Jul 06 23:40:38.350459 ip-10-0-141-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 23:40:38.350468 ip-10-0-141-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 23:40:38.350475 ip-10-0-141-135 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 23:40:38.350720 ip-10-0-141-135 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 23:40:48.361171 ip-10-0-141-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 23:40:48.361187 ip-10-0-141-135 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4e680411d45a43508e6d51d84819993a --
Jul 06 23:42:18.308381 ip-10-0-141-135 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 23:42:18.755059 ip-10-0-141-135 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:42:18.755059 ip-10-0-141-135 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 23:42:18.755059 ip-10-0-141-135 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:42:18.755059 ip-10-0-141-135 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 23:42:18.755059 ip-10-0-141-135 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:42:18.756241 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.756098    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 23:42:18.761946 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761920    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:42:18.761946 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761940    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:42:18.761946 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761945    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:42:18.761946 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761949    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761957    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761963    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761967    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761971    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761977    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761988    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761992    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.761996    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762001    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762005    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762008    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762012    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762016    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762020    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762023    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762028    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762031    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762039    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:42:18.762225 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762044    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762047    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762052    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762056    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762060    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762064    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762086    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762091    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762095    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762114    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762119    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762123    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762132    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762137    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762142    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762147    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762152    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762157    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762161    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762166    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:42:18.763007 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762170    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762174    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762179    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762183    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762188    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762198    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762202    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762210    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762214    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762219    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762223    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762227    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762231    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762236    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762240    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762245    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762254    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762259    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762264    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762268    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762273    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:42:18.763841 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762277    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762283    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762287    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762291    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762296    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762301    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762307    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762311    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762320    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762324    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762329    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762333    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762338    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762343    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762347    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762351    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762356    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762360    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762365    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762373    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:42:18.764732 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762384    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762389    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762395    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762399    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762403    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762408    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762412    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762416    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762421    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762425    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762429    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762434    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762442    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762447    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762454    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.762458    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764430    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764440    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764446    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:42:18.765595 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764456    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764461    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764469    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764475    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764480    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764485    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764490    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764495    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764500    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764505    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764512    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764518    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764528    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764533    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764541    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764547    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764554    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764558    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764563    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:42:18.766400 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764568    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764573    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764577    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764582    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764586    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764595    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764599    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764603    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764607    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764613    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764617    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764622    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764627    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764631    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764635    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764640    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764644    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764653    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764657    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764661    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:42:18.766935 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764666    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764670    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764674    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764679    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764683    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764687    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764692    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764696    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764700    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764705    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764714    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764718    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764722    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764726    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764730    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764734    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764739    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764743    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764747    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764751    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:42:18.767548 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764755    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764760    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764766    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764775    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764779    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764784    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764788    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764792    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764796    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764801    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764805    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764809    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764813    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764820    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764824    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764833    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764837    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764841    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764846    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764851    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:42:18.768035 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764858    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764863    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764868    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764873    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764877    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764881    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764886    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764895    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764899    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764903    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764907    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764912    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764916    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764920    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764924    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764929    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.764934    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.765986    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.765995    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:42:18.768543 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766000    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766006    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766011    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766015    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766025    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766030    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766035    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766040    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766044    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766048    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766052    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766056    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766061    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766065    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766088    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766093    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766101    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766106    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766110    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766117    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:42:18.769003 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766124    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766129    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766133    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766138    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766143    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766149    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766155    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766160    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766172    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766177    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766181    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766186    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766190    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766194    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766199    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766203    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766207    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766212    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766216    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766221    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:42:18.769526 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766226    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766235    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766239    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766243    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766248    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766252    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766257    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766262    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766266    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766271    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766275    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766280    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766286    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766295    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766300    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766304    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766308    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766313    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766317    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766321    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:42:18.770023 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766326    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766331    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766337    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766342    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766779    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766905    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766910    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766913    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766916    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766919    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766922    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766925    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766927    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766930    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766932    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766935    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766938    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766940    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766945    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:42:18.770523 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766948    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766950    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766953    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766956    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766958    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766961    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766964    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766967    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766970    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766972    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766975    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766977    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766980    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766982    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766985    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766988    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766990    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.766993    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767106    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767116    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767126    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 23:42:18.770979 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767130    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767134    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767138    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767142    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767146    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767150    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767152    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767156    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767159    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767162    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767165    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767167    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767170    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767173    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767177    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767181    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767184    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767187    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767190    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767193    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767197    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767200    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767203    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 23:42:18.771542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767206    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767209    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767212    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767215    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767218    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767220    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767225    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767228    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767230    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767233    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767236    2581 flags.go:64] FLAG: --enable-server="true"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767239    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767245    2581 flags.go:64] FLAG: --event-burst="100"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767248    2581 flags.go:64] FLAG: --event-qps="50"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767250    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767253    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767256    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767260    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767262    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767265    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767268    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767271    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767274    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767278    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767281    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 23:42:18.772110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767284    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767286    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767289    2581 flags.go:64] FLAG: --feature-gates=""
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767293    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767296    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767299    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767302    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767305    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767307    2581 flags.go:64] FLAG: --help="false"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767310    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-141-135.ec2.internal"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767313    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767316    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767319    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767323    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767327    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767330    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767333    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767336    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767338    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767341    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767344    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767347    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767350    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767352    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 23:42:18.772734 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767355    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767358    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767360    2581 flags.go:64] FLAG: --lock-file=""
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767363    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767366    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767369    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767377    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767382    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767385    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767388    2581 flags.go:64] FLAG: --logging-format="text"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767391    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767394    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767397    2581 flags.go:64] FLAG: --manifest-url=""
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767400    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767405    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767408    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767411    2581 flags.go:64] FLAG: --max-pods="110"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767414    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767417    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767420    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767423    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767427    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767430    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767433    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767446    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 23:42:18.773335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767449    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767452    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767455    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767458    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767464    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767466    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767470    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767472    2581 flags.go:64] FLAG: --port="10250"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767475    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767478    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0156771723d69247f"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767481    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767484    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767487    2581 flags.go:64] FLAG: --register-node="true"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767492    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767495    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767499    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767502    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767504    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767508    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767510    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767513    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767516    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767519    2581 flags.go:64] FLAG: --runonce="false"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767521    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767524    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 23:42:18.773956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767527    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767529    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767532    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767535    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767539    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767542    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767545    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767547    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767550    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767554    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767557    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767560    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767562    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767568    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767570    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767573    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767577    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767579    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767582    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767585    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767589    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767592    2581 flags.go:64] FLAG: --v="2"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767596    2581 flags.go:64] FLAG: --version="false"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767601    2581 flags.go:64] FLAG: --vmodule=""
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767605    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 23:42:18.774628 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.767608    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767733    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767737    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767740    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767743    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767746    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767749    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767751    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767754    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767756    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767759    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767764    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767767    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767770    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767772    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767775    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767777    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767780    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767783    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767785    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:42:18.775280 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767788    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767792    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767795    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767798    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767800    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767803    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767805    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767809    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767811    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767814    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767817    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767819    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767822    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767825    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767827    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767830    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767832    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767834    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767837    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:42:18.775767 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767840    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767844    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767847    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767849    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767854    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767857    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767860    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767863    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767866    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767868    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767871    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767874    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767876    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767878    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767881    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767883    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767886    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767889    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767891    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:42:18.776257 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767893    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767897    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767900    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767902    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767904    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767907    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767910    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767912    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767915    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767917    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767920    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767922    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767924    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767927    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767929    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767931    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767934    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767938    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767940    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767942    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:42:18.776727 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767945    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767947    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767950    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767952    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767955    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767957    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767960    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767962    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767964    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767967    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767970    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767972    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767974    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767977    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767980    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767982    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767985    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767987    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767989    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767992    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:42:18.777244 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767994    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.767997    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.768680    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.775773    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.775791    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.775810    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.775816    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775872    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775876    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775879    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775882    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775885    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775888    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775891    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:42:18.777728 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775896    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775899    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775902    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775905    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775907    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775910    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775913    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775916    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775919    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775922    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775924    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775927    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775929    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775933    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775935    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775938    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775940    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775942    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775945    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:42:18.778065 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775947    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775949    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775952    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775955    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775958    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775961    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775964    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775966    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775969    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775972    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775974    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775977    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775979    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775982    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775984    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775987    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775989    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775991    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775994    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775996    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:42:18.778612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.775999    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776001    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776004    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776006    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776009    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776012    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776016    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776018    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776021    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776023    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776026    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776028    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776031    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776033    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776036    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776041    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776045    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776047    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776050    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:42:18.779112 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776053    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776056    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776059    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776062    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776065    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776067    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776084    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776088    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776090    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776093    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776096    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776098    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776101    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776104    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776107    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776109    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776112    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776115    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776117    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776120    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:42:18.779571 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776122    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776125    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776127    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776130    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776132    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776134    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776137    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776140    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776143    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776146    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776154    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776157    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776160    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776162    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.776167    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776275    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:42:18.780037 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776279    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776283    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776286    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776288    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776292    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776294    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776297    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776299    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776302    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776304    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776306    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776309    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776312    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776314    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776317    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776319    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776322    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776324    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776326    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:42:18.780457 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776329    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776332    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776334    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776336    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776339    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776341    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776345    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776348    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776351    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776353    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776355    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776358    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776360    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776362    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776365    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776367    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776369    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776372    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776375    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776378    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:42:18.780917 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776380    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776382    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776385    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776387    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776389    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776393    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776396    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776399    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776401    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776404    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776407    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776409    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776412    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776414    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776418    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776422    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776426    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776430    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776433    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:42:18.781468 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776437    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776441    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776447    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776451    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776454    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776456    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776459    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776462    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776464    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776467    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776469    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776472    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776474    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776477    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776479    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776481    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776484    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776487    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776489    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776491    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:42:18.781926 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776494    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776496    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776499    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776501    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776504    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776506    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776508    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776511    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776513    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776516    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776518    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776521    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776525    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776528    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776531    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776534    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776536    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776538    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776541    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:42:18.782426 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:18.776543    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:42:18.782982 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.776548    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:42:18.782982 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.776654    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 23:42:18.782982 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.780933    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 23:42:18.782982 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.782651    2581 server.go:1019] "Starting client certificate rotation"
Jul 06 23:42:18.782982 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.782766    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:42:18.782982 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.782815    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:42:18.786523 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.786508    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:42:18.787671 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.787654    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:42:18.804503 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.804482    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 06 23:42:18.806882 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.806868    2581 log.go:25] "Validated CRI v1 image API"
Jul 06 23:42:18.809701 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.809681    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 23:42:18.813533 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.813214    2581 fs.go:135] Filesystem UUIDs: map[05c4641c-39b9-49a7-9e30-db7b9de0f840:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ce0d83ac-a1a4-42ac-9440-95ab5e08a0d2:/dev/nvme0n1p4]
Jul 06 23:42:18.813533 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.813239    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 23:42:18.818024 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.818008    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:42:18.820695 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.820586    2581 manager.go:216] Machine: {Timestamp:2026-07-06 23:42:18.819171917 +0000 UTC m=+0.382246539 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099639 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c97573c27860a8ff1a0aec55412ae SystemUUID:ec2c9757-3c27-860a-8ff1-a0aec55412ae BootID:4e680411-d45a-4350-8e6d-51d84819993a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:d3:9c:34:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:d3:9c:34:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:34:65:cd:63:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 23:42:18.820695 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.820691    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 23:42:18.820817 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.820764    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 23:42:18.823005 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.822982    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 23:42:18.823147 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.823008    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 23:42:18.824579 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.824569    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 23:42:18.824618 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.824582    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 23:42:18.824618 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.824589    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:42:18.825457 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.825446    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:42:18.827048 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.827038    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 23:42:18.830627 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.830615    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:42:18.830739 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.830729    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 23:42:18.830778 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.830760    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 23:42:18.830778 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.830770    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 23:42:18.830845 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.830783    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 23:42:18.830845 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.830792    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 06 23:42:18.830845 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.830801    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 23:42:18.831232 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.831219    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:42:18.831264 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.831245    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:42:18.834418 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.834401    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 23:42:18.836714 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.836696    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 23:42:18.836792 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.836727    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 23:42:18.838178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838165    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838181    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838187    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838192    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838200    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838206    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838213    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838218    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838225    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838230    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838238    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 23:42:18.838238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.838243    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 23:42:18.839064 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.839053    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 23:42:18.839064 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.839061    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 23:42:18.840985 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.840965    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 23:42:18.841052 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.840961    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 23:42:18.842121 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.842110    2581 server.go:1268] "Started kubelet"
Jul 06 23:42:18.842288 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.842193    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 23:42:18.842347 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.842244    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 23:42:18.842347 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.842313    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 23:42:18.842965 ip-10-0-141-135 systemd[1]: Started Kubernetes Kubelet.
Jul 06 23:42:18.843758 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.843744    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 23:42:18.844348 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.844336    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 23:42:18.850585 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.850561    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 23:42:18.853244 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.853227    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 23:42:18.854409 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.853332    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-135.ec2.internal.18bfd7e100bdf43d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-135.ec2.internal,UID:ip-10-0-141-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-135.ec2.internal,},FirstTimestamp:2026-07-06 23:42:18.842068029 +0000 UTC m=+0.405142652,LastTimestamp:2026-07-06 23:42:18.842068029 +0000 UTC m=+0.405142652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-135.ec2.internal,}"
Jul 06 23:42:18.854559 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.854545    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 23:42:18.854627 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.854563    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 23:42:18.854670 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.854639    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:18.855375 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855358    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 23:42:18.855375 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855377    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 23:42:18.855533 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855514    2581 factory.go:55] Registering systemd factory
Jul 06 23:42:18.855579 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855532    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 23:42:18.855579 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855537    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 06 23:42:18.855655 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855636    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 23:42:18.855655 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855645    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 23:42:18.855758 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855745    2581 factory.go:153] Registering CRI-O factory
Jul 06 23:42:18.855810 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855762    2581 factory.go:223] Registration of the crio container factory successfully
Jul 06 23:42:18.855810 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855807    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 23:42:18.855899 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855834    2581 factory.go:103] Registering Raw factory
Jul 06 23:42:18.855899 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.855849    2581 manager.go:1196] Started watching for new ooms in manager
Jul 06 23:42:18.856569 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.856554    2581 manager.go:349] Starting recovery of all containers
Jul 06 23:42:18.859469 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.859440    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 23:42:18.859579 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.859551    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 23:42:18.863644 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.863621    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pfnck"
Jul 06 23:42:18.865381 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.865229    2581 manager.go:354] Recovery completed
Jul 06 23:42:18.869559 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.869541    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pfnck"
Jul 06 23:42:18.869934 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.869921    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:42:18.876632 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.876619    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:42:18.876684 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.876646    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:42:18.876684 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.876656    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:42:18.877158 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.877145    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 23:42:18.877210 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.877161    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 23:42:18.877210 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.877164    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:42:18.877210 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.877179    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:42:18.878209 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.878195    2581 policy_none.go:49] "None policy: Start"
Jul 06 23:42:18.878276 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.878214    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 23:42:18.878276 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.878228    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 23:42:18.878536 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.878520    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:42:18.878587 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.878556    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:42:18.878587 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.878566    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:42:18.878587 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.878504    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-135.ec2.internal.18bfd7e102cd5e87  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-135.ec2.internal,UID:ip-10-0-141-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-135.ec2.internal,},FirstTimestamp:2026-07-06 23:42:18.876632711 +0000 UTC m=+0.439707340,LastTimestamp:2026-07-06 23:42:18.876632711 +0000 UTC m=+0.439707340,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-135.ec2.internal,}"
Jul 06 23:42:18.879369 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.879323    2581 policy_none.go:47] "Start"
Jul 06 23:42:18.912801 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.912723    2581 manager.go:337] "Starting Device Plugin manager"
Jul 06 23:42:18.912801 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.912756    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 23:42:18.912801 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.912766    2581 server.go:87] "Starting device plugin registration server"
Jul 06 23:42:18.913122 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.912993    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 23:42:18.913122 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.913004    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 23:42:18.913248 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.913194    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 23:42:18.913248 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.913247    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 23:42:18.913362 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.913254    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 23:42:18.913785 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.913757    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 23:42:18.913859 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.913821    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:18.934828 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.934798    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 23:42:18.936138 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.936122    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 23:42:18.936226 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.936156    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 23:42:18.936226 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.936176    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 23:42:18.936226 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:18.936212    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 23:42:18.938094 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:18.938059    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:42:19.013485 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.013403    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:42:19.014549 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.014532    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:42:19.014617 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.014562    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:42:19.014617 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.014572    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:42:19.014617 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.014597    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.021531 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.021514    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.021607 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.021537    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-135.ec2.internal\": node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.037264 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.037239    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal"]
Jul 06 23:42:19.037349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.037298    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:42:19.038815 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.038800    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:42:19.038906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.038827    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:42:19.038906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.038841    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:42:19.040054 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040041    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:42:19.040185 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.040238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040205    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:42:19.040748 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040731    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:42:19.040829 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040765    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:42:19.040829 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040779    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:42:19.040829 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040733    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:42:19.040973 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040832    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:42:19.040973 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.040842    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:42:19.041979 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.041964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.042091 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.042017    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:42:19.042703 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.042685    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:42:19.042784 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.042718    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:42:19.042784 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.042733    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:42:19.048598 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.048582    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.072876 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.072849    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-135.ec2.internal\" not found" node="ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.077481 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.077465    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-135.ec2.internal\" not found" node="ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.149433 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.149405    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.156697 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.156678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d52d6bafcb966b7b60c7d49f22f741f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal\" (UID: \"1d52d6bafcb966b7b60c7d49f22f741f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.156751 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.156702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d52d6bafcb966b7b60c7d49f22f741f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal\" (UID: \"1d52d6bafcb966b7b60c7d49f22f741f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.156751 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.156720    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd626705719bc16cf230177693ed77f5-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.ec2.internal\" (UID: \"dd626705719bc16cf230177693ed77f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.249858 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.249830    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.257172 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.257153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d52d6bafcb966b7b60c7d49f22f741f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal\" (UID: \"1d52d6bafcb966b7b60c7d49f22f741f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.257219 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.257178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d52d6bafcb966b7b60c7d49f22f741f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal\" (UID: \"1d52d6bafcb966b7b60c7d49f22f741f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.257219 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.257194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd626705719bc16cf230177693ed77f5-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.ec2.internal\" (UID: \"dd626705719bc16cf230177693ed77f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.257294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.257242    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd626705719bc16cf230177693ed77f5-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.ec2.internal\" (UID: \"dd626705719bc16cf230177693ed77f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.257294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.257252    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d52d6bafcb966b7b60c7d49f22f741f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal\" (UID: \"1d52d6bafcb966b7b60c7d49f22f741f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.257294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.257273    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d52d6bafcb966b7b60c7d49f22f741f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal\" (UID: \"1d52d6bafcb966b7b60c7d49f22f741f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.350686 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.350616    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.377076 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.377050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.381677 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.381463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:19.451766 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.451732    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.552332 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.552303    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.652930 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.652852    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.753452 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.753419    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.781892 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.781865    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 23:42:19.782447 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.781995    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:42:19.802285 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.802261    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:42:19.854086 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.854047    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.875242 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.875205    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:37:19 +0000 UTC" deadline="2028-02-21 17:42:27.918995702 +0000 UTC"
Jul 06 23:42:19.875242 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.875235    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14274h0m8.043763502s"
Jul 06 23:42:19.954399 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:19.954340    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-135.ec2.internal\" not found"
Jul 06 23:42:19.981423 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:19.981398    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:42:20.054802 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.054768    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:20.068540 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.068517    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:42:20.069609 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.069597    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal"
Jul 06 23:42:20.078684 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.078667    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:42:20.097612 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:20.097585    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d52d6bafcb966b7b60c7d49f22f741f.slice/crio-50745c4be2068cfa818a65832b6ecb4683ccee4984ce67a8744b202d5e56867a WatchSource:0}: Error finding container 50745c4be2068cfa818a65832b6ecb4683ccee4984ce67a8744b202d5e56867a: Status 404 returned error can't find the container with id 50745c4be2068cfa818a65832b6ecb4683ccee4984ce67a8744b202d5e56867a
Jul 06 23:42:20.097844 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:20.097824    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd626705719bc16cf230177693ed77f5.slice/crio-fdff9984bf27445a14ae5eee4f2e06230b0d92851bf89bf0b901c9ed961e64f7 WatchSource:0}: Error finding container fdff9984bf27445a14ae5eee4f2e06230b0d92851bf89bf0b901c9ed961e64f7: Status 404 returned error can't find the container with id fdff9984bf27445a14ae5eee4f2e06230b0d92851bf89bf0b901c9ed961e64f7
Jul 06 23:42:20.102001 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.101986    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:42:20.362548 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.362477    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:42:20.832877 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.832793    2581 apiserver.go:52] "Watching apiserver"
Jul 06 23:42:20.844952 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.844926    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 23:42:20.845447 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.845407    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-2t94n","openshift-multus/multus-additional-cni-plugins-76ssm","openshift-network-diagnostics/network-check-target-x5nq7","kube-system/konnectivity-agent-tbpqg","kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zv27z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal","openshift-multus/network-metrics-daemon-vxhgw","openshift-network-operator/iptables-alerter-rrqqk","openshift-ovn-kubernetes/ovnkube-node-zdkg2","kube-system/global-pull-secret-syncer-5ngh2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz","openshift-dns/node-resolver-4zmkt","openshift-image-registry/node-ca-tvqqp"]
Jul 06 23:42:20.847179 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.847160    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.848576 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.848550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.850054 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.850030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s62bx\""
Jul 06 23:42:20.850181 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.850059    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 23:42:20.850181 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.850060    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:42:20.851048 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.850926    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:20.851048 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.851008    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:20.851322 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.851305    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 23:42:20.851931 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.851578    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 23:42:20.851931 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.851596    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 23:42:20.851931 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.851709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 23:42:20.851931 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.851825    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 23:42:20.852636 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.852596    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8gz6t\""
Jul 06 23:42:20.853005 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.852982    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:20.854455 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.854431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.855289 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.855261    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 23:42:20.855618 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.855596    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 23:42:20.855725 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.855659    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 23:42:20.855904 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.855837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sn7x6\""
Jul 06 23:42:20.856096 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.856078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:20.856196 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.856164    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:20.856934 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.856918    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-588bl\""
Jul 06 23:42:20.857280 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.857259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 23:42:20.858555 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.858537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:20.860221 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.860195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.861592 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.861364    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:42:20.861592 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.861365    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 23:42:20.862232 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.862214    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hf4jw\""
Jul 06 23:42:20.862232 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.862235    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:20.862385 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.862304    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 23:42:20.862385 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.862305    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:20.862966 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.862944    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 23:42:20.864040 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.864017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.866462 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.865083    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 23:42:20.866462 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.866271    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.866655    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.866817    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vfjdm\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.866830    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.867468    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.867856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.867952    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mj6sg\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868238    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868413    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-modprobe-d\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-var-lib-kubelet\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-tuned\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3cb58676-3117-414a-a26d-47074eef5c28-cni-binary-copy\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-cni-multus\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29t2n\" (UniqueName: \"kubernetes.io/projected/3cb58676-3117-414a-a26d-47074eef5c28-kube-api-access-29t2n\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysconfig\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868696    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-sys\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-cnibin\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-cni-bin\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.868920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-etc-kubernetes\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysctl-conf\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.871084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-run\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frtk8\" (UniqueName: \"kubernetes.io/projected/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-kube-api-access-frtk8\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-system-cni-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-cnibin\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-k8s-cni-cncf-io\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-lib-modules\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-host\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-netns\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbbn9\" (UniqueName: \"kubernetes.io/projected/9db7af15-6242-4232-8360-f16cf026a105-kube-api-access-kbbn9\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-kubernetes\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-systemd\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-tmp\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcl2r\" (UniqueName: \"kubernetes.io/projected/93f000d0-9c04-4e80-b965-2cf287e55da4-kube-api-access-rcl2r\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysctl-d\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.872349 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.869931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-cni-binary-copy\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870212    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-cni-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-socket-dir-parent\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-kubelet\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-conf-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-system-cni-dir\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-os-release\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ee05db7-407c-4ae3-8853-93838cb15fa7-agent-certs\") pod \"konnectivity-agent-tbpqg\" (UID: \"7ee05db7-407c-4ae3-8853-93838cb15fa7\") " pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ee05db7-407c-4ae3-8853-93838cb15fa7-konnectivity-ca\") pod \"konnectivity-agent-tbpqg\" (UID: \"7ee05db7-407c-4ae3-8853-93838cb15fa7\") " pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3cb58676-3117-414a-a26d-47074eef5c28-multus-daemon-config\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-multus-certs\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-os-release\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.870890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-hostroot\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.871350    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 23:42:20.872906 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.872012    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 23:42:20.873740 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.872122    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bljkr\""
Jul 06 23:42:20.873796 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.873743    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 23:42:20.873796 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.873790    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 23:42:20.874012 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.873995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 23:42:20.874159 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.874135    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mm56r\""
Jul 06 23:42:20.890535 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.890514    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:42:20.903862 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.903842    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qchds"
Jul 06 23:42:20.910023 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.910002    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qchds"
Jul 06 23:42:20.942024 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.941961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal" event={"ID":"1d52d6bafcb966b7b60c7d49f22f741f","Type":"ContainerStarted","Data":"50745c4be2068cfa818a65832b6ecb4683ccee4984ce67a8744b202d5e56867a"}
Jul 06 23:42:20.943409 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.943382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal" event={"ID":"dd626705719bc16cf230177693ed77f5","Type":"ContainerStarted","Data":"fdff9984bf27445a14ae5eee4f2e06230b0d92851bf89bf0b901c9ed961e64f7"}
Jul 06 23:42:20.957079 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.957057    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 23:42:20.971057 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-host\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.971195 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-netns\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.971195 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:20.971195 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-ovn\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.971195 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971164    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-host\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.971195 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-registration-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.971195 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-sys-fs\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3353df0-539e-4d70-b25d-51ca45b40093-serviceca\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-kubernetes\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.971285    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-systemd\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-tmp\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.971370    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs podName:9db7af15-6242-4232-8360-f16cf026a105 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:21.471346862 +0000 UTC m=+3.034421492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs") pod "network-metrics-daemon-vxhgw" (UID: "9db7af15-6242-4232-8360-f16cf026a105") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcl2r\" (UniqueName: \"kubernetes.io/projected/93f000d0-9c04-4e80-b965-2cf287e55da4-kube-api-access-rcl2r\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jj9b\" (UniqueName: \"kubernetes.io/projected/5ff51189-b638-4fe8-8fa0-fbc7cd197639-kube-api-access-7jj9b\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3353df0-539e-4d70-b25d-51ca45b40093-host\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-kubelet-config\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.971473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-kubelet\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-conf-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-var-lib-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-node-log\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971652    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4t4\" (UniqueName: \"kubernetes.io/projected/c41dd51b-5d92-4655-b244-4e67ece99b87-kube-api-access-4l4t4\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-os-release\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ee05db7-407c-4ae3-8853-93838cb15fa7-konnectivity-ca\") pod \"konnectivity-agent-tbpqg\" (UID: \"7ee05db7-407c-4ae3-8853-93838cb15fa7\") " pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3cb58676-3117-414a-a26d-47074eef5c28-multus-daemon-config\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff51189-b638-4fe8-8fa0-fbc7cd197639-hosts-file\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-systemd-units\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-slash\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-os-release\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-hostroot\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-kubelet\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.972214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-etc-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-modprobe-d\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-var-lib-kubelet\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972166    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-modprobe-d\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-cni-multus\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29t2n\" (UniqueName: \"kubernetes.io/projected/3cb58676-3117-414a-a26d-47074eef5c28-kube-api-access-29t2n\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.971685    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-netns\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972265    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-os-release\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972388    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.972922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.972786    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ee05db7-407c-4ae3-8853-93838cb15fa7-konnectivity-ca\") pod \"konnectivity-agent-tbpqg\" (UID: \"7ee05db7-407c-4ae3-8853-93838cb15fa7\") " pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:20.973213 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973010    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.973336 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3cb58676-3117-414a-a26d-47074eef5c28-multus-daemon-config\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.973472 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973414    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-var-lib-kubelet\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.973472 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973398    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-kubelet\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.973645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973494    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-conf-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.973645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973541    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.973645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-env-overrides\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.973645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973556    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-os-release\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.973645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysconfig\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.973645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973635    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-hostroot\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.973645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973620    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-kubernetes\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973674    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysconfig\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973689    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-cni-multus\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-cnibin\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973715    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-systemd\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973738    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-cnibin\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-etc-kubernetes\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973816    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-etc-kubernetes\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-systemd\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-cni-bin\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4w6\" (UniqueName: \"kubernetes.io/projected/803acd24-62fb-490b-a833-cb168a082e02-kube-api-access-tr4w6\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.974018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.973966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-run\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974031    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-run\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff51189-b638-4fe8-8fa0-fbc7cd197639-tmp-dir\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbbn9\" (UniqueName: \"kubernetes.io/projected/9db7af15-6242-4232-8360-f16cf026a105-kube-api-access-kbbn9\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-run-ovn-kubernetes\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-device-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974248    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-dbus\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b23d1f4-6630-49a1-94ea-5f610456022f-iptables-alerter-script\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-multus-certs\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysctl-d\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-cni-binary-copy\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-cni-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.974516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974484    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-cni-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974543    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-multus-certs\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-socket-dir-parent\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-run-netns\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974657    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysctl-d\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-ovnkube-config\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-system-cni-dir\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ee05db7-407c-4ae3-8853-93838cb15fa7-agent-certs\") pod \"konnectivity-agent-tbpqg\" (UID: \"7ee05db7-407c-4ae3-8853-93838cb15fa7\") " pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b23d1f4-6630-49a1-94ea-5f610456022f-host-slash\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-socket-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-tuned\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3cb58676-3117-414a-a26d-47074eef5c28-cni-binary-copy\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/803acd24-62fb-490b-a833-cb168a082e02-ovn-node-metrics-cert\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmfhq\" (UniqueName: \"kubernetes.io/projected/d3353df0-539e-4d70-b25d-51ca45b40093-kube-api-access-zmfhq\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-sys\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-cni-bin\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975071 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.974978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-cni-netd\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-ovnkube-script-lib\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysctl-conf\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frtk8\" (UniqueName: \"kubernetes.io/projected/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-kube-api-access-frtk8\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-system-cni-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f000d0-9c04-4e80-b965-2cf287e55da4-cni-binary-copy\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-cnibin\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-k8s-cni-cncf-io\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975216    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-multus-socket-dir-parent\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qllvc\" (UniqueName: \"kubernetes.io/projected/2b23d1f4-6630-49a1-94ea-5f610456022f-kube-api-access-qllvc\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-log-socket\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975267    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f000d0-9c04-4e80-b965-2cf287e55da4-system-cni-dir\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-lib-modules\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975395    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-sys\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975436    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-var-lib-cni-bin\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975565    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-sysctl-conf\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.975746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975661    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-system-cni-dir\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.976804 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975740    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-cnibin\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.976804 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975789    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3cb58676-3117-414a-a26d-47074eef5c28-host-run-k8s-cni-cncf-io\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.976804 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975869    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-tmp\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.976804 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.975895    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-lib-modules\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.976804 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.976379    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3cb58676-3117-414a-a26d-47074eef5c28-cni-binary-copy\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:20.979061 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.979037    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-etc-tuned\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.979914 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.979853    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ee05db7-407c-4ae3-8853-93838cb15fa7-agent-certs\") pod \"konnectivity-agent-tbpqg\" (UID: \"7ee05db7-407c-4ae3-8853-93838cb15fa7\") " pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:20.983532 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.983243    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:42:20.983532 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.983272    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:42:20.983532 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.983287    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dtmhx for pod openshift-network-diagnostics/network-check-target-x5nq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:20.983532 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:20.983344    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx podName:94c76581-bb87-4ecc-9d71-e2857678ad4a nodeName:}" failed. No retries permitted until 2026-07-06 23:42:21.483325842 +0000 UTC m=+3.046400456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dtmhx" (UniqueName: "kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx") pod "network-check-target-x5nq7" (UID: "94c76581-bb87-4ecc-9d71-e2857678ad4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:20.983932 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.983894    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcl2r\" (UniqueName: \"kubernetes.io/projected/93f000d0-9c04-4e80-b965-2cf287e55da4-kube-api-access-rcl2r\") pod \"multus-additional-cni-plugins-76ssm\" (UID: \"93f000d0-9c04-4e80-b965-2cf287e55da4\") " pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:20.986481 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.986460    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frtk8\" (UniqueName: \"kubernetes.io/projected/786a1095-2c1c-4f70-afbf-2b4f27d89ee0-kube-api-access-frtk8\") pod \"tuned-zv27z\" (UID: \"786a1095-2c1c-4f70-afbf-2b4f27d89ee0\") " pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:20.987309 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.987287    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbbn9\" (UniqueName: \"kubernetes.io/projected/9db7af15-6242-4232-8360-f16cf026a105-kube-api-access-kbbn9\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:20.987713 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:20.987691    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29t2n\" (UniqueName: \"kubernetes.io/projected/3cb58676-3117-414a-a26d-47074eef5c28-kube-api-access-29t2n\") pod \"multus-2t94n\" (UID: \"3cb58676-3117-414a-a26d-47074eef5c28\") " pod="openshift-multus/multus-2t94n"
Jul 06 23:42:21.075847 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-run-netns\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.075847 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-ovnkube-config\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b23d1f4-6630-49a1-94ea-5f610456022f-host-slash\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-socket-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/803acd24-62fb-490b-a833-cb168a082e02-ovn-node-metrics-cert\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmfhq\" (UniqueName: \"kubernetes.io/projected/d3353df0-539e-4d70-b25d-51ca45b40093-kube-api-access-zmfhq\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075967    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b23d1f4-6630-49a1-94ea-5f610456022f-host-slash\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-cni-netd\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076005    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-ovnkube-script-lib\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.076109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qllvc\" (UniqueName: \"kubernetes.io/projected/2b23d1f4-6630-49a1-94ea-5f610456022f-kube-api-access-qllvc\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-log-socket\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-ovn\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-registration-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-sys-fs\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3353df0-539e-4d70-b25d-51ca45b40093-serviceca\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jj9b\" (UniqueName: \"kubernetes.io/projected/5ff51189-b638-4fe8-8fa0-fbc7cd197639-kube-api-access-7jj9b\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3353df0-539e-4d70-b25d-51ca45b40093-host\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-kubelet-config\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-var-lib-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-node-log\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076429    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-socket-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4t4\" (UniqueName: \"kubernetes.io/projected/c41dd51b-5d92-4655-b244-4e67ece99b87-kube-api-access-4l4t4\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076484    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff51189-b638-4fe8-8fa0-fbc7cd197639-hosts-file\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-systemd-units\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.076717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.075963    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-run-netns\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-slash\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076321    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-log-socket\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-kubelet\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-etc-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-ovn\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-env-overrides\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076682    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-cni-netd\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-registration-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-systemd\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-cni-bin\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.076748    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076755    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-systemd\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076762    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4w6\" (UniqueName: \"kubernetes.io/projected/803acd24-62fb-490b-a833-cb168a082e02-kube-api-access-tr4w6\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076763    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-sys-fs\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.076802    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret podName:eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb nodeName:}" failed. No retries permitted until 2026-07-06 23:42:21.576784309 +0000 UTC m=+3.139858920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret") pod "global-pull-secret-syncer-5ngh2" (UID: "eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076806    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3353df0-539e-4d70-b25d-51ca45b40093-host\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:21.077593 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076820    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-slash\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076854    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-kubelet-config\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076907    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-node-log\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff51189-b638-4fe8-8fa0-fbc7cd197639-tmp-dir\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076942    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-systemd-units\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076978    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-kubelet\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.076979    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-var-lib-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077075    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-etc-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077092    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff51189-b638-4fe8-8fa0-fbc7cd197639-hosts-file\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077129    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-cni-bin\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077130    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-run-openvswitch\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-run-ovn-kubernetes\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077231    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/803acd24-62fb-490b-a833-cb168a082e02-host-run-ovn-kubernetes\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-device-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077279    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.078489 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-dbus\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077338    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3353df0-539e-4d70-b25d-51ca45b40093-serviceca\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c41dd51b-5d92-4655-b244-4e67ece99b87-device-dir\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b23d1f4-6630-49a1-94ea-5f610456022f-iptables-alerter-script\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077468    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff51189-b638-4fe8-8fa0-fbc7cd197639-tmp-dir\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077519    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-dbus\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077587    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-ovnkube-config\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077615    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-env-overrides\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077868    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/803acd24-62fb-490b-a833-cb168a082e02-ovnkube-script-lib\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.079414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.077884    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b23d1f4-6630-49a1-94ea-5f610456022f-iptables-alerter-script\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:21.080557 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.080512    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/803acd24-62fb-490b-a833-cb168a082e02-ovn-node-metrics-cert\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.086465 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.086406    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmfhq\" (UniqueName: \"kubernetes.io/projected/d3353df0-539e-4d70-b25d-51ca45b40093-kube-api-access-zmfhq\") pod \"node-ca-tvqqp\" (UID: \"d3353df0-539e-4d70-b25d-51ca45b40093\") " pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:21.087568 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.087493    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4w6\" (UniqueName: \"kubernetes.io/projected/803acd24-62fb-490b-a833-cb168a082e02-kube-api-access-tr4w6\") pod \"ovnkube-node-zdkg2\" (UID: \"803acd24-62fb-490b-a833-cb168a082e02\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.088192 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.088131    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4t4\" (UniqueName: \"kubernetes.io/projected/c41dd51b-5d92-4655-b244-4e67ece99b87-kube-api-access-4l4t4\") pod \"aws-ebs-csi-driver-node-bzcpz\" (UID: \"c41dd51b-5d92-4655-b244-4e67ece99b87\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.088729 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.088704    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qllvc\" (UniqueName: \"kubernetes.io/projected/2b23d1f4-6630-49a1-94ea-5f610456022f-kube-api-access-qllvc\") pod \"iptables-alerter-rrqqk\" (UID: \"2b23d1f4-6630-49a1-94ea-5f610456022f\") " pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:21.088860 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.088842    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jj9b\" (UniqueName: \"kubernetes.io/projected/5ff51189-b638-4fe8-8fa0-fbc7cd197639-kube-api-access-7jj9b\") pod \"node-resolver-4zmkt\" (UID: \"5ff51189-b638-4fe8-8fa0-fbc7cd197639\") " pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:21.160662 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.160626    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zv27z"
Jul 06 23:42:21.172068 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.172035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-76ssm"
Jul 06 23:42:21.182274 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.182250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:21.183542 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.183519    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f000d0_9c04_4e80_b965_2cf287e55da4.slice/crio-2fd4b36621d2b1a4b80d772014d5fd6ceb7ef10a41772b9cb17d3e840c4e6db7 WatchSource:0}: Error finding container 2fd4b36621d2b1a4b80d772014d5fd6ceb7ef10a41772b9cb17d3e840c4e6db7: Status 404 returned error can't find the container with id 2fd4b36621d2b1a4b80d772014d5fd6ceb7ef10a41772b9cb17d3e840c4e6db7
Jul 06 23:42:21.186975 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.186952    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2t94n"
Jul 06 23:42:21.191387 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.191358    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee05db7_407c_4ae3_8853_93838cb15fa7.slice/crio-f9e2c5423e70be2a32c8e5bb0dd1e94b5990b1512b894a02179f6189d3a8c0dc WatchSource:0}: Error finding container f9e2c5423e70be2a32c8e5bb0dd1e94b5990b1512b894a02179f6189d3a8c0dc: Status 404 returned error can't find the container with id f9e2c5423e70be2a32c8e5bb0dd1e94b5990b1512b894a02179f6189d3a8c0dc
Jul 06 23:42:21.195635 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.195620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrqqk"
Jul 06 23:42:21.196879 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.196845    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb58676_3117_414a_a26d_47074eef5c28.slice/crio-be7b1bb496947ac61383c396b445814a46e9245ddefbd18ded53e9a73ecb51aa WatchSource:0}: Error finding container be7b1bb496947ac61383c396b445814a46e9245ddefbd18ded53e9a73ecb51aa: Status 404 returned error can't find the container with id be7b1bb496947ac61383c396b445814a46e9245ddefbd18ded53e9a73ecb51aa
Jul 06 23:42:21.204248 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.204225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:21.205697 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.205669    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b23d1f4_6630_49a1_94ea_5f610456022f.slice/crio-f697bd559d332d7cccd202d5994d8991de47afeb4a6680f6f84c41dc39f01a26 WatchSource:0}: Error finding container f697bd559d332d7cccd202d5994d8991de47afeb4a6680f6f84c41dc39f01a26: Status 404 returned error can't find the container with id f697bd559d332d7cccd202d5994d8991de47afeb4a6680f6f84c41dc39f01a26
Jul 06 23:42:21.212573 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.212548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz"
Jul 06 23:42:21.214536 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.214511    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803acd24_62fb_490b_a833_cb168a082e02.slice/crio-314dfefc6d84237deb3e760f2abd6ffc8d5bf72e00b4a29b6cf0369eea9e0475 WatchSource:0}: Error finding container 314dfefc6d84237deb3e760f2abd6ffc8d5bf72e00b4a29b6cf0369eea9e0475: Status 404 returned error can't find the container with id 314dfefc6d84237deb3e760f2abd6ffc8d5bf72e00b4a29b6cf0369eea9e0475
Jul 06 23:42:21.221873 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.221851    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4zmkt"
Jul 06 23:42:21.222494 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.222465    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41dd51b_5d92_4655_b244_4e67ece99b87.slice/crio-3f123e1cc992ac4460296efeb2b5d39c0893d7eba7b1fc01360eb57f19b6744d WatchSource:0}: Error finding container 3f123e1cc992ac4460296efeb2b5d39c0893d7eba7b1fc01360eb57f19b6744d: Status 404 returned error can't find the container with id 3f123e1cc992ac4460296efeb2b5d39c0893d7eba7b1fc01360eb57f19b6744d
Jul 06 23:42:21.229227 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.229202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvqqp"
Jul 06 23:42:21.237838 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.237814    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff51189_b638_4fe8_8fa0_fbc7cd197639.slice/crio-0fde9e5309161dd47af837fddfdc574c05bde4cf34b7b47bf55aeec5316b0c41 WatchSource:0}: Error finding container 0fde9e5309161dd47af837fddfdc574c05bde4cf34b7b47bf55aeec5316b0c41: Status 404 returned error can't find the container with id 0fde9e5309161dd47af837fddfdc574c05bde4cf34b7b47bf55aeec5316b0c41
Jul 06 23:42:21.242064 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:21.242038    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3353df0_539e_4d70_b25d_51ca45b40093.slice/crio-1d4935d9cb751a6d87c15b873aff668187b5284f190ee077832f7ef5fbc97193 WatchSource:0}: Error finding container 1d4935d9cb751a6d87c15b873aff668187b5284f190ee077832f7ef5fbc97193: Status 404 returned error can't find the container with id 1d4935d9cb751a6d87c15b873aff668187b5284f190ee077832f7ef5fbc97193
Jul 06 23:42:21.480748 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.480656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:21.480915 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.480832    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:21.480915 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.480909    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs podName:9db7af15-6242-4232-8360-f16cf026a105 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:22.480892659 +0000 UTC m=+4.043967270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs") pod "network-metrics-daemon-vxhgw" (UID: "9db7af15-6242-4232-8360-f16cf026a105") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.581150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.581239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.581360    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.581360    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.581393    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.581407    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dtmhx for pod openshift-network-diagnostics/network-check-target-x5nq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.581432    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret podName:eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb nodeName:}" failed. No retries permitted until 2026-07-06 23:42:22.581411378 +0000 UTC m=+4.144486001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret") pod "global-pull-secret-syncer-5ngh2" (UID: "eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:21.581787 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.581471    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx podName:94c76581-bb87-4ecc-9d71-e2857678ad4a nodeName:}" failed. No retries permitted until 2026-07-06 23:42:22.581463938 +0000 UTC m=+4.144538553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtmhx" (UniqueName: "kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx") pod "network-check-target-x5nq7" (UID: "94c76581-bb87-4ecc-9d71-e2857678ad4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:21.912301 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.912050    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:37:21 +0000 UTC" deadline="2028-02-05 22:15:17.316863146 +0000 UTC"
Jul 06 23:42:21.912710 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.912307    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13894h32m55.404565401s"
Jul 06 23:42:21.936647 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.936621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:21.936793 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:21.936753    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:21.946291 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.946254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz" event={"ID":"c41dd51b-5d92-4655-b244-4e67ece99b87","Type":"ContainerStarted","Data":"3f123e1cc992ac4460296efeb2b5d39c0893d7eba7b1fc01360eb57f19b6744d"}
Jul 06 23:42:21.947678 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.947648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tbpqg" event={"ID":"7ee05db7-407c-4ae3-8853-93838cb15fa7","Type":"ContainerStarted","Data":"f9e2c5423e70be2a32c8e5bb0dd1e94b5990b1512b894a02179f6189d3a8c0dc"}
Jul 06 23:42:21.948900 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.948867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerStarted","Data":"2fd4b36621d2b1a4b80d772014d5fd6ceb7ef10a41772b9cb17d3e840c4e6db7"}
Jul 06 23:42:21.950160 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.950121    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvqqp" event={"ID":"d3353df0-539e-4d70-b25d-51ca45b40093","Type":"ContainerStarted","Data":"1d4935d9cb751a6d87c15b873aff668187b5284f190ee077832f7ef5fbc97193"}
Jul 06 23:42:21.951236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.951209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4zmkt" event={"ID":"5ff51189-b638-4fe8-8fa0-fbc7cd197639","Type":"ContainerStarted","Data":"0fde9e5309161dd47af837fddfdc574c05bde4cf34b7b47bf55aeec5316b0c41"}
Jul 06 23:42:21.952504 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.952481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"314dfefc6d84237deb3e760f2abd6ffc8d5bf72e00b4a29b6cf0369eea9e0475"}
Jul 06 23:42:21.953779 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.953755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrqqk" event={"ID":"2b23d1f4-6630-49a1-94ea-5f610456022f","Type":"ContainerStarted","Data":"f697bd559d332d7cccd202d5994d8991de47afeb4a6680f6f84c41dc39f01a26"}
Jul 06 23:42:21.954972 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.954923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2t94n" event={"ID":"3cb58676-3117-414a-a26d-47074eef5c28","Type":"ContainerStarted","Data":"be7b1bb496947ac61383c396b445814a46e9245ddefbd18ded53e9a73ecb51aa"}
Jul 06 23:42:21.956074 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:21.956053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zv27z" event={"ID":"786a1095-2c1c-4f70-afbf-2b4f27d89ee0","Type":"ContainerStarted","Data":"29e04612f398a33d7860fef6b43d5b5f86069857f31f59e233e1f338a8d88d47"}
Jul 06 23:42:22.488637 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:22.488566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:22.488838 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.488756    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:22.488838 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.488826    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs podName:9db7af15-6242-4232-8360-f16cf026a105 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:24.488806489 +0000 UTC m=+6.051881106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs") pod "network-metrics-daemon-vxhgw" (UID: "9db7af15-6242-4232-8360-f16cf026a105") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:22.589621 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:22.589524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:22.589621 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:22.589609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:22.589861 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.589807    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:42:22.589861 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.589830    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:42:22.589861 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.589845    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dtmhx for pod openshift-network-diagnostics/network-check-target-x5nq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:22.590016 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.589905    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx podName:94c76581-bb87-4ecc-9d71-e2857678ad4a nodeName:}" failed. No retries permitted until 2026-07-06 23:42:24.589885946 +0000 UTC m=+6.152960566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtmhx" (UniqueName: "kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx") pod "network-check-target-x5nq7" (UID: "94c76581-bb87-4ecc-9d71-e2857678ad4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:22.590367 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.590345    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:22.590483 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.590413    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret podName:eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb nodeName:}" failed. No retries permitted until 2026-07-06 23:42:24.590389092 +0000 UTC m=+6.153463711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret") pod "global-pull-secret-syncer-5ngh2" (UID: "eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:22.912894 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:22.912756    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:37:21 +0000 UTC" deadline="2028-03-26 16:12:59.953491824 +0000 UTC"
Jul 06 23:42:22.912894 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:22.912821    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15088h30m37.040675236s"
Jul 06 23:42:22.939393 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:22.939359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:22.939587 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.939496    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:22.939932 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:22.939908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:22.940040 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:22.940012    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:23.937004 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:23.936878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:23.937004 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:23.936998    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:23.970106 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:23.970057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal" event={"ID":"dd626705719bc16cf230177693ed77f5","Type":"ContainerStarted","Data":"a8a97251dba5835239528d5818c4492e6780bedccf4ec2ad6b99819e03e7b4c0"}
Jul 06 23:42:23.988917 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:23.987717    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.ec2.internal" podStartSLOduration=3.9876974450000002 podStartE2EDuration="3.987697445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:23.987470296 +0000 UTC m=+5.550544968" watchObservedRunningTime="2026-07-06 23:42:23.987697445 +0000 UTC m=+5.550772083"
Jul 06 23:42:24.506434 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:24.506392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:24.506596 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.506575    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:24.506690 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.506646    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs podName:9db7af15-6242-4232-8360-f16cf026a105 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:28.506627456 +0000 UTC m=+10.069702075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs") pod "network-metrics-daemon-vxhgw" (UID: "9db7af15-6242-4232-8360-f16cf026a105") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:24.607558 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:24.606966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:24.607558 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:24.607044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:24.607558 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.607249    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:42:24.607558 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.607275    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:42:24.607558 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.607289    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dtmhx for pod openshift-network-diagnostics/network-check-target-x5nq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:24.607558 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.607353    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx podName:94c76581-bb87-4ecc-9d71-e2857678ad4a nodeName:}" failed. No retries permitted until 2026-07-06 23:42:28.607333923 +0000 UTC m=+10.170408553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtmhx" (UniqueName: "kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx") pod "network-check-target-x5nq7" (UID: "94c76581-bb87-4ecc-9d71-e2857678ad4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:24.608090 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.607782    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:24.608090 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.607839    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret podName:eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb nodeName:}" failed. No retries permitted until 2026-07-06 23:42:28.607822581 +0000 UTC m=+10.170897196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret") pod "global-pull-secret-syncer-5ngh2" (UID: "eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:24.936997 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:24.936968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:24.937620 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.937116    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:24.939958 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:24.936928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:24.940089 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:24.940002    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:24.975772 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:24.975712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal" event={"ID":"1d52d6bafcb966b7b60c7d49f22f741f","Type":"ContainerStarted","Data":"21ad1366448696ba9a2d1166c3cf3762f282c74a462df08038e7417f6d9e913e"}
Jul 06 23:42:25.937026 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:25.936932    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:25.937304 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:25.937089    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:25.979234 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:25.979182    2581 generic.go:356] "Generic (PLEG): container finished" podID="1d52d6bafcb966b7b60c7d49f22f741f" containerID="21ad1366448696ba9a2d1166c3cf3762f282c74a462df08038e7417f6d9e913e" exitCode=0
Jul 06 23:42:25.979420 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:25.979257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal" event={"ID":"1d52d6bafcb966b7b60c7d49f22f741f","Type":"ContainerDied","Data":"21ad1366448696ba9a2d1166c3cf3762f282c74a462df08038e7417f6d9e913e"}
Jul 06 23:42:26.938058 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:26.937335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:26.938058 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:26.937504    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:26.938058 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:26.937917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:26.938058 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:26.938011    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:27.936864 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:27.936826    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:27.937075 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:27.936984    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:28.549313 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:28.549268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:28.549796 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.549475    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:28.549796 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.549528    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs podName:9db7af15-6242-4232-8360-f16cf026a105 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:36.54951323 +0000 UTC m=+18.112587847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs") pod "network-metrics-daemon-vxhgw" (UID: "9db7af15-6242-4232-8360-f16cf026a105") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:28.650251 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:28.650084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:28.650439 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.650333    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:42:28.650439 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.650367    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:42:28.650439 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.650379    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dtmhx for pod openshift-network-diagnostics/network-check-target-x5nq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:28.650439 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.650423    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:28.650611 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.650430    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx podName:94c76581-bb87-4ecc-9d71-e2857678ad4a nodeName:}" failed. No retries permitted until 2026-07-06 23:42:36.650415593 +0000 UTC m=+18.213490208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtmhx" (UniqueName: "kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx") pod "network-check-target-x5nq7" (UID: "94c76581-bb87-4ecc-9d71-e2857678ad4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:28.650611 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:28.650333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:28.650611 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.650488    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret podName:eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb nodeName:}" failed. No retries permitted until 2026-07-06 23:42:36.650471552 +0000 UTC m=+18.213546167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret") pod "global-pull-secret-syncer-5ngh2" (UID: "eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:28.937164 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:28.937082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:28.937308 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.937224    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:28.937308 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:28.937279    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:28.937420 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:28.937329    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:29.936781 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:29.936733    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:29.937313 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:29.936897    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:30.936523 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:30.936478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:30.936523 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:30.936528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:30.936779 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:30.936631    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:30.936779 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:30.936740    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:31.936939 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:31.936901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:31.937424 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:31.937046    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:32.937536 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:32.937061    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:32.937536 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:32.937092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:32.937536 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:32.937213    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:32.937536 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:32.937449    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:33.936656 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:33.936624    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:33.936814 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:33.936767    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:34.937091 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:34.937037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:34.937529 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:34.937050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:34.937529 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:34.937193    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:34.937529 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:34.937224    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:35.936994 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:35.936959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:35.937226 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:35.937120    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:36.611340 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:36.611296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:36.611603 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.611480    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:36.611603 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.611560    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs podName:9db7af15-6242-4232-8360-f16cf026a105 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:52.611537057 +0000 UTC m=+34.174611674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs") pod "network-metrics-daemon-vxhgw" (UID: "9db7af15-6242-4232-8360-f16cf026a105") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:36.712769 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:36.712730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:36.712945 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:36.712814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:36.712945 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.712877    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:36.712945 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.712922    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:42:36.712945 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.712939    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:42:36.712945 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.712942    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret podName:eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb nodeName:}" failed. No retries permitted until 2026-07-06 23:42:52.712927538 +0000 UTC m=+34.276002151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret") pod "global-pull-secret-syncer-5ngh2" (UID: "eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:36.712945 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.712948    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dtmhx for pod openshift-network-diagnostics/network-check-target-x5nq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:36.713176 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.712990    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx podName:94c76581-bb87-4ecc-9d71-e2857678ad4a nodeName:}" failed. No retries permitted until 2026-07-06 23:42:52.712975446 +0000 UTC m=+34.276050056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtmhx" (UniqueName: "kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx") pod "network-check-target-x5nq7" (UID: "94c76581-bb87-4ecc-9d71-e2857678ad4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:36.937448 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:36.937364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:36.937874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.937498    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:36.937874 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:36.937568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:36.937874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:36.937690    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:37.937385 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:37.937339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:37.937570 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:37.937479    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:38.937448 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:38.937418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:38.937632 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:38.937462    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:38.937632 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:38.937529    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:38.938021 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:38.937659    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:39.937031 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:39.937000    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:39.937238 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:39.937140    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:40.937218 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:40.937184    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:40.937218 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:40.937205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:40.937725 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:40.937331    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:40.937725 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:40.937469    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:41.937399 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:41.937206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:41.937984 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:41.937486    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:42.015109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.015057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal" event={"ID":"1d52d6bafcb966b7b60c7d49f22f741f","Type":"ContainerStarted","Data":"774f656de6dbedf0129844b9d3ea963f7a96936d3df4e8ba6d3945edcd13a69b"}
Jul 06 23:42:42.016675 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.016645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvqqp" event={"ID":"d3353df0-539e-4d70-b25d-51ca45b40093","Type":"ContainerStarted","Data":"b13712022463957e42e9375d65e6eb9153c4bf5f707eb71bd118dc2bf0b41a92"}
Jul 06 23:42:42.018109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.018065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4zmkt" event={"ID":"5ff51189-b638-4fe8-8fa0-fbc7cd197639","Type":"ContainerStarted","Data":"18941029fdc006910b082e8aef8206671e76014ad5a88de4fd66e144bcba54b4"}
Jul 06 23:42:42.020782 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.020760    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"bdff50fa901584e621c0f61ff241a35032427f998876bdd91e9e05dac7735494"}
Jul 06 23:42:42.020885 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.020824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"ef4464790839dc45183db74a4152a7bf71e0817af4cc89cc5d5c0ec37da7a39b"}
Jul 06 23:42:42.020885 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.020871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"61061b5a26ca84d04b1366a0ab0408568a8f33204cc8eb4bdb767f6565deb320"}
Jul 06 23:42:42.022447 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.022427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2t94n" event={"ID":"3cb58676-3117-414a-a26d-47074eef5c28","Type":"ContainerStarted","Data":"ede1b1b62700043e0ba13e7e9243c238ec966fc6f63263773e0922caa0e4976a"}
Jul 06 23:42:42.023932 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.023907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zv27z" event={"ID":"786a1095-2c1c-4f70-afbf-2b4f27d89ee0","Type":"ContainerStarted","Data":"d7365da2074b51c271f78f8416e4aca31ed2f89a96b2f13ccb4dfd6d6185649b"}
Jul 06 23:42:42.025417 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.025396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz" event={"ID":"c41dd51b-5d92-4655-b244-4e67ece99b87","Type":"ContainerStarted","Data":"259a81b9fe1157353546bb96d8777750cbbd81358b253bd582a273347b4daf53"}
Jul 06 23:42:42.028619 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.027153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tbpqg" event={"ID":"7ee05db7-407c-4ae3-8853-93838cb15fa7","Type":"ContainerStarted","Data":"cb99b24be759a02833db6aa177bf61c41c682d52c54ca72664116eb38b6f3c53"}
Jul 06 23:42:42.030451 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.030403    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.ec2.internal" podStartSLOduration=22.030387912 podStartE2EDuration="22.030387912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:42.030058253 +0000 UTC m=+23.593132886" watchObservedRunningTime="2026-07-06 23:42:42.030387912 +0000 UTC m=+23.593462546"
Jul 06 23:42:42.030567 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.030544    2581 generic.go:356] "Generic (PLEG): container finished" podID="93f000d0-9c04-4e80-b965-2cf287e55da4" containerID="df7d19ab3be042e58055679bed9d9f1a31424f71ff4fd4dc8c922c2c3436ef81" exitCode=0
Jul 06 23:42:42.030630 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.030581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerDied","Data":"df7d19ab3be042e58055679bed9d9f1a31424f71ff4fd4dc8c922c2c3436ef81"}
Jul 06 23:42:42.043297 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.043247    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tbpqg" podStartSLOduration=2.715032137 podStartE2EDuration="23.04322973s" totalImagesPullingTime="20.328197593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:42.043142726 +0000 UTC m=+23.606217335" watchObservedRunningTime="2026-07-06 23:42:42.04322973 +0000 UTC m=+23.606304359"
Jul 06 23:42:42.061465 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.061422    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4zmkt" podStartSLOduration=1.781137129 podStartE2EDuration="22.06140647s" totalImagesPullingTime="20.280269341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:42.061036122 +0000 UTC m=+23.624110756" watchObservedRunningTime="2026-07-06 23:42:42.06140647 +0000 UTC m=+23.624481102"
Jul 06 23:42:42.074910 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.074865    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tvqqp" podStartSLOduration=9.808360406 podStartE2EDuration="22.07484884s" totalImagesPullingTime="12.266488434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:42.074761105 +0000 UTC m=+23.637835736" watchObservedRunningTime="2026-07-06 23:42:42.07484884 +0000 UTC m=+23.637923472"
Jul 06 23:42:42.110063 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.110002    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2t94n" podStartSLOduration=1.725761696 podStartE2EDuration="22.109982697s" totalImagesPullingTime="20.384221001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:42.092365954 +0000 UTC m=+23.655440585" watchObservedRunningTime="2026-07-06 23:42:42.109982697 +0000 UTC m=+23.673057341"
Jul 06 23:42:42.110303 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.110283    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zv27z" podStartSLOduration=2.766513078 podStartE2EDuration="23.110276874s" totalImagesPullingTime="20.343763796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:42.109865166 +0000 UTC m=+23.672939799" watchObservedRunningTime="2026-07-06 23:42:42.110276874 +0000 UTC m=+23.673351505"
Jul 06 23:42:42.659035 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.658972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:42.659750 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.659727    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:42.937350 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.937312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:42.937561 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:42.937367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:42.937561 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:42.937460    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:42.937561 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:42.937542    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:43.038981 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.038943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"7ce32f12cffe9fccb5c7c2c3ca480dd27521a138c14f3a281815218a454d54f0"}
Jul 06 23:42:43.039304 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.039057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"9aefc9af8bbd926b9a1551f44fa70b574ce4581c1e6d0a34831c108230ff9277"}
Jul 06 23:42:43.039304 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.039113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"bae65b735c2873a5cfc8151b37874ecbb52ccef08aa6ae9e2adebf0d9491b7b9"}
Jul 06 23:42:43.040265 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.040226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrqqk" event={"ID":"2b23d1f4-6630-49a1-94ea-5f610456022f","Type":"ContainerStarted","Data":"41693d1c271e171afc77421dccd68e4e8afacf817d733f9077107add99e97979"}
Jul 06 23:42:43.056514 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.056463    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrqqk" podStartSLOduration=2.742753511 podStartE2EDuration="23.056448717s" totalImagesPullingTime="20.313695206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:43.055851685 +0000 UTC m=+24.618926317" watchObservedRunningTime="2026-07-06 23:42:43.056448717 +0000 UTC m=+24.619523348"
Jul 06 23:42:43.516401 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.516369    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 23:42:43.929134 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.929022    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:42:43.516393793Z","UUID":"6fea6b0f-7bb6-4a76-9769-cd7c8c7019d2","Handler":null,"Name":"","Endpoint":""}
Jul 06 23:42:43.930715 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.930686    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 23:42:43.930838 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.930730    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 23:42:43.936654 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:43.936630    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:43.936782 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:43.936743    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:44.044005 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:44.043972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz" event={"ID":"c41dd51b-5d92-4655-b244-4e67ece99b87","Type":"ContainerStarted","Data":"92576e8d2e1b58cff4cff59032116387d96b264f4b9181ef5203eb62ef76d025"}
Jul 06 23:42:44.044389 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:44.044012    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 23:42:44.937231 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:44.937159    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:44.937370 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:44.937159    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:44.937370 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:44.937257    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:44.937370 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:44.937331    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:45.049708 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:45.049539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"8a95b836fe50586388014d5d1418489ad6b9b5d123cf7aea89d997cac71a2983"}
Jul 06 23:42:45.936922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:45.936882    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:45.937127 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:45.937018    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:46.053494 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:46.053463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz" event={"ID":"c41dd51b-5d92-4655-b244-4e67ece99b87","Type":"ContainerStarted","Data":"d7b0bc702e090a3194689cc157c8caeb48eeff99082f2b69ce535dbf890add75"}
Jul 06 23:42:46.072776 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:46.072735    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzcpz" podStartSLOduration=2.76688824 podStartE2EDuration="26.072721877s" totalImagesPullingTime="23.305833637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:46.072483054 +0000 UTC m=+27.635557724" watchObservedRunningTime="2026-07-06 23:42:46.072721877 +0000 UTC m=+27.635796509"
Jul 06 23:42:46.937271 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:46.937242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:46.937457 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:46.937373    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:46.937457 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:46.937411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:46.937586 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:46.937484    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:47.937054 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:47.936993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:47.938062 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:47.937117    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:48.062518 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:48.062215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" event={"ID":"803acd24-62fb-490b-a833-cb168a082e02","Type":"ContainerStarted","Data":"192e593e1b0fdca4106b3b03b8f4c4ac067cd58e96e2709fd05c1bf4fd714fe7"}
Jul 06 23:42:48.062518 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:48.062500    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:48.078467 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:48.078436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:48.118577 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:48.118528    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2" podStartSLOduration=7.742739671 podStartE2EDuration="28.118512704s" totalImagesPullingTime="20.375773033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:42:48.089918427 +0000 UTC m=+29.652993059" watchObservedRunningTime="2026-07-06 23:42:48.118512704 +0000 UTC m=+29.681587356"
Jul 06 23:42:48.940124 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:48.940097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:48.940595 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:48.940186    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:48.940595 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:48.940243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:48.940595 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:48.940326    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:49.068938 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.068903    2581 generic.go:356] "Generic (PLEG): container finished" podID="93f000d0-9c04-4e80-b965-2cf287e55da4" containerID="34b7ec19c1338d2beeaa692736d9f4ac54a71ea629425ff9ec083965892268eb" exitCode=0
Jul 06 23:42:49.069133 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.068964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerDied","Data":"34b7ec19c1338d2beeaa692736d9f4ac54a71ea629425ff9ec083965892268eb"}
Jul 06 23:42:49.069448 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.069430    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:49.069544 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.069507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:49.089981 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.089946    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:42:49.824784 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.824739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5nq7"]
Jul 06 23:42:49.824965 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.824942    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:49.825039 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:49.825022    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:49.828333 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.828306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ngh2"]
Jul 06 23:42:49.828455 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.828422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:49.828547 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:49.828525    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:49.828915 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.828888    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vxhgw"]
Jul 06 23:42:49.829039 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:49.828986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:49.829116 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:49.829067    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:50.936564 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:50.936534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:50.936932 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:50.936630    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:51.076145 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:51.076113    2581 generic.go:356] "Generic (PLEG): container finished" podID="93f000d0-9c04-4e80-b965-2cf287e55da4" containerID="bd7eaf9965bde978a2beba3910440ec11c093008a4197efb3a544013d946248c" exitCode=0
Jul 06 23:42:51.076302 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:51.076196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerDied","Data":"bd7eaf9965bde978a2beba3910440ec11c093008a4197efb3a544013d946248c"}
Jul 06 23:42:51.181619 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:51.181578    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:51.181775 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:51.181720    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 23:42:51.182252 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:51.182220    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tbpqg"
Jul 06 23:42:51.937284 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:51.937133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:51.937585 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:51.937133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:51.937585 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:51.937385    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:51.937585 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:51.937422    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:52.081038 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:52.080947    2581 generic.go:356] "Generic (PLEG): container finished" podID="93f000d0-9c04-4e80-b965-2cf287e55da4" containerID="f605250aaba48cb8b602ffc3d2ec570a7d61fb60c358b9da8171c7ef43c59d1c" exitCode=0
Jul 06 23:42:52.081038 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:52.081028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerDied","Data":"f605250aaba48cb8b602ffc3d2ec570a7d61fb60c358b9da8171c7ef43c59d1c"}
Jul 06 23:42:52.629536 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:52.629500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:52.629739 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.629680    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:52.629783 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.629762    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs podName:9db7af15-6242-4232-8360-f16cf026a105 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:24.629740675 +0000 UTC m=+66.192815300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs") pod "network-metrics-daemon-vxhgw" (UID: "9db7af15-6242-4232-8360-f16cf026a105") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:42:52.730109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:52.730047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:52.730109 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:52.730112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:52.730302 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.730192    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:52.730302 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.730208    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:42:52.730302 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.730227    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:42:52.730302 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.730237    2581 projected.go:196] Error preparing data for projected volume kube-api-access-dtmhx for pod openshift-network-diagnostics/network-check-target-x5nq7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:52.730302 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.730253    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret podName:eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb nodeName:}" failed. No retries permitted until 2026-07-06 23:43:24.730239106 +0000 UTC m=+66.293313719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret") pod "global-pull-secret-syncer-5ngh2" (UID: "eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:42:52.730302 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.730278    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx podName:94c76581-bb87-4ecc-9d71-e2857678ad4a nodeName:}" failed. No retries permitted until 2026-07-06 23:43:24.730264468 +0000 UTC m=+66.293339110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtmhx" (UniqueName: "kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx") pod "network-check-target-x5nq7" (UID: "94c76581-bb87-4ecc-9d71-e2857678ad4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:42:52.936925 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:52.936894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:52.937090 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:52.937021    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:53.937084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:53.937036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:53.937659 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:53.937036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:53.937659 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:53.937182    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ngh2" podUID="eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb"
Jul 06 23:42:53.937659 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:53.937253    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxhgw" podUID="9db7af15-6242-4232-8360-f16cf026a105"
Jul 06 23:42:54.937282 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:54.937253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:54.937715 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:54.937384    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5nq7" podUID="94c76581-bb87-4ecc-9d71-e2857678ad4a"
Jul 06 23:42:55.284241 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.284122    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-135.ec2.internal" event="NodeReady"
Jul 06 23:42:55.284683 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.284284    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 23:42:55.320891 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.320856    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9c88c9578-rm586"]
Jul 06 23:42:55.323089 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.323053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.325306 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.324990    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mzzc9"]
Jul 06 23:42:55.327283 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.327263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.329665 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.329640    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 23:42:55.329785 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.329684    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 23:42:55.329876 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.329862    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 23:42:55.330514 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.330494    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"]
Jul 06 23:42:55.331386 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.331360    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fdhzs\""
Jul 06 23:42:55.332338 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.332218    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"]
Jul 06 23:42:55.332917 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.332897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.333016 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.332930    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 23:42:55.333393 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.333370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 23:42:55.333624 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.333604    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.333995 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.333980    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"]
Jul 06 23:42:55.334286 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.334268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"
Jul 06 23:42:55.334606 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.334484    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.334986 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.334843    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qtnxx\""
Jul 06 23:42:55.335819 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.335790    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"]
Jul 06 23:42:55.336038 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.336018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:55.341172 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.339310    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"]
Jul 06 23:42:55.341288 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.341207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.342246 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.342170    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 23:42:55.342306 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.342252    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 23:42:55.342771 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.342615    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-564bc8fbd9-sfkr9"]
Jul 06 23:42:55.342771 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.342758    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.344178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.343213    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.344178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.343289    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sjcnp\""
Jul 06 23:42:55.344178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.343365    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 23:42:55.344178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.343531    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.344178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.343563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 23:42:55.344178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.343594    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8zv8b\""
Jul 06 23:42:55.344178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.343626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.344589 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.344573    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.345227 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.345125    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.345468 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.345446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-62bfr\""
Jul 06 23:42:55.345578 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.345516    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.345639 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.345620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.345754 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.345737    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9zrf\""
Jul 06 23:42:55.345922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.345893    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.345922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.346053    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-pr4j6"]
Jul 06 23:42:55.345922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.346130    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 23:42:55.345922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.346474    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.345922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.346618    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 23:42:55.345922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.346657    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.345922 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.346767    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.347603 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.347583    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6l572\""
Jul 06 23:42:55.347603 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.347598    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 23:42:55.347875 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.347860    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 23:42:55.347946 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.347879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 23:42:55.348023 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.348000    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.349266 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.349236    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.349374 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.349329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 23:42:55.350422 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.350401    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.350546 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.350533    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 23:42:55.350661 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.350649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 23:42:55.350754 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.350736    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.351045 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.351022    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 23:42:55.351405 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.351276    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.351405 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.351362    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sb2h8\""
Jul 06 23:42:55.351516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.351278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mzzc9"]
Jul 06 23:42:55.352578 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.352560    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 23:42:55.352793 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.352773    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 23:42:55.353062 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.352564    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jf9dw\""
Jul 06 23:42:55.356943 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.353843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"]
Jul 06 23:42:55.357863 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.357842    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"]
Jul 06 23:42:55.358966 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.358946    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9c88c9578-rm586"]
Jul 06 23:42:55.359691 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.359670    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 23:42:55.359960 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.359944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"]
Jul 06 23:42:55.361004 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.360854    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"]
Jul 06 23:42:55.361698 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.361675    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-564bc8fbd9-sfkr9"]
Jul 06 23:42:55.363997 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.363977    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sbgpl"]
Jul 06 23:42:55.367836 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.367818    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.368591 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.368571    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"]
Jul 06 23:42:55.370646 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.370629    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gv9xc"]
Jul 06 23:42:55.370818 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.370800    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.370890 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.370842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 23:42:55.372717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.370802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9whhz\""
Jul 06 23:42:55.372717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.370964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.372717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.371022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"
Jul 06 23:42:55.374724 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.374703    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:42:55.375328 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.375293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qrp7f\""
Jul 06 23:42:55.376047 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.376017    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:42:55.377762 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.377744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-pr4j6"]
Jul 06 23:42:55.377920 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.377859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.378525 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.378507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbgpl"]
Jul 06 23:42:55.381059 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.381033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 23:42:55.383839 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.383788    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 23:42:55.384044 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.384026    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-94g74\""
Jul 06 23:42:55.387321 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.387298    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"]
Jul 06 23:42:55.389663 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.389649    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"]
Jul 06 23:42:55.390546 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.390525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gv9xc"]
Jul 06 23:42:55.451066 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.451260 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5005f58d-c89e-4ed4-8e6d-44a0b1276564-snapshots\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.451260 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtd5r\" (UniqueName: \"kubernetes.io/projected/70be42eb-2adf-41ea-9e24-fc9e55be08ae-kube-api-access-vtd5r\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:55.451260 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-stats-auth\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.451260 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5005f58d-c89e-4ed4-8e6d-44a0b1276564-tmp\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.451260 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.451260 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-config\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-serving-cert\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-trusted-ca\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fncnq\" (UniqueName: \"kubernetes.io/projected/a52cf257-070d-4088-ac86-64ec27c8411d-kube-api-access-fncnq\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a52cf257-070d-4088-ac86-64ec27c8411d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwcgf\" (UniqueName: \"kubernetes.io/projected/b35e4cf1-62eb-48c9-8f8e-c96fd76ac249-kube-api-access-lwcgf\") pod \"volume-data-source-validator-5d456fdbcd-6fqnp\" (UID: \"b35e4cf1-62eb-48c9-8f8e-c96fd76ac249\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5005f58d-c89e-4ed4-8e6d-44a0b1276564-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frkjf\" (UniqueName: \"kubernetes.io/projected/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-kube-api-access-frkjf\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.451482 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dcj\" (UniqueName: \"kubernetes.io/projected/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-kube-api-access-w7dcj\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6vpp\" (UniqueName: \"kubernetes.io/projected/5005f58d-c89e-4ed4-8e6d-44a0b1276564-kube-api-access-z6vpp\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9vj\" (UniqueName: \"kubernetes.io/projected/60199009-fd69-4b69-9cfc-cf7d1b796ee5-kube-api-access-jv9vj\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-trusted-ca\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5005f58d-c89e-4ed4-8e6d-44a0b1276564-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-image-registry-private-configuration\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-installation-pull-secrets\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9thkv\" (UniqueName: \"kubernetes.io/projected/cf429cde-a177-4917-bcfe-b91c08621c28-kube-api-access-9thkv\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-default-certificate\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e14cdace-d513-46ed-860a-e60ca6ed6436-ca-trust-extracted\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.451830 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf429cde-a177-4917-bcfe-b91c08621c28-config\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.452341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf429cde-a177-4917-bcfe-b91c08621c28-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.452341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.452341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7r5j\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-kube-api-access-j7r5j\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.452341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-bound-sa-token\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.452341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.451996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-certificates\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.452341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.452067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5005f58d-c89e-4ed4-8e6d-44a0b1276564-serving-cert\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.517635 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.517598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:42:55.552510 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5005f58d-c89e-4ed4-8e6d-44a0b1276564-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.552510 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.552510 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-image-registry-private-configuration\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.552510 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-installation-pull-secrets\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thkv\" (UniqueName: \"kubernetes.io/projected/cf429cde-a177-4917-bcfe-b91c08621c28-kube-api-access-9thkv\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-default-certificate\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e14cdace-d513-46ed-860a-e60ca6ed6436-ca-trust-extracted\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf429cde-a177-4917-bcfe-b91c08621c28-config\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf429cde-a177-4917-bcfe-b91c08621c28-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkl4v\" (UniqueName: \"kubernetes.io/projected/b5f5d941-3bd4-4de7-bdfd-1102b287a465-kube-api-access-pkl4v\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7r5j\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-kube-api-access-j7r5j\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-bound-sa-token\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-certificates\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5005f58d-c89e-4ed4-8e6d-44a0b1276564-serving-cert\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5lv\" (UniqueName: \"kubernetes.io/projected/03e500fe-f5cd-475e-b05e-002de0b03d4a-kube-api-access-pg5lv\") pod \"network-check-source-989f8b8dc-cn42m\" (UID: \"03e500fe-f5cd-475e-b05e-002de0b03d4a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.552833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5f5d941-3bd4-4de7-bdfd-1102b287a465-tmp-dir\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5005f58d-c89e-4ed4-8e6d-44a0b1276564-snapshots\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtd5r\" (UniqueName: \"kubernetes.io/projected/70be42eb-2adf-41ea-9e24-fc9e55be08ae-kube-api-access-vtd5r\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-stats-auth\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2h6d\" (UniqueName: \"kubernetes.io/projected/2810faf7-3674-4286-9266-a034c71c86b4-kube-api-access-n2h6d\") pod \"ingress-canary-sbgpl\" (UID: \"2810faf7-3674-4286-9266-a034c71c86b4\") " pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5d941-3bd4-4de7-bdfd-1102b287a465-config-volume\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5005f58d-c89e-4ed4-8e6d-44a0b1276564-tmp\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-config\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.552990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-serving-cert\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-trusted-ca\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fncnq\" (UniqueName: \"kubernetes.io/projected/a52cf257-070d-4088-ac86-64ec27c8411d-kube-api-access-fncnq\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a52cf257-070d-4088-ac86-64ec27c8411d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2810faf7-3674-4286-9266-a034c71c86b4-cert\") pod \"ingress-canary-sbgpl\" (UID: \"2810faf7-3674-4286-9266-a034c71c86b4\") " pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwcgf\" (UniqueName: \"kubernetes.io/projected/b35e4cf1-62eb-48c9-8f8e-c96fd76ac249-kube-api-access-lwcgf\") pod \"volume-data-source-validator-5d456fdbcd-6fqnp\" (UID: \"b35e4cf1-62eb-48c9-8f8e-c96fd76ac249\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"
Jul 06 23:42:55.553597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5005f58d-c89e-4ed4-8e6d-44a0b1276564-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frkjf\" (UniqueName: \"kubernetes.io/projected/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-kube-api-access-frkjf\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dcj\" (UniqueName: \"kubernetes.io/projected/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-kube-api-access-w7dcj\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.553290    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5005f58d-c89e-4ed4-8e6d-44a0b1276564-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.553506    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553522    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5005f58d-c89e-4ed4-8e6d-44a0b1276564-tmp\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.553578    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:56.053559313 +0000 UTC m=+37.616633926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : configmap references non-existent config key: service-ca.crt
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.553708    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf429cde-a177-4917-bcfe-b91c08621c28-config\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554171    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5005f58d-c89e-4ed4-8e6d-44a0b1276564-snapshots\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554200    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-config\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.554221    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls podName:70be42eb-2adf-41ea-9e24-fc9e55be08ae nodeName:}" failed. No retries permitted until 2026-07-06 23:42:56.054204086 +0000 UTC m=+37.617278701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q28z2" (UID: "70be42eb-2adf-41ea-9e24-fc9e55be08ae") : secret "samples-operator-tls" not found
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554226    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e14cdace-d513-46ed-860a-e60ca6ed6436-ca-trust-extracted\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.554244    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:56.054233363 +0000 UTC m=+37.617307978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : secret "router-metrics-certs-default" not found
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6vpp\" (UniqueName: \"kubernetes.io/projected/5005f58d-c89e-4ed4-8e6d-44a0b1276564-kube-api-access-z6vpp\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.554312    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:42:55.554344 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.554323    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c88c9578-rm586: secret "image-registry-tls" not found
Jul 06 23:42:55.554996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9vj\" (UniqueName: \"kubernetes.io/projected/60199009-fd69-4b69-9cfc-cf7d1b796ee5-kube-api-access-jv9vj\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.554996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-trusted-ca\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.554996 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.554372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls podName:e14cdace-d513-46ed-860a-e60ca6ed6436 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:56.05435678 +0000 UTC m=+37.617431411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls") pod "image-registry-9c88c9578-rm586" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436") : secret "image-registry-tls" not found
Jul 06 23:42:55.554996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.554996 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.554510    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:55.554996 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.554545    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls podName:a52cf257-070d-4088-ac86-64ec27c8411d nodeName:}" failed. No retries permitted until 2026-07-06 23:42:56.05453475 +0000 UTC m=+37.617609361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nnqcf" (UID: "a52cf257-070d-4088-ac86-64ec27c8411d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:55.554996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.554984    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-certificates\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.555321 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.555164    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-trusted-ca\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.556039 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.556015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a52cf257-070d-4088-ac86-64ec27c8411d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.557404 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.556726    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.557404 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.557146    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5005f58d-c89e-4ed4-8e6d-44a0b1276564-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.557404 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.557258    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-trusted-ca\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.558996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.558967    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf429cde-a177-4917-bcfe-b91c08621c28-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.559108 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.559043    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-stats-auth\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.559187 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.559111    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-installation-pull-secrets\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.559187 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.559063    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-serving-cert\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.559316 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.559247    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-image-registry-private-configuration\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.559576 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.559551    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-default-certificate\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.559745 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.559728    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.560055 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.560039    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5005f58d-c89e-4ed4-8e6d-44a0b1276564-serving-cert\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.567928 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.567884    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frkjf\" (UniqueName: \"kubernetes.io/projected/2cb7fb66-e9d3-465c-96c3-2b1267c185d4-kube-api-access-frkjf\") pod \"kube-storage-version-migrator-operator-846bf668f7-9zbgd\" (UID: \"2cb7fb66-e9d3-465c-96c3-2b1267c185d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.568943 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.568895    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9vj\" (UniqueName: \"kubernetes.io/projected/60199009-fd69-4b69-9cfc-cf7d1b796ee5-kube-api-access-jv9vj\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:55.569323 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.569277    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dcj\" (UniqueName: \"kubernetes.io/projected/9e62260e-42e4-428d-b1bd-1fd5abb4c5e5-kube-api-access-w7dcj\") pod \"console-operator-68b757fb67-pr4j6\" (UID: \"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5\") " pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.569523 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.569466    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9thkv\" (UniqueName: \"kubernetes.io/projected/cf429cde-a177-4917-bcfe-b91c08621c28-kube-api-access-9thkv\") pod \"service-ca-operator-5d46d9ffd4-6g9g5\" (UID: \"cf429cde-a177-4917-bcfe-b91c08621c28\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.569636 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.569581    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fncnq\" (UniqueName: \"kubernetes.io/projected/a52cf257-070d-4088-ac86-64ec27c8411d-kube-api-access-fncnq\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:55.569636 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.569587    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtd5r\" (UniqueName: \"kubernetes.io/projected/70be42eb-2adf-41ea-9e24-fc9e55be08ae-kube-api-access-vtd5r\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:55.569944 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.569915    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7r5j\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-kube-api-access-j7r5j\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.570030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.569995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6vpp\" (UniqueName: \"kubernetes.io/projected/5005f58d-c89e-4ed4-8e6d-44a0b1276564-kube-api-access-z6vpp\") pod \"insights-operator-5c847dcfc4-mzzc9\" (UID: \"5005f58d-c89e-4ed4-8e6d-44a0b1276564\") " pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.570321 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.570299    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-bound-sa-token\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:55.571098 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.571067    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwcgf\" (UniqueName: \"kubernetes.io/projected/b35e4cf1-62eb-48c9-8f8e-c96fd76ac249-kube-api-access-lwcgf\") pod \"volume-data-source-validator-5d456fdbcd-6fqnp\" (UID: \"b35e4cf1-62eb-48c9-8f8e-c96fd76ac249\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"
Jul 06 23:42:55.609123 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.609059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:42:55.647126 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.647094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9"
Jul 06 23:42:55.654752 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.654728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2810faf7-3674-4286-9266-a034c71c86b4-cert\") pod \"ingress-canary-sbgpl\" (UID: \"2810faf7-3674-4286-9266-a034c71c86b4\") " pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.654893 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.654850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkl4v\" (UniqueName: \"kubernetes.io/projected/b5f5d941-3bd4-4de7-bdfd-1102b287a465-kube-api-access-pkl4v\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.654956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.654917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5lv\" (UniqueName: \"kubernetes.io/projected/03e500fe-f5cd-475e-b05e-002de0b03d4a-kube-api-access-pg5lv\") pod \"network-check-source-989f8b8dc-cn42m\" (UID: \"03e500fe-f5cd-475e-b05e-002de0b03d4a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"
Jul 06 23:42:55.654956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.654946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.655045 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.654974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5f5d941-3bd4-4de7-bdfd-1102b287a465-tmp-dir\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.655045 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.655005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2h6d\" (UniqueName: \"kubernetes.io/projected/2810faf7-3674-4286-9266-a034c71c86b4-kube-api-access-n2h6d\") pod \"ingress-canary-sbgpl\" (UID: \"2810faf7-3674-4286-9266-a034c71c86b4\") " pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.661099 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.655230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5d941-3bd4-4de7-bdfd-1102b287a465-config-volume\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.661099 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.655867    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5f5d941-3bd4-4de7-bdfd-1102b287a465-tmp-dir\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.661099 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.655957    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:42:55.661099 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:55.656026    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls podName:b5f5d941-3bd4-4de7-bdfd-1102b287a465 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:56.156007638 +0000 UTC m=+37.719082252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls") pod "dns-default-gv9xc" (UID: "b5f5d941-3bd4-4de7-bdfd-1102b287a465") : secret "dns-default-metrics-tls" not found
Jul 06 23:42:55.661099 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.656520    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5d941-3bd4-4de7-bdfd-1102b287a465-config-volume\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.661099 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.657553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"
Jul 06 23:42:55.662036 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.661999    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2810faf7-3674-4286-9266-a034c71c86b4-cert\") pod \"ingress-canary-sbgpl\" (UID: \"2810faf7-3674-4286-9266-a034c71c86b4\") " pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.665460 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.665294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"
Jul 06 23:42:55.666146 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.666096    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkl4v\" (UniqueName: \"kubernetes.io/projected/b5f5d941-3bd4-4de7-bdfd-1102b287a465-kube-api-access-pkl4v\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:55.666261 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.666178    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2h6d\" (UniqueName: \"kubernetes.io/projected/2810faf7-3674-4286-9266-a034c71c86b4-kube-api-access-n2h6d\") pod \"ingress-canary-sbgpl\" (UID: \"2810faf7-3674-4286-9266-a034c71c86b4\") " pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.666409 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.666375    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5lv\" (UniqueName: \"kubernetes.io/projected/03e500fe-f5cd-475e-b05e-002de0b03d4a-kube-api-access-pg5lv\") pod \"network-check-source-989f8b8dc-cn42m\" (UID: \"03e500fe-f5cd-475e-b05e-002de0b03d4a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"
Jul 06 23:42:55.695840 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.695804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"
Jul 06 23:42:55.711253 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.711016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:42:55.720187 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.719357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbgpl"
Jul 06 23:42:55.726306 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.726238    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"
Jul 06 23:42:55.893727 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.893598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mzzc9"]
Jul 06 23:42:55.910443 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.910369    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5"]
Jul 06 23:42:55.935592 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.935562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp"]
Jul 06 23:42:55.937377 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.937354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:42:55.938012 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.937908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:42:55.941273 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.941250    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsqvs\""
Jul 06 23:42:55.941566 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.941548    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:42:55.941800 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.941781    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:42:55.953622 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.953590    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd"]
Jul 06 23:42:55.986736 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.986709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-pr4j6"]
Jul 06 23:42:55.989380 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:55.989322    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m"]
Jul 06 23:42:56.004574 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.004537    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbgpl"]
Jul 06 23:42:56.063709 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.063673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:56.063875 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.063729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:56.063875 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.063796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:56.063875 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.063836    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.063884    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.063887    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.063899    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c88c9578-rm586: secret "image-registry-tls" not found
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.063912    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls podName:70be42eb-2adf-41ea-9e24-fc9e55be08ae nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.063890154 +0000 UTC m=+38.626964777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q28z2" (UID: "70be42eb-2adf-41ea-9e24-fc9e55be08ae") : secret "samples-operator-tls" not found
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.063939    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls podName:e14cdace-d513-46ed-860a-e60ca6ed6436 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.063927406 +0000 UTC m=+38.627002016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls") pod "image-registry-9c88c9578-rm586" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436") : secret "image-registry-tls" not found
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.063939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.063958    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.063948582 +0000 UTC m=+38.627023193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : secret "router-metrics-certs-default" not found
Jul 06 23:42:56.064028 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.064007    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:56.064414 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.064043    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls podName:a52cf257-070d-4088-ac86-64ec27c8411d nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.064031749 +0000 UTC m=+38.627106375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nnqcf" (UID: "a52cf257-070d-4088-ac86-64ec27c8411d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:56.064414 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.064006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:56.064414 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.064065    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.064055166 +0000 UTC m=+38.627129779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : configmap references non-existent config key: service-ca.crt
Jul 06 23:42:56.164777 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.164688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:56.164933 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.164867    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:42:56.164984 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:56.164937    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls podName:b5f5d941-3bd4-4de7-bdfd-1102b287a465 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:57.16491737 +0000 UTC m=+38.727991987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls") pod "dns-default-gv9xc" (UID: "b5f5d941-3bd4-4de7-bdfd-1102b287a465") : secret "dns-default-metrics-tls" not found
Jul 06 23:42:56.936935 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.936904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:42:56.939926 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:56.939888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pwj6r\""
Jul 06 23:42:57.074358 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:57.074324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:57.074358 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:57.074364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:57.074571 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:57.074403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:57.074571 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:57.074447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:57.074571 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074501    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:57.074571 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074511    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:59.074493059 +0000 UTC m=+40.637567689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : configmap references non-existent config key: service-ca.crt
Jul 06 23:42:57.074571 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074557    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:42:57.074571 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074570    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c88c9578-rm586: secret "image-registry-tls" not found
Jul 06 23:42:57.074874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074581    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls podName:a52cf257-070d-4088-ac86-64ec27c8411d nodeName:}" failed. No retries permitted until 2026-07-06 23:42:59.074562547 +0000 UTC m=+40.637637173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nnqcf" (UID: "a52cf257-070d-4088-ac86-64ec27c8411d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:57.074874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074643    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls podName:e14cdace-d513-46ed-860a-e60ca6ed6436 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:59.074630449 +0000 UTC m=+40.637705075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls") pod "image-registry-9c88c9578-rm586" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436") : secret "image-registry-tls" not found
Jul 06 23:42:57.074874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074650    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:42:57.074874 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:57.074664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:57.074874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074681    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls podName:70be42eb-2adf-41ea-9e24-fc9e55be08ae nodeName:}" failed. No retries permitted until 2026-07-06 23:42:59.074668967 +0000 UTC m=+40.637743579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q28z2" (UID: "70be42eb-2adf-41ea-9e24-fc9e55be08ae") : secret "samples-operator-tls" not found
Jul 06 23:42:57.074874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074731    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:42:57.074874 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.074766    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:59.074755941 +0000 UTC m=+40.637830562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : secret "router-metrics-certs-default" not found
Jul 06 23:42:57.175725 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:57.175693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:57.175905 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.175865    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:42:57.175963 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:57.175942    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls podName:b5f5d941-3bd4-4de7-bdfd-1102b287a465 nodeName:}" failed. No retries permitted until 2026-07-06 23:42:59.175922104 +0000 UTC m=+40.738996738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls") pod "dns-default-gv9xc" (UID: "b5f5d941-3bd4-4de7-bdfd-1102b287a465") : secret "dns-default-metrics-tls" not found
Jul 06 23:42:57.486481 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:57.486443    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb7fb66_e9d3_465c_96c3_2b1267c185d4.slice/crio-1a8b76b4876489efbdf61784d3b65ee4888ad596460aaee1c45d194622498253 WatchSource:0}: Error finding container 1a8b76b4876489efbdf61784d3b65ee4888ad596460aaee1c45d194622498253: Status 404 returned error can't find the container with id 1a8b76b4876489efbdf61784d3b65ee4888ad596460aaee1c45d194622498253
Jul 06 23:42:57.487114 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:57.487067    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf429cde_a177_4917_bcfe_b91c08621c28.slice/crio-6d0f902ccf4050d587df696de61ef1e4ebe88b05c8bdf1142f5cc255abb736fa WatchSource:0}: Error finding container 6d0f902ccf4050d587df696de61ef1e4ebe88b05c8bdf1142f5cc255abb736fa: Status 404 returned error can't find the container with id 6d0f902ccf4050d587df696de61ef1e4ebe88b05c8bdf1142f5cc255abb736fa
Jul 06 23:42:57.488126 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:57.488096    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35e4cf1_62eb_48c9_8f8e_c96fd76ac249.slice/crio-6f8ac947a5653aba7e4bd89461c3fddb688f701dbcba974e61ecc08f00ac5dce WatchSource:0}: Error finding container 6f8ac947a5653aba7e4bd89461c3fddb688f701dbcba974e61ecc08f00ac5dce: Status 404 returned error can't find the container with id 6f8ac947a5653aba7e4bd89461c3fddb688f701dbcba974e61ecc08f00ac5dce
Jul 06 23:42:57.489014 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:57.488965    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5005f58d_c89e_4ed4_8e6d_44a0b1276564.slice/crio-691eef159d610d3f431bbd2d3189f6a3c6ea4ea73cb85f7851e35fe93d3925c9 WatchSource:0}: Error finding container 691eef159d610d3f431bbd2d3189f6a3c6ea4ea73cb85f7851e35fe93d3925c9: Status 404 returned error can't find the container with id 691eef159d610d3f431bbd2d3189f6a3c6ea4ea73cb85f7851e35fe93d3925c9
Jul 06 23:42:57.496786 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:57.496761    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2810faf7_3674_4286_9266_a034c71c86b4.slice/crio-072b08cdf59d97718e084fc1e48b6bcc47c2d5c167d2ed468981febaac28a22c WatchSource:0}: Error finding container 072b08cdf59d97718e084fc1e48b6bcc47c2d5c167d2ed468981febaac28a22c: Status 404 returned error can't find the container with id 072b08cdf59d97718e084fc1e48b6bcc47c2d5c167d2ed468981febaac28a22c
Jul 06 23:42:57.497894 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:57.497871    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e500fe_f5cd_475e_b05e_002de0b03d4a.slice/crio-51b17e08c075fd81f795fedfeed19e18d4d770bda1e754f746ec7d7e7a77c573 WatchSource:0}: Error finding container 51b17e08c075fd81f795fedfeed19e18d4d770bda1e754f746ec7d7e7a77c573: Status 404 returned error can't find the container with id 51b17e08c075fd81f795fedfeed19e18d4d770bda1e754f746ec7d7e7a77c573
Jul 06 23:42:57.498343 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:42:57.498320    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e62260e_42e4_428d_b1bd_1fd5abb4c5e5.slice/crio-2d8fce57183a2a23ac8776049c751f5fd5e68539bd14db875dfbb78851dfb13e WatchSource:0}: Error finding container 2d8fce57183a2a23ac8776049c751f5fd5e68539bd14db875dfbb78851dfb13e: Status 404 returned error can't find the container with id 2d8fce57183a2a23ac8776049c751f5fd5e68539bd14db875dfbb78851dfb13e
Jul 06 23:42:58.099914 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.099567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp" event={"ID":"b35e4cf1-62eb-48c9-8f8e-c96fd76ac249","Type":"ContainerStarted","Data":"6f8ac947a5653aba7e4bd89461c3fddb688f701dbcba974e61ecc08f00ac5dce"}
Jul 06 23:42:58.101261 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.101232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbgpl" event={"ID":"2810faf7-3674-4286-9266-a034c71c86b4","Type":"ContainerStarted","Data":"072b08cdf59d97718e084fc1e48b6bcc47c2d5c167d2ed468981febaac28a22c"}
Jul 06 23:42:58.103367 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.103301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m" event={"ID":"03e500fe-f5cd-475e-b05e-002de0b03d4a","Type":"ContainerStarted","Data":"51b17e08c075fd81f795fedfeed19e18d4d770bda1e754f746ec7d7e7a77c573"}
Jul 06 23:42:58.109096 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.107972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd" event={"ID":"2cb7fb66-e9d3-465c-96c3-2b1267c185d4","Type":"ContainerStarted","Data":"1a8b76b4876489efbdf61784d3b65ee4888ad596460aaee1c45d194622498253"}
Jul 06 23:42:58.120377 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.120330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5" event={"ID":"cf429cde-a177-4917-bcfe-b91c08621c28","Type":"ContainerStarted","Data":"6d0f902ccf4050d587df696de61ef1e4ebe88b05c8bdf1142f5cc255abb736fa"}
Jul 06 23:42:58.123026 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.123006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9" event={"ID":"5005f58d-c89e-4ed4-8e6d-44a0b1276564","Type":"ContainerStarted","Data":"691eef159d610d3f431bbd2d3189f6a3c6ea4ea73cb85f7851e35fe93d3925c9"}
Jul 06 23:42:58.126382 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.126356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" event={"ID":"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5","Type":"ContainerStarted","Data":"2d8fce57183a2a23ac8776049c751f5fd5e68539bd14db875dfbb78851dfb13e"}
Jul 06 23:42:58.134372 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.134311    2581 generic.go:356] "Generic (PLEG): container finished" podID="93f000d0-9c04-4e80-b965-2cf287e55da4" containerID="e3846f034f29296d6ec3b113261bdf8669180f9e4217ec74244218d66de40c39" exitCode=0
Jul 06 23:42:58.134372 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:58.134345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerDied","Data":"e3846f034f29296d6ec3b113261bdf8669180f9e4217ec74244218d66de40c39"}
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.091744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.091806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.091841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.091882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.091957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092150    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092216    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:03.092194861 +0000 UTC m=+44.655269488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : secret "router-metrics-certs-default" not found
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092627    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092680    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls podName:a52cf257-070d-4088-ac86-64ec27c8411d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:03.092664233 +0000 UTC m=+44.655738857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nnqcf" (UID: "a52cf257-070d-4088-ac86-64ec27c8411d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092804    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092819    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c88c9578-rm586: secret "image-registry-tls" not found
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092859    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls podName:e14cdace-d513-46ed-860a-e60ca6ed6436 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:03.092845429 +0000 UTC m=+44.655920053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls") pod "image-registry-9c88c9578-rm586" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436") : secret "image-registry-tls" not found
Jul 06 23:42:59.092887 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092860    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:42:59.093826 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.092924    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls podName:70be42eb-2adf-41ea-9e24-fc9e55be08ae nodeName:}" failed. No retries permitted until 2026-07-06 23:43:03.092907023 +0000 UTC m=+44.655981647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q28z2" (UID: "70be42eb-2adf-41ea-9e24-fc9e55be08ae") : secret "samples-operator-tls" not found
Jul 06 23:42:59.094026 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.094001    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:03.093985787 +0000 UTC m=+44.657060413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : configmap references non-existent config key: service-ca.crt
Jul 06 23:42:59.154051 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.154011    2581 generic.go:356] "Generic (PLEG): container finished" podID="93f000d0-9c04-4e80-b965-2cf287e55da4" containerID="97258141e0695e6cd53ef2ceab676e3e10d96d81a51311679e2c0c479a43084c" exitCode=0
Jul 06 23:42:59.154516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.154089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerDied","Data":"97258141e0695e6cd53ef2ceab676e3e10d96d81a51311679e2c0c479a43084c"}
Jul 06 23:42:59.192935 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.192902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:42:59.193525 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.193493    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:42:59.193634 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:42:59.193571    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls podName:b5f5d941-3bd4-4de7-bdfd-1102b287a465 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:03.193550602 +0000 UTC m=+44.756625225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls") pod "dns-default-gv9xc" (UID: "b5f5d941-3bd4-4de7-bdfd-1102b287a465") : secret "dns-default-metrics-tls" not found
Jul 06 23:42:59.785193 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.785040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:42:59.897614 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:42:59.897508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:00.161946 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:00.161862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-76ssm" event={"ID":"93f000d0-9c04-4e80-b965-2cf287e55da4","Type":"ContainerStarted","Data":"b99073b6e60676089e4ce4c30d28d90fe0c4b4c4788c92d0fa7ea7fb888758fa"}
Jul 06 23:43:00.188614 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:00.188557    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-76ssm" podStartSLOduration=7.163192234 podStartE2EDuration="41.188538713s" totalImagesPullingTime="34.025346479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:00.187765529 +0000 UTC m=+41.750840173" watchObservedRunningTime="2026-07-06 23:43:00.188538713 +0000 UTC m=+41.751613345"
Jul 06 23:43:00.309125 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:00.309089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:00.357555 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:00.357494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:02.384762 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.384722    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"]
Jul 06 23:43:02.415724 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.415685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"]
Jul 06 23:43:02.415894 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.415814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:02.418518 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.418496    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 23:43:02.418647 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.418606    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 23:43:02.418916 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.418891    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7kk6n\""
Jul 06 23:43:02.527244 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.527178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:02.527439 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.527275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:02.628866 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.628817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:02.629066 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.628912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:02.629066 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:02.628973    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:43:02.629066 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:02.629045    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert podName:e4823edc-cfe8-4199-be26-cd3b7aa17ef9 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:03.129028575 +0000 UTC m=+44.692103185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wp4kf" (UID: "e4823edc-cfe8-4199-be26-cd3b7aa17ef9") : secret "networking-console-plugin-cert" not found
Jul 06 23:43:02.629682 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.629657    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:02.704989 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.704937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:02.760324 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:02.760283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:03.103848 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.103703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:03.132935 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.132886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:03.133160 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.132977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:43:03.133160 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.133014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:03.133160 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.133049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:43:03.133160 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133055    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:43:03.133160 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.133111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133155    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133179    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133214    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133159    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert podName:e4823edc-cfe8-4199-be26-cd3b7aa17ef9 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:04.133139223 +0000 UTC m=+45.696213840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wp4kf" (UID: "e4823edc-cfe8-4199-be26-cd3b7aa17ef9") : secret "networking-console-plugin-cert" not found
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133226    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c88c9578-rm586: secret "image-registry-tls" not found
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.133294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133309    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls podName:e14cdace-d513-46ed-860a-e60ca6ed6436 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:11.133292615 +0000 UTC m=+52.696367243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls") pod "image-registry-9c88c9578-rm586" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436") : secret "image-registry-tls" not found
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133347    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:43:03.133369 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133359    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:11.133332078 +0000 UTC m=+52.696406694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : configmap references non-existent config key: service-ca.crt
Jul 06 23:43:03.133698 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133389    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls podName:a52cf257-070d-4088-ac86-64ec27c8411d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:11.133379209 +0000 UTC m=+52.696453819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nnqcf" (UID: "a52cf257-070d-4088-ac86-64ec27c8411d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:43:03.133698 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133417    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls podName:70be42eb-2adf-41ea-9e24-fc9e55be08ae nodeName:}" failed. No retries permitted until 2026-07-06 23:43:11.133409355 +0000 UTC m=+52.696483994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q28z2" (UID: "70be42eb-2adf-41ea-9e24-fc9e55be08ae") : secret "samples-operator-tls" not found
Jul 06 23:43:03.133698 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.133430    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:11.133423302 +0000 UTC m=+52.696497911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : secret "router-metrics-certs-default" not found
Jul 06 23:43:03.160044 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.160003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:03.234794 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.234755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:43:03.234948 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.234893    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:43:03.235008 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:03.234956    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls podName:b5f5d941-3bd4-4de7-bdfd-1102b287a465 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:11.234940396 +0000 UTC m=+52.798015011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls") pod "dns-default-gv9xc" (UID: "b5f5d941-3bd4-4de7-bdfd-1102b287a465") : secret "dns-default-metrics-tls" not found
Jul 06 23:43:03.261513 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.261475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:03.315958 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.315917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:03.642526 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.642486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:03.705262 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:03.705227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:04.143209 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:04.143162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:04.143386 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:04.143342    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:43:04.143445 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:04.143430    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert podName:e4823edc-cfe8-4199-be26-cd3b7aa17ef9 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:06.14340983 +0000 UTC m=+47.706484443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wp4kf" (UID: "e4823edc-cfe8-4199-be26-cd3b7aa17ef9") : secret "networking-console-plugin-cert" not found
Jul 06 23:43:04.411607 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:04.411530    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:04.516457 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:04.516420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:04.845860 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:04.845827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:04.946831 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:04.946788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:06.163711 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.163667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:06.164258 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:06.163828    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:43:06.164258 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:06.163910    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert podName:e4823edc-cfe8-4199-be26-cd3b7aa17ef9 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:10.163889935 +0000 UTC m=+51.726964554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wp4kf" (UID: "e4823edc-cfe8-4199-be26-cd3b7aa17ef9") : secret "networking-console-plugin-cert" not found
Jul 06 23:43:06.181447 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.181400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5" event={"ID":"cf429cde-a177-4917-bcfe-b91c08621c28","Type":"ContainerStarted","Data":"3a01bb8781bf7d01407959c336fe8698ef1ca110f98d14c4f0ba9f6815bc2aff"}
Jul 06 23:43:06.182793 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.182761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9" event={"ID":"5005f58d-c89e-4ed4-8e6d-44a0b1276564","Type":"ContainerStarted","Data":"5ae0f92ef8220998c079dff32408c4bdf5fc86486e49fdc3c1904b5ee5053705"}
Jul 06 23:43:06.184727 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.184709    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/0.log"
Jul 06 23:43:06.184844 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.184747    2581 generic.go:356] "Generic (PLEG): container finished" podID="9e62260e-42e4-428d-b1bd-1fd5abb4c5e5" containerID="e7da971e15b57170e54e25558bbf1b44d085d1f89caf7e204ab413991aed9a6c" exitCode=255
Jul 06 23:43:06.184899 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.184835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" event={"ID":"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5","Type":"ContainerDied","Data":"e7da971e15b57170e54e25558bbf1b44d085d1f89caf7e204ab413991aed9a6c"}
Jul 06 23:43:06.185396 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.185377    2581 scope.go:117] "RemoveContainer" containerID="e7da971e15b57170e54e25558bbf1b44d085d1f89caf7e204ab413991aed9a6c"
Jul 06 23:43:06.186541 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.186518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp" event={"ID":"b35e4cf1-62eb-48c9-8f8e-c96fd76ac249","Type":"ContainerStarted","Data":"b1b1103a5757af7fc8dfad7a7886e9ac9102ce56552fe59f4cc3a7328a61f6f8"}
Jul 06 23:43:06.189335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.189313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbgpl" event={"ID":"2810faf7-3674-4286-9266-a034c71c86b4","Type":"ContainerStarted","Data":"8172727db18f2ca5033a2b6fb4006020a592f50f8863ec758d822f2934c14193"}
Jul 06 23:43:06.190780 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.190758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m" event={"ID":"03e500fe-f5cd-475e-b05e-002de0b03d4a","Type":"ContainerStarted","Data":"245e6fe04a8eb1b1a36d580e135dc9ae6042bda319702254f187e6c064db4b4c"}
Jul 06 23:43:06.192574 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.192554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd" event={"ID":"2cb7fb66-e9d3-465c-96c3-2b1267c185d4","Type":"ContainerStarted","Data":"533fc5dd0fa7b205e85c32a4c31b9feec6a3231b57c52853b31442f3e1b7a93b"}
Jul 06 23:43:06.198868 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.198807    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5" podStartSLOduration=14.480480317 podStartE2EDuration="22.198789688s" totalImagesPullingTime="7.718309371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:06.197935568 +0000 UTC m=+47.761010201" watchObservedRunningTime="2026-07-06 23:43:06.198789688 +0000 UTC m=+47.761864322"
Jul 06 23:43:06.213335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.213276    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9" podStartSLOduration=14.499039519 podStartE2EDuration="22.213253108s" totalImagesPullingTime="7.714213589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:06.212808742 +0000 UTC m=+47.775883386" watchObservedRunningTime="2026-07-06 23:43:06.213253108 +0000 UTC m=+47.776327788"
Jul 06 23:43:06.250735 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.250684    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sbgpl" podStartSLOduration=3.542030846 podStartE2EDuration="11.250666282s" totalImagesPullingTime="7.708635436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:06.25036493 +0000 UTC m=+47.813439562" watchObservedRunningTime="2026-07-06 23:43:06.250666282 +0000 UTC m=+47.813740916"
Jul 06 23:43:06.271056 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.271011    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cn42m" podStartSLOduration=14.553494516 podStartE2EDuration="22.270995646s" totalImagesPullingTime="7.71750113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:06.27060559 +0000 UTC m=+47.833680222" watchObservedRunningTime="2026-07-06 23:43:06.270995646 +0000 UTC m=+47.834070277"
Jul 06 23:43:06.289484 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.289302    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-6fqnp" podStartSLOduration=14.96218823 podStartE2EDuration="22.289283228s" totalImagesPullingTime="7.327094998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:06.28888495 +0000 UTC m=+47.851959582" watchObservedRunningTime="2026-07-06 23:43:06.289283228 +0000 UTC m=+47.852357860"
Jul 06 23:43:06.306310 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.306253    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd" podStartSLOduration=14.587673673 podStartE2EDuration="22.306235681s" totalImagesPullingTime="7.718562008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:06.305775342 +0000 UTC m=+47.868849974" watchObservedRunningTime="2026-07-06 23:43:06.306235681 +0000 UTC m=+47.869310314"
Jul 06 23:43:06.369851 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.369765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:06.474322 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.474234    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q8vhw"]
Jul 06 23:43:06.474943 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.474913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:06.487451 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.487424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8vhw"]
Jul 06 23:43:06.487617 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.487548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.490132 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.490105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 23:43:06.490258 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.490244    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 23:43:06.490524 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.490506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dsbmx\""
Jul 06 23:43:06.569336 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.569305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.569519 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.569372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3229f575-4f59-4884-b78a-effff7a0d69d-data-volume\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.569519 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.569476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttbg2\" (UniqueName: \"kubernetes.io/projected/3229f575-4f59-4884-b78a-effff7a0d69d-kube-api-access-ttbg2\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.569648 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.569525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.569648 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.569587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3229f575-4f59-4884-b78a-effff7a0d69d-crio-socket\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.570084 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.570048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:06.670247 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.670418 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3229f575-4f59-4884-b78a-effff7a0d69d-data-volume\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.670418 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttbg2\" (UniqueName: \"kubernetes.io/projected/3229f575-4f59-4884-b78a-effff7a0d69d-kube-api-access-ttbg2\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.670541 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:06.670292    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:43:06.670541 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:06.670507    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:07.170485208 +0000 UTC m=+48.733559823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : configmap "kube-rbac-proxy" not found
Jul 06 23:43:06.670541 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:06.670520    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:06.670696 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.670696 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:06.670569    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:07.170555032 +0000 UTC m=+48.733629641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:06.670696 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3229f575-4f59-4884-b78a-effff7a0d69d-crio-socket\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.670860 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670721    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3229f575-4f59-4884-b78a-effff7a0d69d-data-volume\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.670860 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670802    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3229f575-4f59-4884-b78a-effff7a0d69d-crio-socket\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:06.671025 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.670996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:06.681940 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:06.681912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttbg2\" (UniqueName: \"kubernetes.io/projected/3229f575-4f59-4884-b78a-effff7a0d69d-kube-api-access-ttbg2\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:07.084547 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.084512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:07.118357 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.118325    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"]
Jul 06 23:43:07.149911 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.149873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"]
Jul 06 23:43:07.150062 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.149992    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"
Jul 06 23:43:07.153159 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.153140    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 23:43:07.153438 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.153423    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 23:43:07.154584 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.154566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mr95x\""
Jul 06 23:43:07.171118 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.171088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:07.175973 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.175953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:07.176100 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.176005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:07.176100 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:07.176087    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:43:07.176198 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:07.176103    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:07.176198 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:07.176145    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:08.176129444 +0000 UTC m=+49.739204058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : configmap "kube-rbac-proxy" not found
Jul 06 23:43:07.176198 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:07.176164    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:08.176154793 +0000 UTC m=+49.739229403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:07.197523 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.197501    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:43:07.197917 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.197901    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/0.log"
Jul 06 23:43:07.197979 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.197940    2581 generic.go:356] "Generic (PLEG): container finished" podID="9e62260e-42e4-428d-b1bd-1fd5abb4c5e5" containerID="61ea1fd47d3f1a806a28e04156feefa80524fa3856dbf750826bf97542d0601d" exitCode=255
Jul 06 23:43:07.198022 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.197969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" event={"ID":"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5","Type":"ContainerDied","Data":"61ea1fd47d3f1a806a28e04156feefa80524fa3856dbf750826bf97542d0601d"}
Jul 06 23:43:07.198094 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.198020    2581 scope.go:117] "RemoveContainer" containerID="e7da971e15b57170e54e25558bbf1b44d085d1f89caf7e204ab413991aed9a6c"
Jul 06 23:43:07.198291 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.198273    2581 scope.go:117] "RemoveContainer" containerID="61ea1fd47d3f1a806a28e04156feefa80524fa3856dbf750826bf97542d0601d"
Jul 06 23:43:07.198465 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:07.198446    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-pr4j6_openshift-console-operator(9e62260e-42e4-428d-b1bd-1fd5abb4c5e5)\"" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" podUID="9e62260e-42e4-428d-b1bd-1fd5abb4c5e5"
Jul 06 23:43:07.245597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.245562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:07.277128 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.277067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w4n4\" (UniqueName: \"kubernetes.io/projected/44354eec-8a4a-45bf-b0d5-927361975a5a-kube-api-access-6w4n4\") pod \"migrator-d57d58cc9-6jvqf\" (UID: \"44354eec-8a4a-45bf-b0d5-927361975a5a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"
Jul 06 23:43:07.339999 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.338850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:07.377965 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.377926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w4n4\" (UniqueName: \"kubernetes.io/projected/44354eec-8a4a-45bf-b0d5-927361975a5a-kube-api-access-6w4n4\") pod \"migrator-d57d58cc9-6jvqf\" (UID: \"44354eec-8a4a-45bf-b0d5-927361975a5a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"
Jul 06 23:43:07.386294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.386273    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w4n4\" (UniqueName: \"kubernetes.io/projected/44354eec-8a4a-45bf-b0d5-927361975a5a-kube-api-access-6w4n4\") pod \"migrator-d57d58cc9-6jvqf\" (UID: \"44354eec-8a4a-45bf-b0d5-927361975a5a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"
Jul 06 23:43:07.458566 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.458528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"
Jul 06 23:43:07.598266 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.598190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf"]
Jul 06 23:43:07.601113 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:07.601067    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44354eec_8a4a_45bf_b0d5_927361975a5a.slice/crio-23f2036fe4c2217f93bdf5fd133de1e2df0faf49374c02a26a7cd47cd6de9068 WatchSource:0}: Error finding container 23f2036fe4c2217f93bdf5fd133de1e2df0faf49374c02a26a7cd47cd6de9068: Status 404 returned error can't find the container with id 23f2036fe4c2217f93bdf5fd133de1e2df0faf49374c02a26a7cd47cd6de9068
Jul 06 23:43:07.679152 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:07.679125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4zmkt_5ff51189-b638-4fe8-8fa0-fbc7cd197639/dns-node-resolver/0.log"
Jul 06 23:43:08.064619 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.064581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:08.185279 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.185249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:08.185654 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.185320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:08.185654 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:08.185424    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:08.185654 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:08.185449    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:43:08.185654 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:08.185494    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:10.185477877 +0000 UTC m=+51.748552487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:08.185654 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:08.185510    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:10.185503008 +0000 UTC m=+51.748577618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : configmap "kube-rbac-proxy" not found
Jul 06 23:43:08.202234 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.202207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf" event={"ID":"44354eec-8a4a-45bf-b0d5-927361975a5a","Type":"ContainerStarted","Data":"23f2036fe4c2217f93bdf5fd133de1e2df0faf49374c02a26a7cd47cd6de9068"}
Jul 06 23:43:08.203669 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.203648    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:43:08.204026 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.204008    2581 scope.go:117] "RemoveContainer" containerID="61ea1fd47d3f1a806a28e04156feefa80524fa3856dbf750826bf97542d0601d"
Jul 06 23:43:08.204225 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:08.204205    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-pr4j6_openshift-console-operator(9e62260e-42e4-428d-b1bd-1fd5abb4c5e5)\"" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" podUID="9e62260e-42e4-428d-b1bd-1fd5abb4c5e5"
Jul 06 23:43:08.464400 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.464359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:08.528354 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.528303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:08.679554 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.679528    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvqqp_d3353df0-539e-4d70-b25d-51ca45b40093/node-ca/0.log"
Jul 06 23:43:08.847807 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.847739    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-b2krd"]
Jul 06 23:43:08.872062 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.872023    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-b2krd"]
Jul 06 23:43:08.872214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.872153    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:08.875178 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.875151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 23:43:08.875327 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.875151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 23:43:08.875488 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.875470    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 23:43:08.875679 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.875554    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 23:43:08.876664 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.876610    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pjgxf\""
Jul 06 23:43:08.877526 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.877499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:08.993406 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.993369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d6b6deb6-530b-46b7-b878-8d2fd97efca1-signing-key\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:08.993566 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.993434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d6b6deb6-530b-46b7-b878-8d2fd97efca1-signing-cabundle\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:08.993664 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:08.993645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5h45\" (UniqueName: \"kubernetes.io/projected/d6b6deb6-530b-46b7-b878-8d2fd97efca1-kube-api-access-x5h45\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.094117 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.094086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5h45\" (UniqueName: \"kubernetes.io/projected/d6b6deb6-530b-46b7-b878-8d2fd97efca1-kube-api-access-x5h45\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.094305 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.094148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d6b6deb6-530b-46b7-b878-8d2fd97efca1-signing-key\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.094305 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.094191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d6b6deb6-530b-46b7-b878-8d2fd97efca1-signing-cabundle\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.094824 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.094801    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d6b6deb6-530b-46b7-b878-8d2fd97efca1-signing-cabundle\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.096723 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.096704    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d6b6deb6-530b-46b7-b878-8d2fd97efca1-signing-key\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.102557 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.102498    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5h45\" (UniqueName: \"kubernetes.io/projected/d6b6deb6-530b-46b7-b878-8d2fd97efca1-kube-api-access-x5h45\") pod \"service-ca-758f599c5-b2krd\" (UID: \"d6b6deb6-530b-46b7-b878-8d2fd97efca1\") " pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.183426 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.183385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-b2krd"
Jul 06 23:43:09.280619 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.280540    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbgpl_2810faf7-3674-4286-9266-a034c71c86b4/serve-healthcheck-canary/0.log"
Jul 06 23:43:09.327996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.327963    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-b2krd"]
Jul 06 23:43:09.483287 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:09.483259    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b6deb6_530b_46b7_b878_8d2fd97efca1.slice/crio-d48fd8332b249a1c0d2a110a0058f9f0bde1ddab649369c0ddb40bbe2b34726c WatchSource:0}: Error finding container d48fd8332b249a1c0d2a110a0058f9f0bde1ddab649369c0ddb40bbe2b34726c: Status 404 returned error can't find the container with id d48fd8332b249a1c0d2a110a0058f9f0bde1ddab649369c0ddb40bbe2b34726c
Jul 06 23:43:09.774941 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:09.774838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:10.204716 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.204688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:10.204873 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.204721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:10.204873 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:10.204853    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:43:10.204984 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.204884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:10.204984 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:10.204899    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:43:10.204984 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:10.204919    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert podName:e4823edc-cfe8-4199-be26-cd3b7aa17ef9 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:18.204898788 +0000 UTC m=+59.767973416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wp4kf" (UID: "e4823edc-cfe8-4199-be26-cd3b7aa17ef9") : secret "networking-console-plugin-cert" not found
Jul 06 23:43:10.204984 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:10.204954    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:14.204939889 +0000 UTC m=+55.768014504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : configmap "kube-rbac-proxy" not found
Jul 06 23:43:10.204984 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:10.204973    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:10.205266 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:10.205027    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:14.205015103 +0000 UTC m=+55.768089713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:10.212815 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.212780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-b2krd" event={"ID":"d6b6deb6-530b-46b7-b878-8d2fd97efca1","Type":"ContainerStarted","Data":"cc678e48067aea8b56f6600116057827bdfc2abda15b1ebbfba09caf5b38dfc0"}
Jul 06 23:43:10.212948 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.212855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-b2krd" event={"ID":"d6b6deb6-530b-46b7-b878-8d2fd97efca1","Type":"ContainerStarted","Data":"d48fd8332b249a1c0d2a110a0058f9f0bde1ddab649369c0ddb40bbe2b34726c"}
Jul 06 23:43:10.217005 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.216978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf" event={"ID":"44354eec-8a4a-45bf-b0d5-927361975a5a","Type":"ContainerStarted","Data":"0fbb1091ac8798a7b1e069c74d55b5b85e0fed28dedea3c3b32c3d4d92fb5080"}
Jul 06 23:43:10.217137 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.217029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf" event={"ID":"44354eec-8a4a-45bf-b0d5-927361975a5a","Type":"ContainerStarted","Data":"a04c56e0578938c14ada81017a256fb5e4db7253f0b00ce9ec52255d86e448e2"}
Jul 06 23:43:10.231140 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.231067    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-b2krd" podStartSLOduration=2.231052034 podStartE2EDuration="2.231052034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:10.228842979 +0000 UTC m=+51.791917622" watchObservedRunningTime="2026-07-06 23:43:10.231052034 +0000 UTC m=+51.794126644"
Jul 06 23:43:10.250218 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.250179    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6jvqf" podStartSLOduration=1.34564703 podStartE2EDuration="3.25016581s" totalImagesPullingTime="1.90451878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:10.24830046 +0000 UTC m=+51.811375091" watchObservedRunningTime="2026-07-06 23:43:10.25016581 +0000 UTC m=+51.813240442"
Jul 06 23:43:10.760751 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:10.760713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:11.214490 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.214450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:43:11.214650 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.214515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:11.214650 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.214554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:43:11.214650 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214583    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:43:11.214650 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.214594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:43:11.214650 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214645    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls podName:a52cf257-070d-4088-ac86-64ec27c8411d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.21463018 +0000 UTC m=+68.777704790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nnqcf" (UID: "a52cf257-070d-4088-ac86-64ec27c8411d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214668    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.214654716 +0000 UTC m=+68.777729325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : configmap references non-existent config key: service-ca.crt
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214710    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214724    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c88c9578-rm586: secret "image-registry-tls" not found
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214745    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214779    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls podName:e14cdace-d513-46ed-860a-e60ca6ed6436 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.214764981 +0000 UTC m=+68.777839595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls") pod "image-registry-9c88c9578-rm586" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436") : secret "image-registry-tls" not found
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.214752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214797    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls podName:70be42eb-2adf-41ea-9e24-fc9e55be08ae nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.214787236 +0000 UTC m=+68.777861845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q28z2" (UID: "70be42eb-2adf-41ea-9e24-fc9e55be08ae") : secret "samples-operator-tls" not found
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214801    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:43:11.214958 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.214831    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs podName:60199009-fd69-4b69-9cfc-cf7d1b796ee5 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.21482057 +0000 UTC m=+68.777895179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs") pod "router-default-564bc8fbd9-sfkr9" (UID: "60199009-fd69-4b69-9cfc-cf7d1b796ee5") : secret "router-metrics-certs-default" not found
Jul 06 23:43:11.289167 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.289131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:11.315995 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.315967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:43:11.316738 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.316707    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:43:11.316799 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:11.316777    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls podName:b5f5d941-3bd4-4de7-bdfd-1102b287a465 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:27.316761416 +0000 UTC m=+68.879836026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls") pod "dns-default-gv9xc" (UID: "b5f5d941-3bd4-4de7-bdfd-1102b287a465") : secret "dns-default-metrics-tls" not found
Jul 06 23:43:11.389611 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.389568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:11.493788 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.493688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:11.550655 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.550621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:11.641013 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.640981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:11.796714 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.796616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:11.984113 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:11.984052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:12.627470 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:12.627434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:12.999838 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:12.999805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:13.405121 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:13.405009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:13.587499 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:13.587463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:13.786732 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:13.786693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:13.986304 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:13.986258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log" limit=1024
Jul 06 23:43:14.248264 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:14.248232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:14.248721 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:14.248299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:14.248721 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:14.248395    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:14.248721 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:14.248476    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls podName:3229f575-4f59-4884-b78a-effff7a0d69d nodeName:}" failed. No retries permitted until 2026-07-06 23:43:22.248445851 +0000 UTC m=+63.811520464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8vhw" (UID: "3229f575-4f59-4884-b78a-effff7a0d69d") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:43:14.248970 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:14.248948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3229f575-4f59-4884-b78a-effff7a0d69d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:15.711814 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:15.711777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:43:15.712406 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:15.711832    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:43:15.712406 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:15.712179    2581 scope.go:117] "RemoveContainer" containerID="61ea1fd47d3f1a806a28e04156feefa80524fa3856dbf750826bf97542d0601d"
Jul 06 23:43:15.712406 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:15.712335    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-pr4j6_openshift-console-operator(9e62260e-42e4-428d-b1bd-1fd5abb4c5e5)\"" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" podUID="9e62260e-42e4-428d-b1bd-1fd5abb4c5e5"
Jul 06 23:43:18.286060 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:18.286010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:18.286476 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:18.286181    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:43:18.286476 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:18.286248    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert podName:e4823edc-cfe8-4199-be26-cd3b7aa17ef9 nodeName:}" failed. No retries permitted until 2026-07-06 23:43:34.286231409 +0000 UTC m=+75.849306019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wp4kf" (UID: "e4823edc-cfe8-4199-be26-cd3b7aa17ef9") : secret "networking-console-plugin-cert" not found
Jul 06 23:43:21.095520 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:21.095487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdkg2"
Jul 06 23:43:22.323629 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:22.323594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:22.326006 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:22.325989    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3229f575-4f59-4884-b78a-effff7a0d69d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8vhw\" (UID: \"3229f575-4f59-4884-b78a-effff7a0d69d\") " pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:22.402785 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:22.402753    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dsbmx\""
Jul 06 23:43:22.410695 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:22.410668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8vhw"
Jul 06 23:43:22.539425 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:22.539395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8vhw"]
Jul 06 23:43:22.542927 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:22.542898    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3229f575_4f59_4884_b78a_effff7a0d69d.slice/crio-96f2e8a253c93c76bd6ddd83d0a7f7c8b7111d661a06e54be37841ada6a0b600 WatchSource:0}: Error finding container 96f2e8a253c93c76bd6ddd83d0a7f7c8b7111d661a06e54be37841ada6a0b600: Status 404 returned error can't find the container with id 96f2e8a253c93c76bd6ddd83d0a7f7c8b7111d661a06e54be37841ada6a0b600
Jul 06 23:43:23.261475 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:23.261400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8vhw" event={"ID":"3229f575-4f59-4884-b78a-effff7a0d69d","Type":"ContainerStarted","Data":"96f2e8a253c93c76bd6ddd83d0a7f7c8b7111d661a06e54be37841ada6a0b600"}
Jul 06 23:43:24.648397 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.648355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:43:24.651717 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.651691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:43:24.661909 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.661884    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9db7af15-6242-4232-8360-f16cf026a105-metrics-certs\") pod \"network-metrics-daemon-vxhgw\" (UID: \"9db7af15-6242-4232-8360-f16cf026a105\") " pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:43:24.748996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.748955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:43:24.749188 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.749037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:43:24.751870 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.751841    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmhx\" (UniqueName: \"kubernetes.io/projected/94c76581-bb87-4ecc-9d71-e2857678ad4a-kube-api-access-dtmhx\") pod \"network-check-target-x5nq7\" (UID: \"94c76581-bb87-4ecc-9d71-e2857678ad4a\") " pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:43:24.752181 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.752160    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:43:24.762804 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.762767    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb-original-pull-secret\") pod \"global-pull-secret-syncer-5ngh2\" (UID: \"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb\") " pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:43:24.765545 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.765521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsqvs\""
Jul 06 23:43:24.773309 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.773292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxhgw"
Jul 06 23:43:24.850504 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.850450    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pwj6r\""
Jul 06 23:43:24.858814 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:24.858793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:43:25.052021 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:25.051977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ngh2"
Jul 06 23:43:25.959792 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:25.959761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5nq7"]
Jul 06 23:43:26.177995 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:26.177960    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c76581_bb87_4ecc_9d71_e2857678ad4a.slice/crio-fa4a98477bb572c39ffd3eaeb667cdc7e2fbc0f5ca9a2a2e03973f2878e07014 WatchSource:0}: Error finding container fa4a98477bb572c39ffd3eaeb667cdc7e2fbc0f5ca9a2a2e03973f2878e07014: Status 404 returned error can't find the container with id fa4a98477bb572c39ffd3eaeb667cdc7e2fbc0f5ca9a2a2e03973f2878e07014
Jul 06 23:43:26.275674 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:26.275466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5nq7" event={"ID":"94c76581-bb87-4ecc-9d71-e2857678ad4a","Type":"ContainerStarted","Data":"ceb9c58587b86bcf8a9a8bf7a48fa24034e062fcdc0201f7e659b2bb777b605c"}
Jul 06 23:43:26.275674 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:26.275524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5nq7" event={"ID":"94c76581-bb87-4ecc-9d71-e2857678ad4a","Type":"ContainerStarted","Data":"fa4a98477bb572c39ffd3eaeb667cdc7e2fbc0f5ca9a2a2e03973f2878e07014"}
Jul 06 23:43:26.276218 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:26.276162    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:43:26.293427 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:26.293312    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x5nq7" podStartSLOduration=67.293291473 podStartE2EDuration="1m7.293291473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:26.292717935 +0000 UTC m=+67.855792568" watchObservedRunningTime="2026-07-06 23:43:26.293291473 +0000 UTC m=+67.856366107"
Jul 06 23:43:26.312095 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:26.312051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ngh2"]
Jul 06 23:43:26.316885 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:26.316857    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb53126f_6e71_4ae7_9cc7_4bb6234aa3bb.slice/crio-97b6fe848a5b7806f79a13ebc02cad839740736a609de00786d7d7f0ea404e22 WatchSource:0}: Error finding container 97b6fe848a5b7806f79a13ebc02cad839740736a609de00786d7d7f0ea404e22: Status 404 returned error can't find the container with id 97b6fe848a5b7806f79a13ebc02cad839740736a609de00786d7d7f0ea404e22
Jul 06 23:43:26.332156 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:26.332128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vxhgw"]
Jul 06 23:43:26.335204 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:26.335176    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db7af15_6242_4232_8360_f16cf026a105.slice/crio-3d3a868ba68e28d5e06597fe8fb2f1b9377a3395f2419dcd6e69cbc8c7e8594b WatchSource:0}: Error finding container 3d3a868ba68e28d5e06597fe8fb2f1b9377a3395f2419dcd6e69cbc8c7e8594b: Status 404 returned error can't find the container with id 3d3a868ba68e28d5e06597fe8fb2f1b9377a3395f2419dcd6e69cbc8c7e8594b
Jul 06 23:43:26.936879 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:26.936850    2581 scope.go:117] "RemoveContainer" containerID="61ea1fd47d3f1a806a28e04156feefa80524fa3856dbf750826bf97542d0601d"
Jul 06 23:43:27.252442 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.252405    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"]
Jul 06 23:43:27.255437 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.255406    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"]
Jul 06 23:43:27.256966 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.255717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.259330 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.259309    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 23:43:27.259746 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.259728    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 23:43:27.260145 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.260127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 23:43:27.260499 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.260483    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 23:43:27.260844 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.260828    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xj2l7\""
Jul 06 23:43:27.263372 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.263348    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"]
Jul 06 23:43:27.263547 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.263526    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.266022 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.266002    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.266134 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.266094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 23:43:27.267495 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.267477    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"]
Jul 06 23:43:27.268653 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.268599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 23:43:27.269231 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.269211    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 23:43:27.269436 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.269418    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 23:43:27.269695 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.269679    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 23:43:27.270412 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.270368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"]
Jul 06 23:43:27.270829 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.270800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:43:27.270916 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.270848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-hub\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.270916 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.270878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7d80add-48fc-419d-bda4-c76b7511048e-klusterlet-config\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.270916 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.270907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:27.272148 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.271582    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60199009-fd69-4b69-9cfc-cf7d1b796ee5-service-ca-bundle\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:27.272739 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.272572    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"]
Jul 06 23:43:27.273834 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:43:27.273834 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-ca\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.273834 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:43:27.273834 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lptbp\" (UniqueName: \"kubernetes.io/projected/1ad27040-88ed-40a8-af88-46c6996545ca-kube-api-access-lptbp\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.273834 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnppm\" (UniqueName: \"kubernetes.io/projected/73d05735-175f-43dc-9ae6-3240731993b7-kube-api-access-xnppm\") pod \"managed-serviceaccount-addon-agent-6d599484b-2nqjz\" (UID: \"73d05735-175f-43dc-9ae6-3240731993b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.273834 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:27.273834 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad27040-88ed-40a8-af88-46c6996545ca-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.274222 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmw8s\" (UniqueName: \"kubernetes.io/projected/d7d80add-48fc-419d-bda4-c76b7511048e-kube-api-access-qmw8s\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.274222 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.274222 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d80add-48fc-419d-bda4-c76b7511048e-tmp\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.274222 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.274222 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.273978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d05735-175f-43dc-9ae6-3240731993b7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d599484b-2nqjz\" (UID: \"73d05735-175f-43dc-9ae6-3240731993b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.276398 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.276376    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a52cf257-070d-4088-ac86-64ec27c8411d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nnqcf\" (UID: \"a52cf257-070d-4088-ac86-64ec27c8411d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:43:27.277439 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.277030    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/70be42eb-2adf-41ea-9e24-fc9e55be08ae-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q28z2\" (UID: \"70be42eb-2adf-41ea-9e24-fc9e55be08ae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:43:27.277537 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.277496    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60199009-fd69-4b69-9cfc-cf7d1b796ee5-metrics-certs\") pod \"router-default-564bc8fbd9-sfkr9\" (UID: \"60199009-fd69-4b69-9cfc-cf7d1b796ee5\") " pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:27.277964 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.277946    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"image-registry-9c88c9578-rm586\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") " pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:43:27.282183 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.282160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8vhw" event={"ID":"3229f575-4f59-4884-b78a-effff7a0d69d","Type":"ContainerStarted","Data":"85a34244a55894976a55845bd23b91b490c3151cf52849613499f51846c81005"}
Jul 06 23:43:27.282270 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.282217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8vhw" event={"ID":"3229f575-4f59-4884-b78a-effff7a0d69d","Type":"ContainerStarted","Data":"4783617da612da63053ccf737a5de9cd30b587e2989601dc872d01eac6a69a14"}
Jul 06 23:43:27.283630 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.283602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxhgw" event={"ID":"9db7af15-6242-4232-8360-f16cf026a105","Type":"ContainerStarted","Data":"3d3a868ba68e28d5e06597fe8fb2f1b9377a3395f2419dcd6e69cbc8c7e8594b"}
Jul 06 23:43:27.286687 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.286670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:43:27.286771 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.286751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" event={"ID":"9e62260e-42e4-428d-b1bd-1fd5abb4c5e5","Type":"ContainerStarted","Data":"0db638a7787e053807ebe310e0bedd2748baebadadcb2d858a62a3b193d118a1"}
Jul 06 23:43:27.286996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.286979    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:43:27.288146 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.288112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ngh2" event={"ID":"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb","Type":"ContainerStarted","Data":"97b6fe848a5b7806f79a13ebc02cad839740736a609de00786d7d7f0ea404e22"}
Jul 06 23:43:27.362245 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.362190    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6" podStartSLOduration=35.656263247 podStartE2EDuration="43.362172938s" totalImagesPullingTime="7.705909691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:27.361310545 +0000 UTC m=+68.924385177" watchObservedRunningTime="2026-07-06 23:43:27.362172938 +0000 UTC m=+68.925247570"
Jul 06 23:43:27.374524 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-hub\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.374676 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7d80add-48fc-419d-bda4-c76b7511048e-klusterlet-config\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.374676 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-ca\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.374676 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lptbp\" (UniqueName: \"kubernetes.io/projected/1ad27040-88ed-40a8-af88-46c6996545ca-kube-api-access-lptbp\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.374676 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnppm\" (UniqueName: \"kubernetes.io/projected/73d05735-175f-43dc-9ae6-3240731993b7-kube-api-access-xnppm\") pod \"managed-serviceaccount-addon-agent-6d599484b-2nqjz\" (UID: \"73d05735-175f-43dc-9ae6-3240731993b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.374676 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:43:27.375030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad27040-88ed-40a8-af88-46c6996545ca-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.375030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmw8s\" (UniqueName: \"kubernetes.io/projected/d7d80add-48fc-419d-bda4-c76b7511048e-kube-api-access-qmw8s\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.375030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.375030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d80add-48fc-419d-bda4-c76b7511048e-tmp\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.375030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.375030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.374880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d05735-175f-43dc-9ae6-3240731993b7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d599484b-2nqjz\" (UID: \"73d05735-175f-43dc-9ae6-3240731993b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.375963 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.375939    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad27040-88ed-40a8-af88-46c6996545ca-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.376110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.375970    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d80add-48fc-419d-bda4-c76b7511048e-tmp\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.379692 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.379629    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.379845 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.379822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-hub\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.380268 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.380245    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-ca\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.381599 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.380741    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1ad27040-88ed-40a8-af88-46c6996545ca-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.381599 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.381119    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d7d80add-48fc-419d-bda4-c76b7511048e-klusterlet-config\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.382113 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.382047    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5f5d941-3bd4-4de7-bdfd-1102b287a465-metrics-tls\") pod \"dns-default-gv9xc\" (UID: \"b5f5d941-3bd4-4de7-bdfd-1102b287a465\") " pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:43:27.382879 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.382856    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d05735-175f-43dc-9ae6-3240731993b7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d599484b-2nqjz\" (UID: \"73d05735-175f-43dc-9ae6-3240731993b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.394269 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.394205    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnppm\" (UniqueName: \"kubernetes.io/projected/73d05735-175f-43dc-9ae6-3240731993b7-kube-api-access-xnppm\") pod \"managed-serviceaccount-addon-agent-6d599484b-2nqjz\" (UID: \"73d05735-175f-43dc-9ae6-3240731993b7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.404900 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.404874    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lptbp\" (UniqueName: \"kubernetes.io/projected/1ad27040-88ed-40a8-af88-46c6996545ca-kube-api-access-lptbp\") pod \"cluster-proxy-proxy-agent-5c86c95495-4zdsh\" (UID: \"1ad27040-88ed-40a8-af88-46c6996545ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:27.405191 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.405163    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmw8s\" (UniqueName: \"kubernetes.io/projected/d7d80add-48fc-419d-bda4-c76b7511048e-kube-api-access-qmw8s\") pod \"klusterlet-addon-workmgr-77458894dd-5bkns\" (UID: \"d7d80add-48fc-419d-bda4-c76b7511048e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.438846 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.438808    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fdhzs\""
Jul 06 23:43:27.446541 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.446334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:43:27.477441 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.477242    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sjcnp\""
Jul 06 23:43:27.485591 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.485563    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"
Jul 06 23:43:27.492052 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.492033    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9zrf\""
Jul 06 23:43:27.499994 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.499782    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"
Jul 06 23:43:27.505962 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.505759    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jf9dw\""
Jul 06 23:43:27.513511 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.513304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:27.535635 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.535433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-94g74\""
Jul 06 23:43:27.543832 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.543639    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:43:27.600018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.599991    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"
Jul 06 23:43:27.605702 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.605675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:27.611938 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:27.611913    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"
Jul 06 23:43:28.019715 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.019458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf"]
Jul 06 23:43:28.058340 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.058241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2"]
Jul 06 23:43:28.077951 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.077186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gv9xc"]
Jul 06 23:43:28.100490 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:28.100460    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f5d941_3bd4_4de7_bdfd_1102b287a465.slice/crio-a7825d337d1f1de16c3e745e2c8011fc14cd5ea58c5aedab935fb5916d08279d WatchSource:0}: Error finding container a7825d337d1f1de16c3e745e2c8011fc14cd5ea58c5aedab935fb5916d08279d: Status 404 returned error can't find the container with id a7825d337d1f1de16c3e745e2c8011fc14cd5ea58c5aedab935fb5916d08279d
Jul 06 23:43:28.221777 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.221745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-pr4j6"
Jul 06 23:43:28.295770 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.295662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2" event={"ID":"70be42eb-2adf-41ea-9e24-fc9e55be08ae","Type":"ContainerStarted","Data":"c703a1cc8f4dff366bc72aad19ab9373e74f79fa010d715d9d6dd254aec9ccdf"}
Jul 06 23:43:28.302405 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.302309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf" event={"ID":"a52cf257-070d-4088-ac86-64ec27c8411d","Type":"ContainerStarted","Data":"52057c9f2e6b6201a556699b3cdc61e939e62348e06e032f95357f8d445c58ed"}
Jul 06 23:43:28.305219 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.305134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gv9xc" event={"ID":"b5f5d941-3bd4-4de7-bdfd-1102b287a465","Type":"ContainerStarted","Data":"a7825d337d1f1de16c3e745e2c8011fc14cd5ea58c5aedab935fb5916d08279d"}
Jul 06 23:43:28.311027 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.310698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxhgw" event={"ID":"9db7af15-6242-4232-8360-f16cf026a105","Type":"ContainerStarted","Data":"54c6f9379128aed54e83101cf7d7a6df4f485a43e9a428739c92f2fba32ecafc"}
Jul 06 23:43:28.338246 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.336956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"]
Jul 06 23:43:28.339974 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.339730    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz"]
Jul 06 23:43:28.341826 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.341756    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9c88c9578-rm586"]
Jul 06 23:43:28.345871 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:28.345843    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73d05735_175f_43dc_9ae6_3240731993b7.slice/crio-6bda8431a27ef96166e1386855035177c5a91a7bc1e7b2a9ee5bcc967af6df9c WatchSource:0}: Error finding container 6bda8431a27ef96166e1386855035177c5a91a7bc1e7b2a9ee5bcc967af6df9c: Status 404 returned error can't find the container with id 6bda8431a27ef96166e1386855035177c5a91a7bc1e7b2a9ee5bcc967af6df9c
Jul 06 23:43:28.346962 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:28.346922    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14cdace_d513_46ed_860a_e60ca6ed6436.slice/crio-f01f1c49b430217e89b452b1c762987a7472ea9dee8ffcc6c449c7dbe4d68ae2 WatchSource:0}: Error finding container f01f1c49b430217e89b452b1c762987a7472ea9dee8ffcc6c449c7dbe4d68ae2: Status 404 returned error can't find the container with id f01f1c49b430217e89b452b1c762987a7472ea9dee8ffcc6c449c7dbe4d68ae2
Jul 06 23:43:28.360113 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.356921    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh"]
Jul 06 23:43:28.385361 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:28.385215    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-564bc8fbd9-sfkr9"]
Jul 06 23:43:28.390011 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:28.389978    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60199009_fd69_4b69_9cfc_cf7d1b796ee5.slice/crio-2b7f43eddde4b52b3bc7efa36a7490c767c63fb7f57d367786bcaabef91de86a WatchSource:0}: Error finding container 2b7f43eddde4b52b3bc7efa36a7490c767c63fb7f57d367786bcaabef91de86a: Status 404 returned error can't find the container with id 2b7f43eddde4b52b3bc7efa36a7490c767c63fb7f57d367786bcaabef91de86a
Jul 06 23:43:29.320161 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.320050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh" event={"ID":"1ad27040-88ed-40a8-af88-46c6996545ca","Type":"ContainerStarted","Data":"e405eefdb3ef945973caac6582a1340c37dfb91c29230d76984976d83161adff"}
Jul 06 23:43:29.322747 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.322715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz" event={"ID":"73d05735-175f-43dc-9ae6-3240731993b7","Type":"ContainerStarted","Data":"6bda8431a27ef96166e1386855035177c5a91a7bc1e7b2a9ee5bcc967af6df9c"}
Jul 06 23:43:29.329516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.329483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns" event={"ID":"d7d80add-48fc-419d-bda4-c76b7511048e","Type":"ContainerStarted","Data":"b520f65d7a7d725b87802655f4787beff612fc9bbb24ef902236dce0b088a842"}
Jul 06 23:43:29.340485 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.340446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxhgw" event={"ID":"9db7af15-6242-4232-8360-f16cf026a105","Type":"ContainerStarted","Data":"7358728fade99ad7167b2e085e721a267ea13f62db50af33d5f8bd52ffb572b0"}
Jul 06 23:43:29.349023 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.348432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9" event={"ID":"60199009-fd69-4b69-9cfc-cf7d1b796ee5","Type":"ContainerStarted","Data":"5699270bb96e8096ddbeae0080fe67c4a50d68cfe113080382427c3bb8f5b8d6"}
Jul 06 23:43:29.349023 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.348484    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9" event={"ID":"60199009-fd69-4b69-9cfc-cf7d1b796ee5","Type":"ContainerStarted","Data":"2b7f43eddde4b52b3bc7efa36a7490c767c63fb7f57d367786bcaabef91de86a"}
Jul 06 23:43:29.361774 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.360312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c88c9578-rm586" event={"ID":"e14cdace-d513-46ed-860a-e60ca6ed6436","Type":"ContainerStarted","Data":"55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5"}
Jul 06 23:43:29.361774 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.360358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c88c9578-rm586" event={"ID":"e14cdace-d513-46ed-860a-e60ca6ed6436","Type":"ContainerStarted","Data":"f01f1c49b430217e89b452b1c762987a7472ea9dee8ffcc6c449c7dbe4d68ae2"}
Jul 06 23:43:29.361774 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.360382    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:43:29.397788 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.396477    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vxhgw" podStartSLOduration=67.975457441 podStartE2EDuration="1m9.3964538s" totalImagesPullingTime="1.420996359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:29.364898611 +0000 UTC m=+70.927973244" watchObservedRunningTime="2026-07-06 23:43:29.3964538 +0000 UTC m=+70.959528433"
Jul 06 23:43:29.397788 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.397381    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9c88c9578-rm586" podStartSLOduration=69.39736995 podStartE2EDuration="1m9.39736995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:29.394836893 +0000 UTC m=+70.957911526" watchObservedRunningTime="2026-07-06 23:43:29.39736995 +0000 UTC m=+70.960444583"
Jul 06 23:43:29.442455 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.442393    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9" podStartSLOduration=45.442370293 podStartE2EDuration="45.442370293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:29.4412506 +0000 UTC m=+71.004325233" watchObservedRunningTime="2026-07-06 23:43:29.442370293 +0000 UTC m=+71.005444929"
Jul 06 23:43:29.514853 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.514819    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:29.517891 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:29.517866    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:30.377533 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:30.377109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:30.385594 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:30.379662    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-564bc8fbd9-sfkr9"
Jul 06 23:43:34.359487 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:34.359453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:34.362273 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:34.362245    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4823edc-cfe8-4199-be26-cd3b7aa17ef9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wp4kf\" (UID: \"e4823edc-cfe8-4199-be26-cd3b7aa17ef9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:34.529309 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:34.529279    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7kk6n\""
Jul 06 23:43:34.537675 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:34.537644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"
Jul 06 23:43:39.801497 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:39.801454    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf"]
Jul 06 23:43:40.424567 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.424525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ngh2" event={"ID":"eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb","Type":"ContainerStarted","Data":"828054e9d60cb5777718447a0d07a27b6157199a74fb8906ee0b104bde6adfd2"}
Jul 06 23:43:40.426577 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.426553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gv9xc" event={"ID":"b5f5d941-3bd4-4de7-bdfd-1102b287a465","Type":"ContainerStarted","Data":"10fbd4cc3aed08265fd098d6a4f3ac52053533a7a175b290130ef143e8535787"}
Jul 06 23:43:40.426714 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.426601    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gv9xc" event={"ID":"b5f5d941-3bd4-4de7-bdfd-1102b287a465","Type":"ContainerStarted","Data":"2a4b105945f3fbf811b01fc6141b34fa212a55c73857ab59afbee0101e908b4e"}
Jul 06 23:43:40.426778 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.426681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:43:40.428244 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.428218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns" event={"ID":"d7d80add-48fc-419d-bda4-c76b7511048e","Type":"ContainerStarted","Data":"18960a8535019ab8dfa1116dc4533a07c277e06f3c9771934b9d3ebed2d0441c"}
Jul 06 23:43:40.428951 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.428929    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:40.430897 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.430879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns"
Jul 06 23:43:40.431552 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.431530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8vhw" event={"ID":"3229f575-4f59-4884-b78a-effff7a0d69d","Type":"ContainerStarted","Data":"c4a3f44f4f46a4c8b89961cd576f716545fd5c7ad51e1e75131f3052f44844ac"}
Jul 06 23:43:40.433099 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.433062    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf" event={"ID":"a52cf257-070d-4088-ac86-64ec27c8411d","Type":"ContainerStarted","Data":"efa73b540a348ff1185f5dc44c0a42b4c6cd295780407f975af96be2f3cba29a"}
Jul 06 23:43:40.434837 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.434802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2" event={"ID":"70be42eb-2adf-41ea-9e24-fc9e55be08ae","Type":"ContainerStarted","Data":"5cfdd8e11e3cc03720da638968be57e772969c1e7fd8e1a792ac9233d5086c13"}
Jul 06 23:43:40.434934 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.434856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2" event={"ID":"70be42eb-2adf-41ea-9e24-fc9e55be08ae","Type":"ContainerStarted","Data":"56d4c0c2b1dc9492aa51df3143240924e6361a58e3d4edade1b9822c855a4638"}
Jul 06 23:43:40.437016 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.436995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh" event={"ID":"1ad27040-88ed-40a8-af88-46c6996545ca","Type":"ContainerStarted","Data":"cbec57a06760a0fd7babc79849ca3a078046e4d549ab4a82636a9883baf78a97"}
Jul 06 23:43:40.437153 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.437031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh" event={"ID":"1ad27040-88ed-40a8-af88-46c6996545ca","Type":"ContainerStarted","Data":"d57f1a54f5a45996235532d17043e8149358821846ec2dedcafa7c435a803730"}
Jul 06 23:43:40.437153 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.437048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh" event={"ID":"1ad27040-88ed-40a8-af88-46c6996545ca","Type":"ContainerStarted","Data":"8bbf77c547cae979035b08154162150dbf8e9e53f88d8e0ce1564c269efdea33"}
Jul 06 23:43:40.438295 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.438271    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf" event={"ID":"e4823edc-cfe8-4199-be26-cd3b7aa17ef9","Type":"ContainerStarted","Data":"32044e7db0415953e8e14ba507bcd9313fcc5fda5db0968cd824fc28f561b2ca"}
Jul 06 23:43:40.439656 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.439633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz" event={"ID":"73d05735-175f-43dc-9ae6-3240731993b7","Type":"ContainerStarted","Data":"7a6f281403aa9c6f31f844094a035998b784610e690913b4f69b317f424c58f7"}
Jul 06 23:43:40.441898 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.441853    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5ngh2" podStartSLOduration=67.130314523 podStartE2EDuration="1m20.441838138s" totalImagesPullingTime="13.311523615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.441192178 +0000 UTC m=+82.004266811" watchObservedRunningTime="2026-07-06 23:43:40.441838138 +0000 UTC m=+82.004912762"
Jul 06 23:43:40.461777 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.461723    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c86c95495-4zdsh" podStartSLOduration=2.176366278 podStartE2EDuration="13.461705888s" totalImagesPullingTime="11.28533961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.459028895 +0000 UTC m=+82.022103549" watchObservedRunningTime="2026-07-06 23:43:40.461705888 +0000 UTC m=+82.024780520"
Jul 06 23:43:40.478707 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.478644    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q8vhw" podStartSLOduration=17.516247649 podStartE2EDuration="34.478628642s" totalImagesPullingTime="16.962380993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.478517168 +0000 UTC m=+82.041591802" watchObservedRunningTime="2026-07-06 23:43:40.478628642 +0000 UTC m=+82.041703276"
Jul 06 23:43:40.494896 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.494857    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q28z2" podStartSLOduration=45.006511499 podStartE2EDuration="56.494840852s" totalImagesPullingTime="11.488329353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.494302652 +0000 UTC m=+82.057377287" watchObservedRunningTime="2026-07-06 23:43:40.494840852 +0000 UTC m=+82.057915490"
Jul 06 23:43:40.514376 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.514335    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nnqcf" podStartSLOduration=44.983401841 podStartE2EDuration="56.5143228s" totalImagesPullingTime="11.530920959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.51336979 +0000 UTC m=+82.076444420" watchObservedRunningTime="2026-07-06 23:43:40.5143228 +0000 UTC m=+82.077397432"
Jul 06 23:43:40.530000 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.529952    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gv9xc" podStartSLOduration=34.003361108 podStartE2EDuration="45.529934579s" totalImagesPullingTime="11.526573471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.529320219 +0000 UTC m=+82.092394887" watchObservedRunningTime="2026-07-06 23:43:40.529934579 +0000 UTC m=+82.093009215"
Jul 06 23:43:40.564127 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.564066    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d599484b-2nqjz" podStartSLOduration=2.281502281 podStartE2EDuration="13.564053894s" totalImagesPullingTime="11.282551613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.545463224 +0000 UTC m=+82.108537857" watchObservedRunningTime="2026-07-06 23:43:40.564053894 +0000 UTC m=+82.127128531"
Jul 06 23:43:40.564280 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:40.564150    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77458894dd-5bkns" podStartSLOduration=2.265253224 podStartE2EDuration="13.564143526s" totalImagesPullingTime="11.298890302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:40.563657163 +0000 UTC m=+82.126731797" watchObservedRunningTime="2026-07-06 23:43:40.564143526 +0000 UTC m=+82.127218157"
Jul 06 23:43:42.448963 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:42.448927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf" event={"ID":"e4823edc-cfe8-4199-be26-cd3b7aa17ef9","Type":"ContainerStarted","Data":"582f44a1524398be0b3221fbc979f610c30d90d03bbc141f2da368542b8987a0"}
Jul 06 23:43:42.465483 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:42.465435    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wp4kf" podStartSLOduration=38.527354754 podStartE2EDuration="40.465419909s" totalImagesPullingTime="1.938065155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:43:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:42.464746831 +0000 UTC m=+84.027821464" watchObservedRunningTime="2026-07-06 23:43:42.465419909 +0000 UTC m=+84.028494540"
Jul 06 23:43:47.451133 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:47.451093    2581 patch_prober.go:28] interesting pod/image-registry-9c88c9578-rm586 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 23:43:47.451586 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:47.451161    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9c88c9578-rm586" podUID="e14cdace-d513-46ed-860a-e60ca6ed6436" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 23:43:50.154129 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:50.154093    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c88c9578-rm586"]
Jul 06 23:43:50.159085 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:50.159025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:43:50.445966 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:50.445932    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gv9xc"
Jul 06 23:43:53.855640 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:53.855600    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m7mvr"]
Jul 06 23:43:53.859253 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:53.859232    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:53.861844 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:53.861822    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 23:43:53.862034 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:53.861964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 23:43:53.863393 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:53.863369    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 23:43:53.863393 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:53.863381    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 23:43:53.863609 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:53.863598    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jvgrg\""
Jul 06 23:43:54.029675 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.029859 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83eb7085-bbb9-4114-8f27-66389b8f9b3e-metrics-client-ca\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.029859 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-896zs\" (UniqueName: \"kubernetes.io/projected/83eb7085-bbb9-4114-8f27-66389b8f9b3e-kube-api-access-896zs\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.029859 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-root\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.030021 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.030021 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-tls\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.030021 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-wtmp\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.030021 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.029959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-sys\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.030021 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.030004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-textfile\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.130937 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.130833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-textfile\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.130937 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.130886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.130937 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.130929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83eb7085-bbb9-4114-8f27-66389b8f9b3e-metrics-client-ca\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.130972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-896zs\" (UniqueName: \"kubernetes.io/projected/83eb7085-bbb9-4114-8f27-66389b8f9b3e-kube-api-access-896zs\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-root\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-tls\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-wtmp\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131141    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-root\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-sys\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131236 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131213    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-sys\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131627 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:54.131310    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 23:43:54.131627 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-wtmp\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131627 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131306    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-textfile\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.131627 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:43:54.131382    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-tls podName:83eb7085-bbb9-4114-8f27-66389b8f9b3e nodeName:}" failed. No retries permitted until 2026-07-06 23:43:54.631360358 +0000 UTC m=+96.194434969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-tls") pod "node-exporter-m7mvr" (UID: "83eb7085-bbb9-4114-8f27-66389b8f9b3e") : secret "node-exporter-tls" not found
Jul 06 23:43:54.131927 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.131906    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83eb7085-bbb9-4114-8f27-66389b8f9b3e-metrics-client-ca\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.132112 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.132091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.133809 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.133788    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.140141 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.140117    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-896zs\" (UniqueName: \"kubernetes.io/projected/83eb7085-bbb9-4114-8f27-66389b8f9b3e-kube-api-access-896zs\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.636594 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.636562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-tls\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.639040 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.639016    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83eb7085-bbb9-4114-8f27-66389b8f9b3e-node-exporter-tls\") pod \"node-exporter-m7mvr\" (UID: \"83eb7085-bbb9-4114-8f27-66389b8f9b3e\") " pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.770201 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:54.770165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m7mvr"
Jul 06 23:43:54.781717 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:43:54.781685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eb7085_bbb9_4114_8f27_66389b8f9b3e.slice/crio-050a3e2f5621823f45df665ae448183fa419ea7544cf30474bf02907a75641f2 WatchSource:0}: Error finding container 050a3e2f5621823f45df665ae448183fa419ea7544cf30474bf02907a75641f2: Status 404 returned error can't find the container with id 050a3e2f5621823f45df665ae448183fa419ea7544cf30474bf02907a75641f2
Jul 06 23:43:55.501777 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:55.501735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7mvr" event={"ID":"83eb7085-bbb9-4114-8f27-66389b8f9b3e","Type":"ContainerStarted","Data":"050a3e2f5621823f45df665ae448183fa419ea7544cf30474bf02907a75641f2"}
Jul 06 23:43:56.507338 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:56.507299    2581 generic.go:356] "Generic (PLEG): container finished" podID="83eb7085-bbb9-4114-8f27-66389b8f9b3e" containerID="a6f344a8ab680a7a5705cc6ab06aeab642c2778e43d654176cacf9f0df406cbc" exitCode=0
Jul 06 23:43:56.507723 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:56.507388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7mvr" event={"ID":"83eb7085-bbb9-4114-8f27-66389b8f9b3e","Type":"ContainerDied","Data":"a6f344a8ab680a7a5705cc6ab06aeab642c2778e43d654176cacf9f0df406cbc"}
Jul 06 23:43:57.513993 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:57.513955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7mvr" event={"ID":"83eb7085-bbb9-4114-8f27-66389b8f9b3e","Type":"ContainerStarted","Data":"7dcc9240d940b171123b38ac565756679041fd0b9e19c1368c9a3e1bfa1ca10c"}
Jul 06 23:43:57.514428 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:57.514019    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7mvr" event={"ID":"83eb7085-bbb9-4114-8f27-66389b8f9b3e","Type":"ContainerStarted","Data":"72c2bd13d298494d96525a8c508133eb4bf772568a77afa0759f071b2d119e5c"}
Jul 06 23:43:57.534110 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:57.534042    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m7mvr" podStartSLOduration=3.4157886619999998 podStartE2EDuration="4.534024176s" totalImagesPullingTime="1.045797453s" totalInitContainerRuntime="72.438061ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:43:57.532594442 +0000 UTC m=+99.095669076" watchObservedRunningTime="2026-07-06 23:43:57.534024176 +0000 UTC m=+99.097098808"
Jul 06 23:43:58.313806 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:43:58.313774    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x5nq7"
Jul 06 23:44:15.176258 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.176216    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9c88c9578-rm586" podUID="e14cdace-d513-46ed-860a-e60ca6ed6436" containerName="registry" containerID="cri-o://55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5" gracePeriod=30
Jul 06 23:44:15.463747 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.463715    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:44:15.500143 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.500303 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7r5j\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-kube-api-access-j7r5j\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.500303 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500175    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-image-registry-private-configuration\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.500303 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500209    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-bound-sa-token\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.500303 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500240    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-trusted-ca\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.500465 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500313    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e14cdace-d513-46ed-860a-e60ca6ed6436-ca-trust-extracted\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.500465 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500369    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-certificates\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.500465 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.500398    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-installation-pull-secrets\") pod \"e14cdace-d513-46ed-860a-e60ca6ed6436\" (UID: \"e14cdace-d513-46ed-860a-e60ca6ed6436\") "
Jul 06 23:44:15.501169 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.501103    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:44:15.501582 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.501518    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:44:15.503311 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.503243    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:44:15.503311 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.503259    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:44:15.503517 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.503371    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-kube-api-access-j7r5j" (OuterVolumeSpecName: "kube-api-access-j7r5j") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "kube-api-access-j7r5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:44:15.503517 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.503424    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:44:15.503636 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.503517    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:44:15.510015 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.509991    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14cdace-d513-46ed-860a-e60ca6ed6436-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e14cdace-d513-46ed-860a-e60ca6ed6436" (UID: "e14cdace-d513-46ed-860a-e60ca6ed6436"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:44:15.589691 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.589661    2581 generic.go:356] "Generic (PLEG): container finished" podID="e14cdace-d513-46ed-860a-e60ca6ed6436" containerID="55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5" exitCode=0
Jul 06 23:44:15.589820 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.589699    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c88c9578-rm586"
Jul 06 23:44:15.589820 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.589721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c88c9578-rm586" event={"ID":"e14cdace-d513-46ed-860a-e60ca6ed6436","Type":"ContainerDied","Data":"55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5"}
Jul 06 23:44:15.589820 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.589759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9c88c9578-rm586" event={"ID":"e14cdace-d513-46ed-860a-e60ca6ed6436","Type":"ContainerDied","Data":"f01f1c49b430217e89b452b1c762987a7472ea9dee8ffcc6c449c7dbe4d68ae2"}
Jul 06 23:44:15.589820 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.589777    2581 scope.go:117] "RemoveContainer" containerID="55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5"
Jul 06 23:44:15.598002 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.597986    2581 scope.go:117] "RemoveContainer" containerID="55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5"
Jul 06 23:44:15.598310 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:44:15.598289    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5\": container with ID starting with 55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5 not found: ID does not exist" containerID="55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5"
Jul 06 23:44:15.598365 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.598318    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5"} err="failed to get container status \"55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5\": rpc error: code = NotFound desc = could not find container \"55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5\": container with ID starting with 55bd90fe3895af969833f6b2640faea85c4b9dcce66fb35b333b2af3c5c232f5 not found: ID does not exist"
Jul 06 23:44:15.600957 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.600941    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-installation-pull-secrets\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.601018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.600958    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.601018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.600968    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7r5j\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-kube-api-access-j7r5j\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.601018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.600976    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e14cdace-d513-46ed-860a-e60ca6ed6436-image-registry-private-configuration\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.601018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.600984    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e14cdace-d513-46ed-860a-e60ca6ed6436-bound-sa-token\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.601018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.600993    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-trusted-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.601018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.601002    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e14cdace-d513-46ed-860a-e60ca6ed6436-ca-trust-extracted\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.601018 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.601009    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e14cdace-d513-46ed-860a-e60ca6ed6436-registry-certificates\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:44:15.611383 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.611362    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c88c9578-rm586"]
Jul 06 23:44:15.615059 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:15.615040    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9c88c9578-rm586"]
Jul 06 23:44:16.596232 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:16.596151    2581 generic.go:356] "Generic (PLEG): container finished" podID="5005f58d-c89e-4ed4-8e6d-44a0b1276564" containerID="5ae0f92ef8220998c079dff32408c4bdf5fc86486e49fdc3c1904b5ee5053705" exitCode=0
Jul 06 23:44:16.596232 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:16.596193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9" event={"ID":"5005f58d-c89e-4ed4-8e6d-44a0b1276564","Type":"ContainerDied","Data":"5ae0f92ef8220998c079dff32408c4bdf5fc86486e49fdc3c1904b5ee5053705"}
Jul 06 23:44:16.596614 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:16.596524    2581 scope.go:117] "RemoveContainer" containerID="5ae0f92ef8220998c079dff32408c4bdf5fc86486e49fdc3c1904b5ee5053705"
Jul 06 23:44:16.942356 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:16.942321    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14cdace-d513-46ed-860a-e60ca6ed6436" path="/var/lib/kubelet/pods/e14cdace-d513-46ed-860a-e60ca6ed6436/volumes"
Jul 06 23:44:17.603049 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:17.603018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mzzc9" event={"ID":"5005f58d-c89e-4ed4-8e6d-44a0b1276564","Type":"ContainerStarted","Data":"7f519fb8aa284184643d91e6747c4a6a9a96dc9121a1495f5b97dc08e905bfd6"}
Jul 06 23:44:21.619156 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:21.619118    2581 generic.go:356] "Generic (PLEG): container finished" podID="cf429cde-a177-4917-bcfe-b91c08621c28" containerID="3a01bb8781bf7d01407959c336fe8698ef1ca110f98d14c4f0ba9f6815bc2aff" exitCode=0
Jul 06 23:44:21.619567 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:21.619182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5" event={"ID":"cf429cde-a177-4917-bcfe-b91c08621c28","Type":"ContainerDied","Data":"3a01bb8781bf7d01407959c336fe8698ef1ca110f98d14c4f0ba9f6815bc2aff"}
Jul 06 23:44:21.619567 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:21.619513    2581 scope.go:117] "RemoveContainer" containerID="3a01bb8781bf7d01407959c336fe8698ef1ca110f98d14c4f0ba9f6815bc2aff"
Jul 06 23:44:22.624706 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:22.624672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6g9g5" event={"ID":"cf429cde-a177-4917-bcfe-b91c08621c28","Type":"ContainerStarted","Data":"49ddcb5d37971a5a2dea42e442179aae0298d4bbec1b7e5a0ab7b745921e52a0"}
Jul 06 23:44:31.663705 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:31.663666    2581 generic.go:356] "Generic (PLEG): container finished" podID="2cb7fb66-e9d3-465c-96c3-2b1267c185d4" containerID="533fc5dd0fa7b205e85c32a4c31b9feec6a3231b57c52853b31442f3e1b7a93b" exitCode=0
Jul 06 23:44:31.664214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:31.663746    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd" event={"ID":"2cb7fb66-e9d3-465c-96c3-2b1267c185d4","Type":"ContainerDied","Data":"533fc5dd0fa7b205e85c32a4c31b9feec6a3231b57c52853b31442f3e1b7a93b"}
Jul 06 23:44:31.664214 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:31.664169    2581 scope.go:117] "RemoveContainer" containerID="533fc5dd0fa7b205e85c32a4c31b9feec6a3231b57c52853b31442f3e1b7a93b"
Jul 06 23:44:32.670253 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:44:32.670223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9zbgd" event={"ID":"2cb7fb66-e9d3-465c-96c3-2b1267c185d4","Type":"ContainerStarted","Data":"3055865ecb4db0ffeda07c7dcf9c5f4857362e3193717bc3462a03c7009090ca"}
Jul 06 23:47:18.864063 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:18.864036    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:47:18.869840 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:18.869810    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:47:18.876249 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:18.876216    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 23:47:45.509771 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.509736    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"]
Jul 06 23:47:45.511531 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.510876    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14cdace-d513-46ed-860a-e60ca6ed6436" containerName="registry"
Jul 06 23:47:45.511531 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.510899    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14cdace-d513-46ed-860a-e60ca6ed6436" containerName="registry"
Jul 06 23:47:45.511531 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.511105    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14cdace-d513-46ed-860a-e60ca6ed6436" containerName="registry"
Jul 06 23:47:45.513873 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.513850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.517563 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.517533    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 23:47:45.517563 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.517538    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 23:47:45.517739 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.517608    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 23:47:45.517956 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.517943    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-clcwx\""
Jul 06 23:47:45.518316 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.518303    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 23:47:45.539881 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.539856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqqh\" (UniqueName: \"kubernetes.io/projected/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-kube-api-access-lbqqh\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.540034 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.539908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.540034 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.539938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.540034 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.539978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-manifests\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.540034 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.540023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-tmp\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.542842 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.542819    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"]
Jul 06 23:47:45.640497 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.640467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.640700 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.640515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.640700 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.640561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-manifests\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.640700 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.640587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-tmp\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.640700 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.640620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqqh\" (UniqueName: \"kubernetes.io/projected/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-kube-api-access-lbqqh\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.640991 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.640968    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-manifests\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.643085 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.643045    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.643200 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.643054    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-tmp\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.643259 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.643198    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.652658 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.652633    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqqh\" (UniqueName: \"kubernetes.io/projected/5f5fb811-84c3-442a-b500-f0a3ab4c9a7d-kube-api-access-lbqqh\") pod \"opendatahub-operator-controller-manager-5bfc4f9689-6zhrb\" (UID: \"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.823997 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.823910    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:45.960530 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.960448    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"]
Jul 06 23:47:45.964511 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:47:45.964484    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5fb811_84c3_442a_b500_f0a3ab4c9a7d.slice/crio-ea109905181613646bc246c69e9d37981f75ee7faf8938305f9537058a82456e WatchSource:0}: Error finding container ea109905181613646bc246c69e9d37981f75ee7faf8938305f9537058a82456e: Status 404 returned error can't find the container with id ea109905181613646bc246c69e9d37981f75ee7faf8938305f9537058a82456e
Jul 06 23:47:45.966232 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:45.966213    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:47:46.386127 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:46.386056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb" event={"ID":"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d","Type":"ContainerStarted","Data":"ea109905181613646bc246c69e9d37981f75ee7faf8938305f9537058a82456e"}
Jul 06 23:47:49.400851 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:49.400820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb" event={"ID":"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d","Type":"ContainerStarted","Data":"17fa61781c23f33f3bf959880700094635593e791df1ba9d02a7d71ce819a1f5"}
Jul 06 23:47:50.406590 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:50.406491    2581 generic.go:356] "Generic (PLEG): container finished" podID="5f5fb811-84c3-442a-b500-f0a3ab4c9a7d" containerID="17fa61781c23f33f3bf959880700094635593e791df1ba9d02a7d71ce819a1f5" exitCode=0
Jul 06 23:47:50.407017 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:50.406585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb" event={"ID":"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d","Type":"ContainerDied","Data":"17fa61781c23f33f3bf959880700094635593e791df1ba9d02a7d71ce819a1f5"}
Jul 06 23:47:51.413062 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:51.413024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb" event={"ID":"5f5fb811-84c3-442a-b500-f0a3ab4c9a7d","Type":"ContainerStarted","Data":"842028ad595efb4a9f7a53615742e2b3069083afacf6bfc319187707305d486f"}
Jul 06 23:47:51.413556 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:51.413128    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:47:51.439528 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:47:51.439479    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb" podStartSLOduration=2.118392937 podStartE2EDuration="6.439461625s" totalImagesPullingTime="3.238985522s" totalInitContainerRuntime="1.082083166s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:47:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:47:51.436906836 +0000 UTC m=+332.999981480" watchObservedRunningTime="2026-07-06 23:47:51.439461625 +0000 UTC m=+333.002536257"
Jul 06 23:48:02.420651 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:02.420619    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bfc4f9689-6zhrb"
Jul 06 23:48:13.427115 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.427060    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"]
Jul 06 23:48:13.430190 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.430174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.434944 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.434921    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 23:48:13.435139 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.434968    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 23:48:13.435264 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.434973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rhvnz\""
Jul 06 23:48:13.435264 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.434973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 23:48:13.435264 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.434978    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 23:48:13.435264 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.435049    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:48:13.447519 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.447491    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"]
Jul 06 23:48:13.577549 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.577515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ce8e4fac-869d-42b1-a2ac-16c7e679550a-manager-config\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.577726 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.577556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce8e4fac-869d-42b1-a2ac-16c7e679550a-cert\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.577726 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.577594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce8e4fac-869d-42b1-a2ac-16c7e679550a-metrics-cert\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.577726 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.577636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrbhm\" (UniqueName: \"kubernetes.io/projected/ce8e4fac-869d-42b1-a2ac-16c7e679550a-kube-api-access-xrbhm\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.678859 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.678777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce8e4fac-869d-42b1-a2ac-16c7e679550a-metrics-cert\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.678859 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.678821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrbhm\" (UniqueName: \"kubernetes.io/projected/ce8e4fac-869d-42b1-a2ac-16c7e679550a-kube-api-access-xrbhm\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.678859 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.678860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ce8e4fac-869d-42b1-a2ac-16c7e679550a-manager-config\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.679061 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.678877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce8e4fac-869d-42b1-a2ac-16c7e679550a-cert\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.679614 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.679592    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ce8e4fac-869d-42b1-a2ac-16c7e679550a-manager-config\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.681438 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.681415    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce8e4fac-869d-42b1-a2ac-16c7e679550a-metrics-cert\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.681553 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.681500    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce8e4fac-869d-42b1-a2ac-16c7e679550a-cert\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.713726 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.713702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrbhm\" (UniqueName: \"kubernetes.io/projected/ce8e4fac-869d-42b1-a2ac-16c7e679550a-kube-api-access-xrbhm\") pod \"lws-controller-manager-58544fcc46-hdjbt\" (UID: \"ce8e4fac-869d-42b1-a2ac-16c7e679550a\") " pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.739594 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.739564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:13.892255 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:13.892224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"]
Jul 06 23:48:13.896274 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:48:13.896248    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8e4fac_869d_42b1_a2ac_16c7e679550a.slice/crio-12969147c70b9eb57e08e50b1126c30e15f32ae524c34e2016df688ed5e83d41 WatchSource:0}: Error finding container 12969147c70b9eb57e08e50b1126c30e15f32ae524c34e2016df688ed5e83d41: Status 404 returned error can't find the container with id 12969147c70b9eb57e08e50b1126c30e15f32ae524c34e2016df688ed5e83d41
Jul 06 23:48:14.514549 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:14.514515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt" event={"ID":"ce8e4fac-869d-42b1-a2ac-16c7e679550a","Type":"ContainerStarted","Data":"12969147c70b9eb57e08e50b1126c30e15f32ae524c34e2016df688ed5e83d41"}
Jul 06 23:48:16.525688 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:16.525646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt" event={"ID":"ce8e4fac-869d-42b1-a2ac-16c7e679550a","Type":"ContainerStarted","Data":"90c9c6746eff8a21c68c25a493c856b96be26729722df405e454f401e6732295"}
Jul 06 23:48:16.526148 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:16.525815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:16.560981 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:16.560874    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt" podStartSLOduration=1.16617796 podStartE2EDuration="3.560859933s" totalImagesPullingTime="2.394681973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:16.559033139 +0000 UTC m=+358.122107770" watchObservedRunningTime="2026-07-06 23:48:16.560859933 +0000 UTC m=+358.123934628"
Jul 06 23:48:17.486788 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.486753    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"]
Jul 06 23:48:17.490067 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.490051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.494333 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.494312    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 23:48:17.494462 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.494441    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-s79l8\""
Jul 06 23:48:17.503974 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.503949    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"]
Jul 06 23:48:17.507591 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.507570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.509580 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.509559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"]
Jul 06 23:48:17.510841 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.510820    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 23:48:17.511000 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.510837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cpgjl\""
Jul 06 23:48:17.533637 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.533612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"]
Jul 06 23:48:17.616706 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.616675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e17545-9c1f-4967-a037-7893dde433e6-cert\") pod \"kserve-controller-manager-d6f4b65b8-9kbjz\" (UID: \"d7e17545-9c1f-4967-a037-7893dde433e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.616706 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.616713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbz7t\" (UniqueName: \"kubernetes.io/projected/0b2f4893-bee3-4d9c-810f-5993a9ddb282-kube-api-access-tbz7t\") pod \"llmisvc-controller-manager-777c6bd7d5-rh6tc\" (UID: \"0b2f4893-bee3-4d9c-810f-5993a9ddb282\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.616924 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.616803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b2f4893-bee3-4d9c-810f-5993a9ddb282-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rh6tc\" (UID: \"0b2f4893-bee3-4d9c-810f-5993a9ddb282\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.616924 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.616848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wtf8\" (UniqueName: \"kubernetes.io/projected/d7e17545-9c1f-4967-a037-7893dde433e6-kube-api-access-8wtf8\") pod \"kserve-controller-manager-d6f4b65b8-9kbjz\" (UID: \"d7e17545-9c1f-4967-a037-7893dde433e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.717518 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.717472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e17545-9c1f-4967-a037-7893dde433e6-cert\") pod \"kserve-controller-manager-d6f4b65b8-9kbjz\" (UID: \"d7e17545-9c1f-4967-a037-7893dde433e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.717518 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.717524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbz7t\" (UniqueName: \"kubernetes.io/projected/0b2f4893-bee3-4d9c-810f-5993a9ddb282-kube-api-access-tbz7t\") pod \"llmisvc-controller-manager-777c6bd7d5-rh6tc\" (UID: \"0b2f4893-bee3-4d9c-810f-5993a9ddb282\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.717812 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.717581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b2f4893-bee3-4d9c-810f-5993a9ddb282-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rh6tc\" (UID: \"0b2f4893-bee3-4d9c-810f-5993a9ddb282\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.717812 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.717626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wtf8\" (UniqueName: \"kubernetes.io/projected/d7e17545-9c1f-4967-a037-7893dde433e6-kube-api-access-8wtf8\") pod \"kserve-controller-manager-d6f4b65b8-9kbjz\" (UID: \"d7e17545-9c1f-4967-a037-7893dde433e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.720262 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.720227    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b2f4893-bee3-4d9c-810f-5993a9ddb282-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rh6tc\" (UID: \"0b2f4893-bee3-4d9c-810f-5993a9ddb282\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.720262 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.720227    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e17545-9c1f-4967-a037-7893dde433e6-cert\") pod \"kserve-controller-manager-d6f4b65b8-9kbjz\" (UID: \"d7e17545-9c1f-4967-a037-7893dde433e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.732893 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.732831    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wtf8\" (UniqueName: \"kubernetes.io/projected/d7e17545-9c1f-4967-a037-7893dde433e6-kube-api-access-8wtf8\") pod \"kserve-controller-manager-d6f4b65b8-9kbjz\" (UID: \"d7e17545-9c1f-4967-a037-7893dde433e6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.733056 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.733012    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbz7t\" (UniqueName: \"kubernetes.io/projected/0b2f4893-bee3-4d9c-810f-5993a9ddb282-kube-api-access-tbz7t\") pod \"llmisvc-controller-manager-777c6bd7d5-rh6tc\" (UID: \"0b2f4893-bee3-4d9c-810f-5993a9ddb282\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.802846 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.802742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:17.819292 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.819250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:17.955242 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.955199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"]
Jul 06 23:48:17.958327 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:48:17.958301    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e17545_9c1f_4967_a037_7893dde433e6.slice/crio-ef951461c20a7c6633bc0287c9fbeb6795826948e494e9bb9456c3966909581a WatchSource:0}: Error finding container ef951461c20a7c6633bc0287c9fbeb6795826948e494e9bb9456c3966909581a: Status 404 returned error can't find the container with id ef951461c20a7c6633bc0287c9fbeb6795826948e494e9bb9456c3966909581a
Jul 06 23:48:17.971620 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:17.971600    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"]
Jul 06 23:48:17.973909 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:48:17.973874    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b2f4893_bee3_4d9c_810f_5993a9ddb282.slice/crio-428ce1c0f59a86a4bfdd26debf2babf7528ae9afec3927b005f51b48b1153a24 WatchSource:0}: Error finding container 428ce1c0f59a86a4bfdd26debf2babf7528ae9afec3927b005f51b48b1153a24: Status 404 returned error can't find the container with id 428ce1c0f59a86a4bfdd26debf2babf7528ae9afec3927b005f51b48b1153a24
Jul 06 23:48:18.536804 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:18.536761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc" event={"ID":"0b2f4893-bee3-4d9c-810f-5993a9ddb282","Type":"ContainerStarted","Data":"428ce1c0f59a86a4bfdd26debf2babf7528ae9afec3927b005f51b48b1153a24"}
Jul 06 23:48:18.538117 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:18.538061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz" event={"ID":"d7e17545-9c1f-4967-a037-7893dde433e6","Type":"ContainerStarted","Data":"ef951461c20a7c6633bc0287c9fbeb6795826948e494e9bb9456c3966909581a"}
Jul 06 23:48:21.555718 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:21.555683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc" event={"ID":"0b2f4893-bee3-4d9c-810f-5993a9ddb282","Type":"ContainerStarted","Data":"1777361b9fccfda3dcf057d43101ab89f51eacae194afb4bf8edf11ce8e02907"}
Jul 06 23:48:21.556225 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:21.555864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:21.557272 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:21.557241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz" event={"ID":"d7e17545-9c1f-4967-a037-7893dde433e6","Type":"ContainerStarted","Data":"1e0a83fd133525ac12e848e34d5c0bcbd7dd33138ddbbdd958f6d285b5d953ae"}
Jul 06 23:48:21.557403 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:21.557378    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:48:21.588907 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:21.588854    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc" podStartSLOduration=1.593114176 podStartE2EDuration="4.58883926s" totalImagesPullingTime="2.995725084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:21.588376121 +0000 UTC m=+363.151450753" watchObservedRunningTime="2026-07-06 23:48:21.58883926 +0000 UTC m=+363.151913869"
Jul 06 23:48:21.628648 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:21.628595    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz" podStartSLOduration=1.660793773 podStartE2EDuration="4.628580447s" totalImagesPullingTime="2.967786674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:48:21.627193153 +0000 UTC m=+363.190267796" watchObservedRunningTime="2026-07-06 23:48:21.628580447 +0000 UTC m=+363.191655113"
Jul 06 23:48:27.532289 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:27.532259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58544fcc46-hdjbt"
Jul 06 23:48:52.564032 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:52.564003    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh6tc"
Jul 06 23:48:52.566910 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:48:52.566890    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9kbjz"
Jul 06 23:50:31.566294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.566261    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"]
Jul 06 23:50:31.568732 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.568711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:31.572876 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.572856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 23:50:31.573116 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.573103    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 23:50:31.574270 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.574250    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v84bn\""
Jul 06 23:50:31.574375 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.574256    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 23:50:31.582727 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.582705    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"]
Jul 06 23:50:31.657112 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.657081    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"]
Jul 06 23:50:31.716562 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.716528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4773b987-2881-42bc-b175-a6b9efe415c8-config-file\") pod \"limitador-limitador-64c94fd64f-f8qsh\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:31.716700 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.716566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krszv\" (UniqueName: \"kubernetes.io/projected/4773b987-2881-42bc-b175-a6b9efe415c8-kube-api-access-krszv\") pod \"limitador-limitador-64c94fd64f-f8qsh\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:31.817151 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.817043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4773b987-2881-42bc-b175-a6b9efe415c8-config-file\") pod \"limitador-limitador-64c94fd64f-f8qsh\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:31.817151 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.817112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krszv\" (UniqueName: \"kubernetes.io/projected/4773b987-2881-42bc-b175-a6b9efe415c8-kube-api-access-krszv\") pod \"limitador-limitador-64c94fd64f-f8qsh\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:31.817641 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.817621    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4773b987-2881-42bc-b175-a6b9efe415c8-config-file\") pod \"limitador-limitador-64c94fd64f-f8qsh\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:31.837021 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.836997    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krszv\" (UniqueName: \"kubernetes.io/projected/4773b987-2881-42bc-b175-a6b9efe415c8-kube-api-access-krszv\") pod \"limitador-limitador-64c94fd64f-f8qsh\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:31.878992 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:31.878965    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:32.013410 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.013383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"]
Jul 06 23:50:32.016040 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:50:32.016013    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4773b987_2881_42bc_b175_a6b9efe415c8.slice/crio-3daa38b9462d2862b146e2ad07567e8f2e2822af9c7cc2f1cc96a41df2242ca6 WatchSource:0}: Error finding container 3daa38b9462d2862b146e2ad07567e8f2e2822af9c7cc2f1cc96a41df2242ca6: Status 404 returned error can't find the container with id 3daa38b9462d2862b146e2ad07567e8f2e2822af9c7cc2f1cc96a41df2242ca6
Jul 06 23:50:32.107555 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.107472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh" event={"ID":"4773b987-2881-42bc-b175-a6b9efe415c8","Type":"ContainerStarted","Data":"3daa38b9462d2862b146e2ad07567e8f2e2822af9c7cc2f1cc96a41df2242ca6"}
Jul 06 23:50:32.537198 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.537161    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqgmc"]
Jul 06 23:50:32.540493 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.540470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqgmc"
Jul 06 23:50:32.543765 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.543744    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rhqch\""
Jul 06 23:50:32.552324 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.552299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqgmc"]
Jul 06 23:50:32.624515 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.624485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhdpm\" (UniqueName: \"kubernetes.io/projected/c578e99f-695c-4996-850d-f4cfc0a2f0f7-kube-api-access-qhdpm\") pod \"authorino-75d556bd77-cqgmc\" (UID: \"c578e99f-695c-4996-850d-f4cfc0a2f0f7\") " pod="kuadrant-system/authorino-75d556bd77-cqgmc"
Jul 06 23:50:32.725719 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.725682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhdpm\" (UniqueName: \"kubernetes.io/projected/c578e99f-695c-4996-850d-f4cfc0a2f0f7-kube-api-access-qhdpm\") pod \"authorino-75d556bd77-cqgmc\" (UID: \"c578e99f-695c-4996-850d-f4cfc0a2f0f7\") " pod="kuadrant-system/authorino-75d556bd77-cqgmc"
Jul 06 23:50:32.735477 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.735414    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhdpm\" (UniqueName: \"kubernetes.io/projected/c578e99f-695c-4996-850d-f4cfc0a2f0f7-kube-api-access-qhdpm\") pod \"authorino-75d556bd77-cqgmc\" (UID: \"c578e99f-695c-4996-850d-f4cfc0a2f0f7\") " pod="kuadrant-system/authorino-75d556bd77-cqgmc"
Jul 06 23:50:32.851320 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:32.851223    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqgmc"
Jul 06 23:50:33.033833 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:33.033756    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqgmc"]
Jul 06 23:50:33.036218 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:50:33.036184    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc578e99f_695c_4996_850d_f4cfc0a2f0f7.slice/crio-2f44394ebd90dd1b57f34085b7d5368763d9bf48513257646d4fd3ec55f47394 WatchSource:0}: Error finding container 2f44394ebd90dd1b57f34085b7d5368763d9bf48513257646d4fd3ec55f47394: Status 404 returned error can't find the container with id 2f44394ebd90dd1b57f34085b7d5368763d9bf48513257646d4fd3ec55f47394
Jul 06 23:50:33.114551 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:33.114468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqgmc" event={"ID":"c578e99f-695c-4996-850d-f4cfc0a2f0f7","Type":"ContainerStarted","Data":"2f44394ebd90dd1b57f34085b7d5368763d9bf48513257646d4fd3ec55f47394"}
Jul 06 23:50:35.131476 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:35.131439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh" event={"ID":"4773b987-2881-42bc-b175-a6b9efe415c8","Type":"ContainerStarted","Data":"b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3"}
Jul 06 23:50:35.131917 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:35.131672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:35.174330 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:35.174267    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh" podStartSLOduration=1.29059385 podStartE2EDuration="4.174245572s" totalImagesPullingTime="2.883651722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:35.172474762 +0000 UTC m=+496.735549393" watchObservedRunningTime="2026-07-06 23:50:35.174245572 +0000 UTC m=+496.737320204"
Jul 06 23:50:37.142610 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:37.142514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqgmc" event={"ID":"c578e99f-695c-4996-850d-f4cfc0a2f0f7","Type":"ContainerStarted","Data":"14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd"}
Jul 06 23:50:37.161546 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:37.161502    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cqgmc" podStartSLOduration=1.443026767 podStartE2EDuration="5.161488436s" totalImagesPullingTime="3.718461669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:37.159373988 +0000 UTC m=+498.722448620" watchObservedRunningTime="2026-07-06 23:50:37.161488436 +0000 UTC m=+498.724563067"
Jul 06 23:50:46.137724 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.137690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:46.139501 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.139479    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"]
Jul 06 23:50:46.183030 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.182995    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh" podUID="4773b987-2881-42bc-b175-a6b9efe415c8" containerName="limitador" containerID="cri-o://b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3" gracePeriod=30
Jul 06 23:50:46.741655 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.741634    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:46.841667 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.841571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4773b987-2881-42bc-b175-a6b9efe415c8-config-file\") pod \"4773b987-2881-42bc-b175-a6b9efe415c8\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") "
Jul 06 23:50:46.841818 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.841710    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krszv\" (UniqueName: \"kubernetes.io/projected/4773b987-2881-42bc-b175-a6b9efe415c8-kube-api-access-krszv\") pod \"4773b987-2881-42bc-b175-a6b9efe415c8\" (UID: \"4773b987-2881-42bc-b175-a6b9efe415c8\") "
Jul 06 23:50:46.841973 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.841950    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4773b987-2881-42bc-b175-a6b9efe415c8-config-file" (OuterVolumeSpecName: "config-file") pod "4773b987-2881-42bc-b175-a6b9efe415c8" (UID: "4773b987-2881-42bc-b175-a6b9efe415c8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:50:46.843943 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.843915    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4773b987-2881-42bc-b175-a6b9efe415c8-kube-api-access-krszv" (OuterVolumeSpecName: "kube-api-access-krszv") pod "4773b987-2881-42bc-b175-a6b9efe415c8" (UID: "4773b987-2881-42bc-b175-a6b9efe415c8"). InnerVolumeSpecName "kube-api-access-krszv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:50:46.942797 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.942763    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krszv\" (UniqueName: \"kubernetes.io/projected/4773b987-2881-42bc-b175-a6b9efe415c8-kube-api-access-krszv\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:50:46.942797 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:46.942797    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4773b987-2881-42bc-b175-a6b9efe415c8-config-file\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:50:47.188472 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.188433    2581 generic.go:356] "Generic (PLEG): container finished" podID="4773b987-2881-42bc-b175-a6b9efe415c8" containerID="b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3" exitCode=0
Jul 06 23:50:47.188903 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.188482    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"
Jul 06 23:50:47.188903 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.188518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh" event={"ID":"4773b987-2881-42bc-b175-a6b9efe415c8","Type":"ContainerDied","Data":"b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3"}
Jul 06 23:50:47.188903 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.188565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f8qsh" event={"ID":"4773b987-2881-42bc-b175-a6b9efe415c8","Type":"ContainerDied","Data":"3daa38b9462d2862b146e2ad07567e8f2e2822af9c7cc2f1cc96a41df2242ca6"}
Jul 06 23:50:47.188903 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.188593    2581 scope.go:117] "RemoveContainer" containerID="b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3"
Jul 06 23:50:47.196735 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.196715    2581 scope.go:117] "RemoveContainer" containerID="b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3"
Jul 06 23:50:47.196968 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:50:47.196951    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3\": container with ID starting with b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3 not found: ID does not exist" containerID="b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3"
Jul 06 23:50:47.197012 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.196975    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3"} err="failed to get container status \"b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3\": rpc error: code = NotFound desc = could not find container \"b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3\": container with ID starting with b6e349976922f559ec54610ba204fc32c730a922617effd34469ceb08cc4f4a3 not found: ID does not exist"
Jul 06 23:50:47.208644 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.208617    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"]
Jul 06 23:50:47.212580 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.212557    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f8qsh"]
Jul 06 23:50:47.763242 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.763202    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-hkr8c"]
Jul 06 23:50:47.763557 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.763544    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4773b987-2881-42bc-b175-a6b9efe415c8" containerName="limitador"
Jul 06 23:50:47.763600 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.763560    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4773b987-2881-42bc-b175-a6b9efe415c8" containerName="limitador"
Jul 06 23:50:47.763637 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.763619    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4773b987-2881-42bc-b175-a6b9efe415c8" containerName="limitador"
Jul 06 23:50:47.766565 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.766549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:47.769534 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.769509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 23:50:47.769673 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.769591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xms6r\""
Jul 06 23:50:47.776374 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.776351    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hkr8c"]
Jul 06 23:50:47.951985 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.951947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a54fef2-76aa-485f-981e-c79358256d0b-data\") pod \"postgres-69fb4594cf-hkr8c\" (UID: \"1a54fef2-76aa-485f-981e-c79358256d0b\") " pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:47.951985 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:47.951988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9wmm\" (UniqueName: \"kubernetes.io/projected/1a54fef2-76aa-485f-981e-c79358256d0b-kube-api-access-m9wmm\") pod \"postgres-69fb4594cf-hkr8c\" (UID: \"1a54fef2-76aa-485f-981e-c79358256d0b\") " pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:48.053362 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:48.053266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a54fef2-76aa-485f-981e-c79358256d0b-data\") pod \"postgres-69fb4594cf-hkr8c\" (UID: \"1a54fef2-76aa-485f-981e-c79358256d0b\") " pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:48.053362 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:48.053322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9wmm\" (UniqueName: \"kubernetes.io/projected/1a54fef2-76aa-485f-981e-c79358256d0b-kube-api-access-m9wmm\") pod \"postgres-69fb4594cf-hkr8c\" (UID: \"1a54fef2-76aa-485f-981e-c79358256d0b\") " pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:48.053666 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:48.053647    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a54fef2-76aa-485f-981e-c79358256d0b-data\") pod \"postgres-69fb4594cf-hkr8c\" (UID: \"1a54fef2-76aa-485f-981e-c79358256d0b\") " pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:48.062934 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:48.062912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9wmm\" (UniqueName: \"kubernetes.io/projected/1a54fef2-76aa-485f-981e-c79358256d0b-kube-api-access-m9wmm\") pod \"postgres-69fb4594cf-hkr8c\" (UID: \"1a54fef2-76aa-485f-981e-c79358256d0b\") " pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:48.077145 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:48.077111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:48.208063 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:48.207923    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hkr8c"]
Jul 06 23:50:48.210711 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:50:48.210674    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a54fef2_76aa_485f_981e_c79358256d0b.slice/crio-f048bac7bdb58b5ed3d0cf4d03a196c799688c8cf94e52c4988f51b909463b38 WatchSource:0}: Error finding container f048bac7bdb58b5ed3d0cf4d03a196c799688c8cf94e52c4988f51b909463b38: Status 404 returned error can't find the container with id f048bac7bdb58b5ed3d0cf4d03a196c799688c8cf94e52c4988f51b909463b38
Jul 06 23:50:48.944928 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:48.944889    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4773b987-2881-42bc-b175-a6b9efe415c8" path="/var/lib/kubelet/pods/4773b987-2881-42bc-b175-a6b9efe415c8/volumes"
Jul 06 23:50:49.203627 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:49.203490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hkr8c" event={"ID":"1a54fef2-76aa-485f-981e-c79358256d0b","Type":"ContainerStarted","Data":"f048bac7bdb58b5ed3d0cf4d03a196c799688c8cf94e52c4988f51b909463b38"}
Jul 06 23:50:53.223458 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:53.223374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hkr8c" event={"ID":"1a54fef2-76aa-485f-981e-c79358256d0b","Type":"ContainerStarted","Data":"ebfd8f90715a83bf7caa6abd4493fe75340e1969b2e0bbbcbdeb964f3691d1be"}
Jul 06 23:50:53.223838 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:53.223456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:53.240420 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:53.240370    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-hkr8c" podStartSLOduration=1.503278568 podStartE2EDuration="6.240354422s" totalImagesPullingTime="4.737075854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:50:53.239338246 +0000 UTC m=+514.802412879" watchObservedRunningTime="2026-07-06 23:50:53.240354422 +0000 UTC m=+514.803429054"
Jul 06 23:50:59.257415 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:59.257384    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-hkr8c"
Jul 06 23:50:59.818010 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:59.817977    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h4dlp"]
Jul 06 23:50:59.824354 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:59.824335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h4dlp"
Jul 06 23:50:59.827737 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:59.827715    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h4dlp"]
Jul 06 23:50:59.851506 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:59.851479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xml\" (UniqueName: \"kubernetes.io/projected/363e0c2f-023b-41da-8375-8d2044663cd4-kube-api-access-d9xml\") pod \"authorino-5d4b67c446-h4dlp\" (UID: \"363e0c2f-023b-41da-8375-8d2044663cd4\") " pod="kuadrant-system/authorino-5d4b67c446-h4dlp"
Jul 06 23:50:59.952705 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:59.952672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xml\" (UniqueName: \"kubernetes.io/projected/363e0c2f-023b-41da-8375-8d2044663cd4-kube-api-access-d9xml\") pod \"authorino-5d4b67c446-h4dlp\" (UID: \"363e0c2f-023b-41da-8375-8d2044663cd4\") " pod="kuadrant-system/authorino-5d4b67c446-h4dlp"
Jul 06 23:50:59.961238 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:50:59.961214    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xml\" (UniqueName: \"kubernetes.io/projected/363e0c2f-023b-41da-8375-8d2044663cd4-kube-api-access-d9xml\") pod \"authorino-5d4b67c446-h4dlp\" (UID: \"363e0c2f-023b-41da-8375-8d2044663cd4\") " pod="kuadrant-system/authorino-5d4b67c446-h4dlp"
Jul 06 23:51:00.067907 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.067876    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h4dlp"]
Jul 06 23:51:00.068233 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.068172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h4dlp"
Jul 06 23:51:00.094040 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.094008    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66664bc66c-wlmlc"]
Jul 06 23:51:00.099618 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.099593    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66664bc66c-wlmlc"
Jul 06 23:51:00.104982 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.104954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66664bc66c-wlmlc"]
Jul 06 23:51:00.154271 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.154188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvlzw\" (UniqueName: \"kubernetes.io/projected/f7326491-de0a-4a48-a2d1-b488306ce621-kube-api-access-mvlzw\") pod \"authorino-66664bc66c-wlmlc\" (UID: \"f7326491-de0a-4a48-a2d1-b488306ce621\") " pod="kuadrant-system/authorino-66664bc66c-wlmlc"
Jul 06 23:51:00.193271 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.193241    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66664bc66c-wlmlc"]
Jul 06 23:51:00.193545 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:51:00.193523    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mvlzw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-66664bc66c-wlmlc" podUID="f7326491-de0a-4a48-a2d1-b488306ce621"
Jul 06 23:51:00.211481 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.211459    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h4dlp"]
Jul 06 23:51:00.214316 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:51:00.214293    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod363e0c2f_023b_41da_8375_8d2044663cd4.slice/crio-1929f5f7cca88bb1f4a637b45a06c6486916587bbceb51721bc45fe18a495c5d WatchSource:0}: Error finding container 1929f5f7cca88bb1f4a637b45a06c6486916587bbceb51721bc45fe18a495c5d: Status 404 returned error can't find the container with id 1929f5f7cca88bb1f4a637b45a06c6486916587bbceb51721bc45fe18a495c5d
Jul 06 23:51:00.225707 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.225683    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-764d67fcf9-8zhsn"]
Jul 06 23:51:00.229998 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.229973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.232676 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.232657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 23:51:00.235950 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.235932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-764d67fcf9-8zhsn"]
Jul 06 23:51:00.255192 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.255160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqn5\" (UniqueName: \"kubernetes.io/projected/e39e9324-83de-4f35-bfbd-00cdf3514e0b-kube-api-access-dkqn5\") pod \"authorino-764d67fcf9-8zhsn\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") " pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.255341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.255225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvlzw\" (UniqueName: \"kubernetes.io/projected/f7326491-de0a-4a48-a2d1-b488306ce621-kube-api-access-mvlzw\") pod \"authorino-66664bc66c-wlmlc\" (UID: \"f7326491-de0a-4a48-a2d1-b488306ce621\") " pod="kuadrant-system/authorino-66664bc66c-wlmlc"
Jul 06 23:51:00.255341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.255292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e39e9324-83de-4f35-bfbd-00cdf3514e0b-tls-cert\") pod \"authorino-764d67fcf9-8zhsn\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") " pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.257141 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.257110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h4dlp" event={"ID":"363e0c2f-023b-41da-8375-8d2044663cd4","Type":"ContainerStarted","Data":"1929f5f7cca88bb1f4a637b45a06c6486916587bbceb51721bc45fe18a495c5d"}
Jul 06 23:51:00.257253 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.257149    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66664bc66c-wlmlc"
Jul 06 23:51:00.263473 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.263447    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvlzw\" (UniqueName: \"kubernetes.io/projected/f7326491-de0a-4a48-a2d1-b488306ce621-kube-api-access-mvlzw\") pod \"authorino-66664bc66c-wlmlc\" (UID: \"f7326491-de0a-4a48-a2d1-b488306ce621\") " pod="kuadrant-system/authorino-66664bc66c-wlmlc"
Jul 06 23:51:00.263961 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.263945    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66664bc66c-wlmlc"
Jul 06 23:51:00.355709 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.355615    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvlzw\" (UniqueName: \"kubernetes.io/projected/f7326491-de0a-4a48-a2d1-b488306ce621-kube-api-access-mvlzw\") pod \"f7326491-de0a-4a48-a2d1-b488306ce621\" (UID: \"f7326491-de0a-4a48-a2d1-b488306ce621\") "
Jul 06 23:51:00.355870 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.355720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e39e9324-83de-4f35-bfbd-00cdf3514e0b-tls-cert\") pod \"authorino-764d67fcf9-8zhsn\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") " pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.355870 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.355767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqn5\" (UniqueName: \"kubernetes.io/projected/e39e9324-83de-4f35-bfbd-00cdf3514e0b-kube-api-access-dkqn5\") pod \"authorino-764d67fcf9-8zhsn\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") " pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.357837 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.357808    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7326491-de0a-4a48-a2d1-b488306ce621-kube-api-access-mvlzw" (OuterVolumeSpecName: "kube-api-access-mvlzw") pod "f7326491-de0a-4a48-a2d1-b488306ce621" (UID: "f7326491-de0a-4a48-a2d1-b488306ce621"). InnerVolumeSpecName "kube-api-access-mvlzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:00.358207 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.358189    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e39e9324-83de-4f35-bfbd-00cdf3514e0b-tls-cert\") pod \"authorino-764d67fcf9-8zhsn\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") " pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.364222 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.364199    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqn5\" (UniqueName: \"kubernetes.io/projected/e39e9324-83de-4f35-bfbd-00cdf3514e0b-kube-api-access-dkqn5\") pod \"authorino-764d67fcf9-8zhsn\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") " pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.456771 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.456738    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvlzw\" (UniqueName: \"kubernetes.io/projected/f7326491-de0a-4a48-a2d1-b488306ce621-kube-api-access-mvlzw\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:51:00.540782 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.540750    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:51:00.676601 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:00.676577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-764d67fcf9-8zhsn"]
Jul 06 23:51:00.678625 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:51:00.678598    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode39e9324_83de_4f35_bfbd_00cdf3514e0b.slice/crio-bdb64764dd76e2005eb2694cba5d2a4a7b86aa49341751c5662973001bc12cfe WatchSource:0}: Error finding container bdb64764dd76e2005eb2694cba5d2a4a7b86aa49341751c5662973001bc12cfe: Status 404 returned error can't find the container with id bdb64764dd76e2005eb2694cba5d2a4a7b86aa49341751c5662973001bc12cfe
Jul 06 23:51:01.264115 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.264003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-764d67fcf9-8zhsn" event={"ID":"e39e9324-83de-4f35-bfbd-00cdf3514e0b","Type":"ContainerStarted","Data":"cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9"}
Jul 06 23:51:01.264115 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.264043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-764d67fcf9-8zhsn" event={"ID":"e39e9324-83de-4f35-bfbd-00cdf3514e0b","Type":"ContainerStarted","Data":"bdb64764dd76e2005eb2694cba5d2a4a7b86aa49341751c5662973001bc12cfe"}
Jul 06 23:51:01.265726 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.265701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h4dlp" event={"ID":"363e0c2f-023b-41da-8375-8d2044663cd4","Type":"ContainerStarted","Data":"fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3"}
Jul 06 23:51:01.265872 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.265726    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-h4dlp" podUID="363e0c2f-023b-41da-8375-8d2044663cd4" containerName="authorino" containerID="cri-o://fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3" gracePeriod=30
Jul 06 23:51:01.265872 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.265766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66664bc66c-wlmlc"
Jul 06 23:51:01.282976 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.282931    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-764d67fcf9-8zhsn" podStartSLOduration=0.849678546 podStartE2EDuration="1.282911466s" totalImagesPullingTime="433.23292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:01.282542132 +0000 UTC m=+522.845616765" watchObservedRunningTime="2026-07-06 23:51:01.282911466 +0000 UTC m=+522.845986098"
Jul 06 23:51:01.299204 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.299146    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-h4dlp" podStartSLOduration=1.828486373 podStartE2EDuration="2.299127807s" totalImagesPullingTime="470.641434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:01.298229123 +0000 UTC m=+522.861303756" watchObservedRunningTime="2026-07-06 23:51:01.299127807 +0000 UTC m=+522.862202439"
Jul 06 23:51:01.316550 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.316522    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqgmc"]
Jul 06 23:51:01.316744 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.316719    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cqgmc" podUID="c578e99f-695c-4996-850d-f4cfc0a2f0f7" containerName="authorino" containerID="cri-o://14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd" gracePeriod=30
Jul 06 23:51:01.332006 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.331978    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66664bc66c-wlmlc"]
Jul 06 23:51:01.338300 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.338277    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66664bc66c-wlmlc"]
Jul 06 23:51:01.576336 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.576309    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h4dlp"
Jul 06 23:51:01.588348 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.588321    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqgmc"
Jul 06 23:51:01.667416 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.667381    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9xml\" (UniqueName: \"kubernetes.io/projected/363e0c2f-023b-41da-8375-8d2044663cd4-kube-api-access-d9xml\") pod \"363e0c2f-023b-41da-8375-8d2044663cd4\" (UID: \"363e0c2f-023b-41da-8375-8d2044663cd4\") "
Jul 06 23:51:01.667602 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.667447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhdpm\" (UniqueName: \"kubernetes.io/projected/c578e99f-695c-4996-850d-f4cfc0a2f0f7-kube-api-access-qhdpm\") pod \"c578e99f-695c-4996-850d-f4cfc0a2f0f7\" (UID: \"c578e99f-695c-4996-850d-f4cfc0a2f0f7\") "
Jul 06 23:51:01.669623 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.669589    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/363e0c2f-023b-41da-8375-8d2044663cd4-kube-api-access-d9xml" (OuterVolumeSpecName: "kube-api-access-d9xml") pod "363e0c2f-023b-41da-8375-8d2044663cd4" (UID: "363e0c2f-023b-41da-8375-8d2044663cd4"). InnerVolumeSpecName "kube-api-access-d9xml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:01.669623 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.669599    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c578e99f-695c-4996-850d-f4cfc0a2f0f7-kube-api-access-qhdpm" (OuterVolumeSpecName: "kube-api-access-qhdpm") pod "c578e99f-695c-4996-850d-f4cfc0a2f0f7" (UID: "c578e99f-695c-4996-850d-f4cfc0a2f0f7"). InnerVolumeSpecName "kube-api-access-qhdpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:01.768597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.768560    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9xml\" (UniqueName: \"kubernetes.io/projected/363e0c2f-023b-41da-8375-8d2044663cd4-kube-api-access-d9xml\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:51:01.768597 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:01.768587    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhdpm\" (UniqueName: \"kubernetes.io/projected/c578e99f-695c-4996-850d-f4cfc0a2f0f7-kube-api-access-qhdpm\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:51:02.271866 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.271775    2581 generic.go:356] "Generic (PLEG): container finished" podID="c578e99f-695c-4996-850d-f4cfc0a2f0f7" containerID="14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd" exitCode=0
Jul 06 23:51:02.271866 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.271817    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqgmc"
Jul 06 23:51:02.271866 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.271856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqgmc" event={"ID":"c578e99f-695c-4996-850d-f4cfc0a2f0f7","Type":"ContainerDied","Data":"14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd"}
Jul 06 23:51:02.272456 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.271897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqgmc" event={"ID":"c578e99f-695c-4996-850d-f4cfc0a2f0f7","Type":"ContainerDied","Data":"2f44394ebd90dd1b57f34085b7d5368763d9bf48513257646d4fd3ec55f47394"}
Jul 06 23:51:02.272456 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.271914    2581 scope.go:117] "RemoveContainer" containerID="14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd"
Jul 06 23:51:02.273358 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.273335    2581 generic.go:356] "Generic (PLEG): container finished" podID="363e0c2f-023b-41da-8375-8d2044663cd4" containerID="fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3" exitCode=0
Jul 06 23:51:02.273439 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.273376    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h4dlp"
Jul 06 23:51:02.273439 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.273425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h4dlp" event={"ID":"363e0c2f-023b-41da-8375-8d2044663cd4","Type":"ContainerDied","Data":"fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3"}
Jul 06 23:51:02.273566 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.273461    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h4dlp" event={"ID":"363e0c2f-023b-41da-8375-8d2044663cd4","Type":"ContainerDied","Data":"1929f5f7cca88bb1f4a637b45a06c6486916587bbceb51721bc45fe18a495c5d"}
Jul 06 23:51:02.281052 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.281035    2581 scope.go:117] "RemoveContainer" containerID="14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd"
Jul 06 23:51:02.281377 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:51:02.281359    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd\": container with ID starting with 14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd not found: ID does not exist" containerID="14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd"
Jul 06 23:51:02.281456 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.281390    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd"} err="failed to get container status \"14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd\": rpc error: code = NotFound desc = could not find container \"14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd\": container with ID starting with 14b71079924d5ae1a97d0bf0aef7182b78ad6367dd07a8529168a869e6b7b7fd not found: ID does not exist"
Jul 06 23:51:02.281456 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.281413    2581 scope.go:117] "RemoveContainer" containerID="fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3"
Jul 06 23:51:02.289882 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.289860    2581 scope.go:117] "RemoveContainer" containerID="fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3"
Jul 06 23:51:02.290205 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:51:02.290188    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3\": container with ID starting with fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3 not found: ID does not exist" containerID="fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3"
Jul 06 23:51:02.290263 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.290213    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3"} err="failed to get container status \"fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3\": rpc error: code = NotFound desc = could not find container \"fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3\": container with ID starting with fb34e097201d4e53f8a4759169301c2eec43a7f4d3788618d9ca45f75a10d0c3 not found: ID does not exist"
Jul 06 23:51:02.297611 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.297579    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqgmc"]
Jul 06 23:51:02.301036 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.301014    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqgmc"]
Jul 06 23:51:02.311577 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.311557    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h4dlp"]
Jul 06 23:51:02.316543 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.316524    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h4dlp"]
Jul 06 23:51:02.942126 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.942095    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="363e0c2f-023b-41da-8375-8d2044663cd4" path="/var/lib/kubelet/pods/363e0c2f-023b-41da-8375-8d2044663cd4/volumes"
Jul 06 23:51:02.942415 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.942402    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c578e99f-695c-4996-850d-f4cfc0a2f0f7" path="/var/lib/kubelet/pods/c578e99f-695c-4996-850d-f4cfc0a2f0f7/volumes"
Jul 06 23:51:02.942672 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:02.942661    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7326491-de0a-4a48-a2d1-b488306ce621" path="/var/lib/kubelet/pods/f7326491-de0a-4a48-a2d1-b488306ce621/volumes"
Jul 06 23:51:05.899667 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:05.899628    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bcff797fb-h5pbp"]
Jul 06 23:51:05.900064 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:05.899986    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c578e99f-695c-4996-850d-f4cfc0a2f0f7" containerName="authorino"
Jul 06 23:51:05.900064 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:05.899998    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c578e99f-695c-4996-850d-f4cfc0a2f0f7" containerName="authorino"
Jul 06 23:51:05.900064 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:05.900005    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="363e0c2f-023b-41da-8375-8d2044663cd4" containerName="authorino"
Jul 06 23:51:05.900064 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:05.900010    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="363e0c2f-023b-41da-8375-8d2044663cd4" containerName="authorino"
Jul 06 23:51:05.900064 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:05.900092    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="363e0c2f-023b-41da-8375-8d2044663cd4" containerName="authorino"
Jul 06 23:51:05.900294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:05.900100    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c578e99f-695c-4996-850d-f4cfc0a2f0f7" containerName="authorino"
Jul 06 23:51:06.114390 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.114349    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcff797fb-h5pbp"]
Jul 06 23:51:06.114390 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.114387    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-694cd7b67-tmc9x"]
Jul 06 23:51:06.114586 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.114494    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.117509 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.117486    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 23:51:06.117661 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.117537    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k5nzc\""
Jul 06 23:51:06.117661 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.117486    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 23:51:06.139321 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.139292    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694cd7b67-tmc9x"]
Jul 06 23:51:06.139442 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.139411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.206314 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.206279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a22f9e67-dc00-45ad-93f9-a5c506872a55-webhook-cert\") pod \"maas-controller-bcff797fb-h5pbp\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") " pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.206472 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.206414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cef7815-9236-4463-8e7a-0ea019bfcfc7-webhook-cert\") pod \"maas-controller-694cd7b67-tmc9x\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") " pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.206472 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.206444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt6gs\" (UniqueName: \"kubernetes.io/projected/a22f9e67-dc00-45ad-93f9-a5c506872a55-kube-api-access-xt6gs\") pod \"maas-controller-bcff797fb-h5pbp\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") " pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.206563 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.206477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xksh\" (UniqueName: \"kubernetes.io/projected/8cef7815-9236-4463-8e7a-0ea019bfcfc7-kube-api-access-7xksh\") pod \"maas-controller-694cd7b67-tmc9x\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") " pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.307883 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.307846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cef7815-9236-4463-8e7a-0ea019bfcfc7-webhook-cert\") pod \"maas-controller-694cd7b67-tmc9x\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") " pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.307883 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.307885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt6gs\" (UniqueName: \"kubernetes.io/projected/a22f9e67-dc00-45ad-93f9-a5c506872a55-kube-api-access-xt6gs\") pod \"maas-controller-bcff797fb-h5pbp\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") " pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.308131 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.307926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xksh\" (UniqueName: \"kubernetes.io/projected/8cef7815-9236-4463-8e7a-0ea019bfcfc7-kube-api-access-7xksh\") pod \"maas-controller-694cd7b67-tmc9x\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") " pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.308131 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.308118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a22f9e67-dc00-45ad-93f9-a5c506872a55-webhook-cert\") pod \"maas-controller-bcff797fb-h5pbp\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") " pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.310530 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.310508    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cef7815-9236-4463-8e7a-0ea019bfcfc7-webhook-cert\") pod \"maas-controller-694cd7b67-tmc9x\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") " pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.310645 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.310628    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a22f9e67-dc00-45ad-93f9-a5c506872a55-webhook-cert\") pod \"maas-controller-bcff797fb-h5pbp\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") " pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.316811 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.316779    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xksh\" (UniqueName: \"kubernetes.io/projected/8cef7815-9236-4463-8e7a-0ea019bfcfc7-kube-api-access-7xksh\") pod \"maas-controller-694cd7b67-tmc9x\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") " pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.317542 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.317521    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt6gs\" (UniqueName: \"kubernetes.io/projected/a22f9e67-dc00-45ad-93f9-a5c506872a55-kube-api-access-xt6gs\") pod \"maas-controller-bcff797fb-h5pbp\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") " pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.427370 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.427328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:06.449518 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.449486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:06.611356 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.611321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcff797fb-h5pbp"]
Jul 06 23:51:06.614345 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:51:06.614310    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22f9e67_dc00_45ad_93f9_a5c506872a55.slice/crio-65a7aa5b14698c962d2dde0a96eee0f6126973ddb4dc78f3926d2e4d4158ec5a WatchSource:0}: Error finding container 65a7aa5b14698c962d2dde0a96eee0f6126973ddb4dc78f3926d2e4d4158ec5a: Status 404 returned error can't find the container with id 65a7aa5b14698c962d2dde0a96eee0f6126973ddb4dc78f3926d2e4d4158ec5a
Jul 06 23:51:06.637322 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:06.637301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694cd7b67-tmc9x"]
Jul 06 23:51:06.639763 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:51:06.639740    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cef7815_9236_4463_8e7a_0ea019bfcfc7.slice/crio-8c1e5d12264af0e382d8ee21bda3288a8641262ecf0e851d306641707a3eaf0f WatchSource:0}: Error finding container 8c1e5d12264af0e382d8ee21bda3288a8641262ecf0e851d306641707a3eaf0f: Status 404 returned error can't find the container with id 8c1e5d12264af0e382d8ee21bda3288a8641262ecf0e851d306641707a3eaf0f
Jul 06 23:51:07.301705 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:07.301656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694cd7b67-tmc9x" event={"ID":"8cef7815-9236-4463-8e7a-0ea019bfcfc7","Type":"ContainerStarted","Data":"8c1e5d12264af0e382d8ee21bda3288a8641262ecf0e851d306641707a3eaf0f"}
Jul 06 23:51:07.303966 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:07.303893    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcff797fb-h5pbp" event={"ID":"a22f9e67-dc00-45ad-93f9-a5c506872a55","Type":"ContainerStarted","Data":"65a7aa5b14698c962d2dde0a96eee0f6126973ddb4dc78f3926d2e4d4158ec5a"}
Jul 06 23:51:10.322688 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:10.322646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcff797fb-h5pbp" event={"ID":"a22f9e67-dc00-45ad-93f9-a5c506872a55","Type":"ContainerStarted","Data":"535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3"}
Jul 06 23:51:10.323258 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:10.322810    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:10.324417 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:10.324384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694cd7b67-tmc9x" event={"ID":"8cef7815-9236-4463-8e7a-0ea019bfcfc7","Type":"ContainerStarted","Data":"c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c"}
Jul 06 23:51:10.324540 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:10.324526    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:10.342062 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:10.342016    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bcff797fb-h5pbp" podStartSLOduration=2.534730317 podStartE2EDuration="5.342001847s" totalImagesPullingTime="2.80727153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:10.341446904 +0000 UTC m=+531.904521535" watchObservedRunningTime="2026-07-06 23:51:10.342001847 +0000 UTC m=+531.905076479"
Jul 06 23:51:10.360278 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:10.360229    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-694cd7b67-tmc9x" podStartSLOduration=1.568323628 podStartE2EDuration="4.360213487s" totalImagesPullingTime="2.791889859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:10.359504993 +0000 UTC m=+531.922579626" watchObservedRunningTime="2026-07-06 23:51:10.360213487 +0000 UTC m=+531.923288119"
Jul 06 23:51:21.334587 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.334550    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:51:21.335106 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.334849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:21.385042 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.385013    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcff797fb-h5pbp"]
Jul 06 23:51:21.385225 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.385203    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-bcff797fb-h5pbp" podUID="a22f9e67-dc00-45ad-93f9-a5c506872a55" containerName="manager" containerID="cri-o://535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3" gracePeriod=30
Jul 06 23:51:21.635996 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.635973    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:21.740037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.739993    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt6gs\" (UniqueName: \"kubernetes.io/projected/a22f9e67-dc00-45ad-93f9-a5c506872a55-kube-api-access-xt6gs\") pod \"a22f9e67-dc00-45ad-93f9-a5c506872a55\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") "
Jul 06 23:51:21.740037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.740046    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a22f9e67-dc00-45ad-93f9-a5c506872a55-webhook-cert\") pod \"a22f9e67-dc00-45ad-93f9-a5c506872a55\" (UID: \"a22f9e67-dc00-45ad-93f9-a5c506872a55\") "
Jul 06 23:51:21.742485 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.742447    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a22f9e67-dc00-45ad-93f9-a5c506872a55-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a22f9e67-dc00-45ad-93f9-a5c506872a55" (UID: "a22f9e67-dc00-45ad-93f9-a5c506872a55"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:51:21.742598 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.742480    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22f9e67-dc00-45ad-93f9-a5c506872a55-kube-api-access-xt6gs" (OuterVolumeSpecName: "kube-api-access-xt6gs") pod "a22f9e67-dc00-45ad-93f9-a5c506872a55" (UID: "a22f9e67-dc00-45ad-93f9-a5c506872a55"). InnerVolumeSpecName "kube-api-access-xt6gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:51:21.841370 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.841330    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt6gs\" (UniqueName: \"kubernetes.io/projected/a22f9e67-dc00-45ad-93f9-a5c506872a55-kube-api-access-xt6gs\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:51:21.841370 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:21.841372    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a22f9e67-dc00-45ad-93f9-a5c506872a55-webhook-cert\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:51:22.381644 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.381611    2581 generic.go:356] "Generic (PLEG): container finished" podID="a22f9e67-dc00-45ad-93f9-a5c506872a55" containerID="535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3" exitCode=0
Jul 06 23:51:22.382037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.381670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcff797fb-h5pbp" event={"ID":"a22f9e67-dc00-45ad-93f9-a5c506872a55","Type":"ContainerDied","Data":"535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3"}
Jul 06 23:51:22.382037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.381707    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcff797fb-h5pbp"
Jul 06 23:51:22.382037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.381714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcff797fb-h5pbp" event={"ID":"a22f9e67-dc00-45ad-93f9-a5c506872a55","Type":"ContainerDied","Data":"65a7aa5b14698c962d2dde0a96eee0f6126973ddb4dc78f3926d2e4d4158ec5a"}
Jul 06 23:51:22.382037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.381737    2581 scope.go:117] "RemoveContainer" containerID="535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3"
Jul 06 23:51:22.391272 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.391123    2581 scope.go:117] "RemoveContainer" containerID="535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3"
Jul 06 23:51:22.391444 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:51:22.391422    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3\": container with ID starting with 535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3 not found: ID does not exist" containerID="535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3"
Jul 06 23:51:22.391501 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.391457    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3"} err="failed to get container status \"535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3\": rpc error: code = NotFound desc = could not find container \"535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3\": container with ID starting with 535c2f5d7752e4579ee4d21cc5743b88decd7123942fdb277961d41163a310f3 not found: ID does not exist"
Jul 06 23:51:22.403613 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.403581    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcff797fb-h5pbp"]
Jul 06 23:51:22.407382 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.407358    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bcff797fb-h5pbp"]
Jul 06 23:51:22.942784 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:22.942752    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a22f9e67-dc00-45ad-93f9-a5c506872a55" path="/var/lib/kubelet/pods/a22f9e67-dc00-45ad-93f9-a5c506872a55/volumes"
Jul 06 23:51:41.578997 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.578951    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-74c7cd457b-4zxz7"]
Jul 06 23:51:41.579517 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.579501    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22f9e67-dc00-45ad-93f9-a5c506872a55" containerName="manager"
Jul 06 23:51:41.579567 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.579520    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22f9e67-dc00-45ad-93f9-a5c506872a55" containerName="manager"
Jul 06 23:51:41.579611 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.579602    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a22f9e67-dc00-45ad-93f9-a5c506872a55" containerName="manager"
Jul 06 23:51:41.582756 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.582709    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.586043 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.586022    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 23:51:41.605292 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.605266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74c7cd457b-4zxz7"]
Jul 06 23:51:41.715029 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.714988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3db69ad6-545f-48b6-9e36-a35346187c19-maas-api-tls\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.715251 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.715040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftwjb\" (UniqueName: \"kubernetes.io/projected/3db69ad6-545f-48b6-9e36-a35346187c19-kube-api-access-ftwjb\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.715251 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.715222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3db69ad6-545f-48b6-9e36-a35346187c19-openshift-service-ca\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.816039 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.816004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3db69ad6-545f-48b6-9e36-a35346187c19-openshift-service-ca\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.816263 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.816060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3db69ad6-545f-48b6-9e36-a35346187c19-maas-api-tls\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.816263 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.816125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwjb\" (UniqueName: \"kubernetes.io/projected/3db69ad6-545f-48b6-9e36-a35346187c19-kube-api-access-ftwjb\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.816263 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:51:41.816243    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 23:51:41.816418 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:51:41.816330    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db69ad6-545f-48b6-9e36-a35346187c19-maas-api-tls podName:3db69ad6-545f-48b6-9e36-a35346187c19 nodeName:}" failed. No retries permitted until 2026-07-06 23:51:42.316313229 +0000 UTC m=+563.879387839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3db69ad6-545f-48b6-9e36-a35346187c19-maas-api-tls") pod "maas-api-74c7cd457b-4zxz7" (UID: "3db69ad6-545f-48b6-9e36-a35346187c19") : secret "maas-api-serving-cert" not found
Jul 06 23:51:41.816630 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.816611    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3db69ad6-545f-48b6-9e36-a35346187c19-openshift-service-ca\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:41.836844 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:41.836774    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftwjb\" (UniqueName: \"kubernetes.io/projected/3db69ad6-545f-48b6-9e36-a35346187c19-kube-api-access-ftwjb\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:42.320912 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.320870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3db69ad6-545f-48b6-9e36-a35346187c19-maas-api-tls\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:42.323491 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.323461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3db69ad6-545f-48b6-9e36-a35346187c19-maas-api-tls\") pod \"maas-api-74c7cd457b-4zxz7\" (UID: \"3db69ad6-545f-48b6-9e36-a35346187c19\") " pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:42.410667 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.410635    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x846l"]
Jul 06 23:51:42.414261 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.414241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.420280 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.420254    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 23:51:42.420280 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.420274    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-255cc\""
Jul 06 23:51:42.421508 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.421392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x846l\" (UID: \"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8\") " pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.421508 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.421427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwds\" (UniqueName: \"kubernetes.io/projected/878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8-kube-api-access-kkwds\") pod \"payload-pre-processing-7964457696-x846l\" (UID: \"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8\") " pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.436292 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.436264    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x846l"]
Jul 06 23:51:42.464583 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.464553    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cl6jj"]
Jul 06 23:51:42.467748 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.467726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.493242 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.493216    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cl6jj"]
Jul 06 23:51:42.493377 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.493268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:42.521966 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.521935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fccffb-03a0-470d-8fad-f5c946e9d765-plugins-config-volume\") pod \"payload-processing-58f86c7798-cl6jj\" (UID: \"12fccffb-03a0-470d-8fad-f5c946e9d765\") " pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.522128 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.521989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x846l\" (UID: \"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8\") " pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.522128 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.522054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwds\" (UniqueName: \"kubernetes.io/projected/878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8-kube-api-access-kkwds\") pod \"payload-pre-processing-7964457696-x846l\" (UID: \"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8\") " pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.522226 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.522129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv2sg\" (UniqueName: \"kubernetes.io/projected/12fccffb-03a0-470d-8fad-f5c946e9d765-kube-api-access-sv2sg\") pod \"payload-processing-58f86c7798-cl6jj\" (UID: \"12fccffb-03a0-470d-8fad-f5c946e9d765\") " pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.522639 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.522622    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-x846l\" (UID: \"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8\") " pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.542742 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.542676    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwds\" (UniqueName: \"kubernetes.io/projected/878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8-kube-api-access-kkwds\") pod \"payload-pre-processing-7964457696-x846l\" (UID: \"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8\") " pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.622580 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.622549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fccffb-03a0-470d-8fad-f5c946e9d765-plugins-config-volume\") pod \"payload-processing-58f86c7798-cl6jj\" (UID: \"12fccffb-03a0-470d-8fad-f5c946e9d765\") " pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.622945 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.622620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv2sg\" (UniqueName: \"kubernetes.io/projected/12fccffb-03a0-470d-8fad-f5c946e9d765-kube-api-access-sv2sg\") pod \"payload-processing-58f86c7798-cl6jj\" (UID: \"12fccffb-03a0-470d-8fad-f5c946e9d765\") " pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.623274 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.623253    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12fccffb-03a0-470d-8fad-f5c946e9d765-plugins-config-volume\") pod \"payload-processing-58f86c7798-cl6jj\" (UID: \"12fccffb-03a0-470d-8fad-f5c946e9d765\") " pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.642461 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.642436    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv2sg\" (UniqueName: \"kubernetes.io/projected/12fccffb-03a0-470d-8fad-f5c946e9d765-kube-api-access-sv2sg\") pod \"payload-processing-58f86c7798-cl6jj\" (UID: \"12fccffb-03a0-470d-8fad-f5c946e9d765\") " pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.663024 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.662996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74c7cd457b-4zxz7"]
Jul 06 23:51:42.665539 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:51:42.665515    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db69ad6_545f_48b6_9e36_a35346187c19.slice/crio-1a18735a2fa0eaff9bcf0e66093cd2f0144891cb9cfa68ad07bd567383d37c50 WatchSource:0}: Error finding container 1a18735a2fa0eaff9bcf0e66093cd2f0144891cb9cfa68ad07bd567383d37c50: Status 404 returned error can't find the container with id 1a18735a2fa0eaff9bcf0e66093cd2f0144891cb9cfa68ad07bd567383d37c50
Jul 06 23:51:42.725228 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.725196    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:42.777676 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.777625    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:42.887153 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.887050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-x846l"]
Jul 06 23:51:42.887476 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:51:42.887428    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878f8ff6_ba3b_428c_bd2a_bbf0a8874aa8.slice/crio-647ec895199f4bf4d81dfcaf0493a930e0a61978034d68e9bde86c7af1e4107b WatchSource:0}: Error finding container 647ec895199f4bf4d81dfcaf0493a930e0a61978034d68e9bde86c7af1e4107b: Status 404 returned error can't find the container with id 647ec895199f4bf4d81dfcaf0493a930e0a61978034d68e9bde86c7af1e4107b
Jul 06 23:51:42.948689 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:42.948647    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cl6jj"]
Jul 06 23:51:42.953569 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:51:42.953530    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fccffb_03a0_470d_8fad_f5c946e9d765.slice/crio-4268fffb916567fcf4f3f4d1a1b14d40521d6f5d91a4204b95b2a9bbe09ac089 WatchSource:0}: Error finding container 4268fffb916567fcf4f3f4d1a1b14d40521d6f5d91a4204b95b2a9bbe09ac089: Status 404 returned error can't find the container with id 4268fffb916567fcf4f3f4d1a1b14d40521d6f5d91a4204b95b2a9bbe09ac089
Jul 06 23:51:43.477318 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:43.477276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cl6jj" event={"ID":"12fccffb-03a0-470d-8fad-f5c946e9d765","Type":"ContainerStarted","Data":"4268fffb916567fcf4f3f4d1a1b14d40521d6f5d91a4204b95b2a9bbe09ac089"}
Jul 06 23:51:43.478600 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:43.478575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74c7cd457b-4zxz7" event={"ID":"3db69ad6-545f-48b6-9e36-a35346187c19","Type":"ContainerStarted","Data":"1a18735a2fa0eaff9bcf0e66093cd2f0144891cb9cfa68ad07bd567383d37c50"}
Jul 06 23:51:43.479890 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:43.479858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x846l" event={"ID":"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8","Type":"ContainerStarted","Data":"647ec895199f4bf4d81dfcaf0493a930e0a61978034d68e9bde86c7af1e4107b"}
Jul 06 23:51:45.490507 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.490471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cl6jj" event={"ID":"12fccffb-03a0-470d-8fad-f5c946e9d765","Type":"ContainerStarted","Data":"7dcddcac4b3ffddae36eff017b16f040b36f35bebfcf5a2c8fb2cefedf0986a2"}
Jul 06 23:51:45.490991 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.490549    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:45.492126 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.492103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74c7cd457b-4zxz7" event={"ID":"3db69ad6-545f-48b6-9e36-a35346187c19","Type":"ContainerStarted","Data":"036e2f870dfaa88b7a30d355cf157acb983b3f0fc0a00ca6bbf5799ef655c637"}
Jul 06 23:51:45.492269 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.492146    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:45.493576 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.493557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-x846l" event={"ID":"878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8","Type":"ContainerStarted","Data":"e1b32eb1dc8bc2eb159eb538f1b388da27af647b4f1459cc1d55826372aa00f5"}
Jul 06 23:51:45.493689 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.493669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:51:45.523626 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.523572    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-cl6jj" podStartSLOduration=1.941836152 podStartE2EDuration="3.523552342s" totalImagesPullingTime="1.58171619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:45.523403653 +0000 UTC m=+567.086478286" watchObservedRunningTime="2026-07-06 23:51:45.523552342 +0000 UTC m=+567.086626975"
Jul 06 23:51:45.557826 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.557769    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-74c7cd457b-4zxz7" podStartSLOduration=2.689260012 podStartE2EDuration="4.557752284s" totalImagesPullingTime="1.868492272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:45.55600862 +0000 UTC m=+567.119083251" watchObservedRunningTime="2026-07-06 23:51:45.557752284 +0000 UTC m=+567.120826915"
Jul 06 23:51:45.605523 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:45.605465    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-x846l" podStartSLOduration=1.960050527 podStartE2EDuration="3.60544865s" totalImagesPullingTime="1.645398123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:51:45.603936163 +0000 UTC m=+567.167010799" watchObservedRunningTime="2026-07-06 23:51:45.60544865 +0000 UTC m=+567.168523282"
Jul 06 23:51:51.504471 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:51.504442    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-74c7cd457b-4zxz7"
Jul 06 23:51:56.500543 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:56.500505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-cl6jj"
Jul 06 23:51:56.500979 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:51:56.500732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-x846l"
Jul 06 23:52:00.862619 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.862584    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"]
Jul 06 23:52:00.867397 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.867374    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:00.870484 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.870464    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 23:52:00.870729 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.870712    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 23:52:00.871984 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.871969    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4n7l9\""
Jul 06 23:52:00.872094 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.872022    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 23:52:00.876260 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.876240    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"]
Jul 06 23:52:00.982219 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.982179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:00.982409 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.982234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:00.982409 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.982319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n57g4\" (UniqueName: \"kubernetes.io/projected/02491d49-b5da-425e-a905-cc519b31e0ec-kube-api-access-n57g4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:00.982409 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.982375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:00.982578 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.982425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:00.982578 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:00.982450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02491d49-b5da-425e-a905-cc519b31e0ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.083535 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.083503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.083723 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.083544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n57g4\" (UniqueName: \"kubernetes.io/projected/02491d49-b5da-425e-a905-cc519b31e0ec-kube-api-access-n57g4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.083723 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.083681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.083843 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.083756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.083843 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.083782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02491d49-b5da-425e-a905-cc519b31e0ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.083952 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.083888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.084162 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.084137    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.084284 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.084148    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.084284 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.084241    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.086024 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.085998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02491d49-b5da-425e-a905-cc519b31e0ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.086609 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.086585    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02491d49-b5da-425e-a905-cc519b31e0ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.092271 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.092252    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n57g4\" (UniqueName: \"kubernetes.io/projected/02491d49-b5da-425e-a905-cc519b31e0ec-kube-api-access-n57g4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf\" (UID: \"02491d49-b5da-425e-a905-cc519b31e0ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.178208 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.178179    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:01.327252 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.327226    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"]
Jul 06 23:52:01.328991 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:52:01.328960    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02491d49_b5da_425e_a905_cc519b31e0ec.slice/crio-12048b12a981a953be78830527c28e911a6ba6345c1df3a60c4beffb16601b04 WatchSource:0}: Error finding container 12048b12a981a953be78830527c28e911a6ba6345c1df3a60c4beffb16601b04: Status 404 returned error can't find the container with id 12048b12a981a953be78830527c28e911a6ba6345c1df3a60c4beffb16601b04
Jul 06 23:52:01.568672 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:01.568554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf" event={"ID":"02491d49-b5da-425e-a905-cc519b31e0ec","Type":"ContainerStarted","Data":"12048b12a981a953be78830527c28e911a6ba6345c1df3a60c4beffb16601b04"}
Jul 06 23:52:03.579436 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:03.579398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf" event={"ID":"02491d49-b5da-425e-a905-cc519b31e0ec","Type":"ContainerStarted","Data":"e0548881816b90b81aa75a8b3eae4baa1590a132ba8255b088165947df342619"}
Jul 06 23:52:03.611341 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:03.611291    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf" podStartSLOduration=2.403653267 podStartE2EDuration="3.611276434s" totalImagesPullingTime="1.207623167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:52:03.608383416 +0000 UTC m=+585.171458049" watchObservedRunningTime="2026-07-06 23:52:03.611276434 +0000 UTC m=+585.174351066"
Jul 06 23:52:11.178692 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:11.178637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:11.179139 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:11.178711    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:11.194878 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:11.194851    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:11.628913 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:11.628831    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf"
Jul 06 23:52:18.896960 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:18.896929    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:52:18.897861 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:18.897843    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:52:32.733788 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.733749    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"]
Jul 06 23:52:32.744298 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.744263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.747335 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.747310    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 23:52:32.760324 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.760303    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"]
Jul 06 23:52:32.768120 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.768095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4a9751-a97a-4121-b46d-92757bf13029-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.768223 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.768143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f55p8\" (UniqueName: \"kubernetes.io/projected/9b4a9751-a97a-4121-b46d-92757bf13029-kube-api-access-f55p8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.768223 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.768165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.768308 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.768251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.768308 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.768271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.768308 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.768295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869135 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4a9751-a97a-4121-b46d-92757bf13029-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869316 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f55p8\" (UniqueName: \"kubernetes.io/projected/9b4a9751-a97a-4121-b46d-92757bf13029-kube-api-access-f55p8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869316 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869316 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869316 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869516 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869697 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869670    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869785 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869691    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.869785 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.869750    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.871607 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.871584    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b4a9751-a97a-4121-b46d-92757bf13029-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.871843 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.871826    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4a9751-a97a-4121-b46d-92757bf13029-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:32.884515 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:32.884493    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f55p8\" (UniqueName: \"kubernetes.io/projected/9b4a9751-a97a-4121-b46d-92757bf13029-kube-api-access-f55p8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5k4bl\" (UID: \"9b4a9751-a97a-4121-b46d-92757bf13029\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:33.054747 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:33.054660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:33.222326 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:33.222298    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"]
Jul 06 23:52:33.223868 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:52:33.223842    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4a9751_a97a_4121_b46d_92757bf13029.slice/crio-5a800ac474371be319d45fc4a70639c450d09ebc85df04c47b41dcca19d866af WatchSource:0}: Error finding container 5a800ac474371be319d45fc4a70639c450d09ebc85df04c47b41dcca19d866af: Status 404 returned error can't find the container with id 5a800ac474371be319d45fc4a70639c450d09ebc85df04c47b41dcca19d866af
Jul 06 23:52:33.724331 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:33.724298    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl" event={"ID":"9b4a9751-a97a-4121-b46d-92757bf13029","Type":"ContainerStarted","Data":"392ae2a405f9aebf9c76a7a11ce2f176340f4db71f344a28398adebeecfefb5d"}
Jul 06 23:52:33.724523 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:33.724348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl" event={"ID":"9b4a9751-a97a-4121-b46d-92757bf13029","Type":"ContainerStarted","Data":"5a800ac474371be319d45fc4a70639c450d09ebc85df04c47b41dcca19d866af"}
Jul 06 23:52:33.767566 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:33.767511    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl" podStartSLOduration=1.593923224 podStartE2EDuration="1.767494124s" totalImagesPullingTime="173.5709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:52:33.766003071 +0000 UTC m=+615.329077704" watchObservedRunningTime="2026-07-06 23:52:33.767494124 +0000 UTC m=+615.330568756"
Jul 06 23:52:43.055818 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:43.055730    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:43.055818 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:43.055797    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:43.068342 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:43.068312    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:52:43.786106 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:52:43.786067    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5k4bl"
Jul 06 23:54:02.730515 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:02.730475    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-764d67fcf9-8zhsn"]
Jul 06 23:54:02.731177 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:02.730685    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-764d67fcf9-8zhsn" podUID="e39e9324-83de-4f35-bfbd-00cdf3514e0b" containerName="authorino" containerID="cri-o://cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9" gracePeriod=30
Jul 06 23:54:02.983320 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:02.983258    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:54:03.145536 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.145498    2581 generic.go:356] "Generic (PLEG): container finished" podID="e39e9324-83de-4f35-bfbd-00cdf3514e0b" containerID="cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9" exitCode=0
Jul 06 23:54:03.145708 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.145549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-764d67fcf9-8zhsn" event={"ID":"e39e9324-83de-4f35-bfbd-00cdf3514e0b","Type":"ContainerDied","Data":"cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9"}
Jul 06 23:54:03.145708 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.145574    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-764d67fcf9-8zhsn"
Jul 06 23:54:03.145708 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.145589    2581 scope.go:117] "RemoveContainer" containerID="cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9"
Jul 06 23:54:03.145708 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.145579    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-764d67fcf9-8zhsn" event={"ID":"e39e9324-83de-4f35-bfbd-00cdf3514e0b","Type":"ContainerDied","Data":"bdb64764dd76e2005eb2694cba5d2a4a7b86aa49341751c5662973001bc12cfe"}
Jul 06 23:54:03.154136 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.154116    2581 scope.go:117] "RemoveContainer" containerID="cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9"
Jul 06 23:54:03.154396 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:54:03.154376    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9\": container with ID starting with cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9 not found: ID does not exist" containerID="cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9"
Jul 06 23:54:03.154443 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.154404    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9"} err="failed to get container status \"cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9\": rpc error: code = NotFound desc = could not find container \"cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9\": container with ID starting with cbfd182d022f627afa231ca3f65086344e0d135b55d8260ad4d5db9328ae3bc9 not found: ID does not exist"
Jul 06 23:54:03.160702 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.160683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e39e9324-83de-4f35-bfbd-00cdf3514e0b-tls-cert\") pod \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") "
Jul 06 23:54:03.160761 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.160744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkqn5\" (UniqueName: \"kubernetes.io/projected/e39e9324-83de-4f35-bfbd-00cdf3514e0b-kube-api-access-dkqn5\") pod \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\" (UID: \"e39e9324-83de-4f35-bfbd-00cdf3514e0b\") "
Jul 06 23:54:03.162782 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.162757    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39e9324-83de-4f35-bfbd-00cdf3514e0b-kube-api-access-dkqn5" (OuterVolumeSpecName: "kube-api-access-dkqn5") pod "e39e9324-83de-4f35-bfbd-00cdf3514e0b" (UID: "e39e9324-83de-4f35-bfbd-00cdf3514e0b"). InnerVolumeSpecName "kube-api-access-dkqn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:54:03.171485 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.171462    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e39e9324-83de-4f35-bfbd-00cdf3514e0b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e39e9324-83de-4f35-bfbd-00cdf3514e0b" (UID: "e39e9324-83de-4f35-bfbd-00cdf3514e0b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:54:03.262294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.262210    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e39e9324-83de-4f35-bfbd-00cdf3514e0b-tls-cert\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:54:03.262294 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.262237    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkqn5\" (UniqueName: \"kubernetes.io/projected/e39e9324-83de-4f35-bfbd-00cdf3514e0b-kube-api-access-dkqn5\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:54:03.470904 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.470063    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-764d67fcf9-8zhsn"]
Jul 06 23:54:03.473974 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:03.473944    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-764d67fcf9-8zhsn"]
Jul 06 23:54:04.943037 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:54:04.942998    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39e9324-83de-4f35-bfbd-00cdf3514e0b" path="/var/lib/kubelet/pods/e39e9324-83de-4f35-bfbd-00cdf3514e0b/volumes"
Jul 06 23:55:13.757634 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:13.757601    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694cd7b67-tmc9x"]
Jul 06 23:55:13.758059 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:13.757788    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-694cd7b67-tmc9x" podUID="8cef7815-9236-4463-8e7a-0ea019bfcfc7" containerName="manager" containerID="cri-o://c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c" gracePeriod=30
Jul 06 23:55:14.012637 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.012583    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:55:14.055108 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.055051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cef7815-9236-4463-8e7a-0ea019bfcfc7-webhook-cert\") pod \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") "
Jul 06 23:55:14.055108 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.055109    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xksh\" (UniqueName: \"kubernetes.io/projected/8cef7815-9236-4463-8e7a-0ea019bfcfc7-kube-api-access-7xksh\") pod \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\" (UID: \"8cef7815-9236-4463-8e7a-0ea019bfcfc7\") "
Jul 06 23:55:14.057206 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.057177    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cef7815-9236-4463-8e7a-0ea019bfcfc7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8cef7815-9236-4463-8e7a-0ea019bfcfc7" (UID: "8cef7815-9236-4463-8e7a-0ea019bfcfc7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:55:14.057382 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.057365    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cef7815-9236-4463-8e7a-0ea019bfcfc7-kube-api-access-7xksh" (OuterVolumeSpecName: "kube-api-access-7xksh") pod "8cef7815-9236-4463-8e7a-0ea019bfcfc7" (UID: "8cef7815-9236-4463-8e7a-0ea019bfcfc7"). InnerVolumeSpecName "kube-api-access-7xksh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:55:14.156321 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.156289    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cef7815-9236-4463-8e7a-0ea019bfcfc7-webhook-cert\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:55:14.156321 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.156316    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xksh\" (UniqueName: \"kubernetes.io/projected/8cef7815-9236-4463-8e7a-0ea019bfcfc7-kube-api-access-7xksh\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 06 23:55:14.472976 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.472942    2581 generic.go:356] "Generic (PLEG): container finished" podID="8cef7815-9236-4463-8e7a-0ea019bfcfc7" containerID="c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c" exitCode=0
Jul 06 23:55:14.473171 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.472990    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694cd7b67-tmc9x"
Jul 06 23:55:14.473171 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.472995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694cd7b67-tmc9x" event={"ID":"8cef7815-9236-4463-8e7a-0ea019bfcfc7","Type":"ContainerDied","Data":"c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c"}
Jul 06 23:55:14.473171 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.473036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694cd7b67-tmc9x" event={"ID":"8cef7815-9236-4463-8e7a-0ea019bfcfc7","Type":"ContainerDied","Data":"8c1e5d12264af0e382d8ee21bda3288a8641262ecf0e851d306641707a3eaf0f"}
Jul 06 23:55:14.473171 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.473058    2581 scope.go:117] "RemoveContainer" containerID="c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c"
Jul 06 23:55:14.482288 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.482269    2581 scope.go:117] "RemoveContainer" containerID="c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c"
Jul 06 23:55:14.482535 ip-10-0-141-135 kubenswrapper[2581]: E0706 23:55:14.482515    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c\": container with ID starting with c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c not found: ID does not exist" containerID="c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c"
Jul 06 23:55:14.482586 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.482543    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c"} err="failed to get container status \"c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c\": rpc error: code = NotFound desc = could not find container \"c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c\": container with ID starting with c0464515bd5b782561b1425dcba3ff5ec51baf0d79ef57f9584efe898f40ac1c not found: ID does not exist"
Jul 06 23:55:14.494192 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.494172    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-694cd7b67-tmc9x"]
Jul 06 23:55:14.498100 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.498058    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-694cd7b67-tmc9x"]
Jul 06 23:55:14.942233 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:14.942201    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cef7815-9236-4463-8e7a-0ea019bfcfc7" path="/var/lib/kubelet/pods/8cef7815-9236-4463-8e7a-0ea019bfcfc7/volumes"
Jul 06 23:55:15.273324 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.273246    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-694cd7b67-xphvj"]
Jul 06 23:55:15.273619 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.273607    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cef7815-9236-4463-8e7a-0ea019bfcfc7" containerName="manager"
Jul 06 23:55:15.273664 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.273621    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cef7815-9236-4463-8e7a-0ea019bfcfc7" containerName="manager"
Jul 06 23:55:15.273664 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.273639    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39e9324-83de-4f35-bfbd-00cdf3514e0b" containerName="authorino"
Jul 06 23:55:15.273664 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.273644    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39e9324-83de-4f35-bfbd-00cdf3514e0b" containerName="authorino"
Jul 06 23:55:15.273750 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.273706    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39e9324-83de-4f35-bfbd-00cdf3514e0b" containerName="authorino"
Jul 06 23:55:15.273750 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.273714    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cef7815-9236-4463-8e7a-0ea019bfcfc7" containerName="manager"
Jul 06 23:55:15.278023 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.278008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.280899 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.280877    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 23:55:15.282272 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.282258    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 23:55:15.282272 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.282264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k5nzc\""
Jul 06 23:55:15.287649 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.287622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694cd7b67-xphvj"]
Jul 06 23:55:15.366245 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.366208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3-webhook-cert\") pod \"maas-controller-694cd7b67-xphvj\" (UID: \"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3\") " pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.366406 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.366318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdt5f\" (UniqueName: \"kubernetes.io/projected/80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3-kube-api-access-sdt5f\") pod \"maas-controller-694cd7b67-xphvj\" (UID: \"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3\") " pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.467172 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.467136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdt5f\" (UniqueName: \"kubernetes.io/projected/80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3-kube-api-access-sdt5f\") pod \"maas-controller-694cd7b67-xphvj\" (UID: \"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3\") " pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.467325 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.467187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3-webhook-cert\") pod \"maas-controller-694cd7b67-xphvj\" (UID: \"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3\") " pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.469905 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.469882    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3-webhook-cert\") pod \"maas-controller-694cd7b67-xphvj\" (UID: \"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3\") " pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.479185 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.479158    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdt5f\" (UniqueName: \"kubernetes.io/projected/80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3-kube-api-access-sdt5f\") pod \"maas-controller-694cd7b67-xphvj\" (UID: \"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3\") " pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.588998 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.588920    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:15.727505 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.727477    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-694cd7b67-xphvj"]
Jul 06 23:55:15.729933 ip-10-0-141-135 kubenswrapper[2581]: W0706 23:55:15.729908    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f826d1_bfa6_4d5c_a82f_17a8d9cef6f3.slice/crio-0fb11c49d849d79034eba7b609e9a76249de2f1b0f38dc28bb4b024d9003af18 WatchSource:0}: Error finding container 0fb11c49d849d79034eba7b609e9a76249de2f1b0f38dc28bb4b024d9003af18: Status 404 returned error can't find the container with id 0fb11c49d849d79034eba7b609e9a76249de2f1b0f38dc28bb4b024d9003af18
Jul 06 23:55:15.731360 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:15.731341    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:55:16.485946 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:16.485905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694cd7b67-xphvj" event={"ID":"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3","Type":"ContainerStarted","Data":"21dff1e1fdc9c721f2185b11525b29db842db244cfa9e9875d375bbe341bfe9d"}
Jul 06 23:55:16.486440 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:16.485977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-694cd7b67-xphvj" event={"ID":"80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3","Type":"ContainerStarted","Data":"0fb11c49d849d79034eba7b609e9a76249de2f1b0f38dc28bb4b024d9003af18"}
Jul 06 23:55:16.486440 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:16.486010    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:55:16.508981 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:16.508924    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-694cd7b67-xphvj" podStartSLOduration=0.847879335 podStartE2EDuration="1.508910485s" totalImagesPullingTime="661.03115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:16.506967618 +0000 UTC m=+778.070042248" watchObservedRunningTime="2026-07-06 23:55:16.508910485 +0000 UTC m=+778.071985115"
Jul 06 23:55:27.495756 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:55:27.495724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-694cd7b67-xphvj"
Jul 06 23:57:18.925107 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:57:18.925016    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 06 23:57:18.926444 ip-10-0-141-135 kubenswrapper[2581]: I0706 23:57:18.926422    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:02:18.961106 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:02:18.961055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:02:18.961850 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:02:18.961830    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:07:11.430965 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.430934    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"]
Jul 07 00:07:11.434140 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.434116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.437115 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.437093    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-e12b8e24-serving-cert\""
Jul 07 00:07:11.437279 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.437260    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:07:11.448416 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.448368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"]
Jul 07 00:07:11.589160 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.589125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89a46d1a-1f47-470c-82dc-a225e2a7b040-maas-api-tls\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.589334 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.589186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22fc5\" (UniqueName: \"kubernetes.io/projected/89a46d1a-1f47-470c-82dc-a225e2a7b040-kube-api-access-22fc5\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.589334 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.589257    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a46d1a-1f47-470c-82dc-a225e2a7b040-openshift-service-ca\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.690189 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.690104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89a46d1a-1f47-470c-82dc-a225e2a7b040-maas-api-tls\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.690189 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.690156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22fc5\" (UniqueName: \"kubernetes.io/projected/89a46d1a-1f47-470c-82dc-a225e2a7b040-kube-api-access-22fc5\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.690189 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.690185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a46d1a-1f47-470c-82dc-a225e2a7b040-openshift-service-ca\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.690880 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.690860    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a46d1a-1f47-470c-82dc-a225e2a7b040-openshift-service-ca\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.692723 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.692699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89a46d1a-1f47-470c-82dc-a225e2a7b040-maas-api-tls\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.699790 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.699761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22fc5\" (UniqueName: \"kubernetes.io/projected/89a46d1a-1f47-470c-82dc-a225e2a7b040-kube-api-access-22fc5\") pod \"maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") " pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.748444 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.748414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:11.890905 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.890881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"]
Jul 07 00:07:11.892983 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:07:11.892957    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a46d1a_1f47_470c_82dc_a225e2a7b040.slice/crio-9a6b760ef827f201224f237a1dd7c8febd590a004cdb2d1c9f27cba20d44a739 WatchSource:0}: Error finding container 9a6b760ef827f201224f237a1dd7c8febd590a004cdb2d1c9f27cba20d44a739: Status 404 returned error can't find the container with id 9a6b760ef827f201224f237a1dd7c8febd590a004cdb2d1c9f27cba20d44a739
Jul 07 00:07:11.894707 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:11.894568    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:07:12.737192 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:12.737107    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67" event={"ID":"89a46d1a-1f47-470c-82dc-a225e2a7b040","Type":"ContainerStarted","Data":"98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d"}
Jul 07 00:07:12.737545 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:12.737193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67" event={"ID":"89a46d1a-1f47-470c-82dc-a225e2a7b040","Type":"ContainerStarted","Data":"9a6b760ef827f201224f237a1dd7c8febd590a004cdb2d1c9f27cba20d44a739"}
Jul 07 00:07:12.737545 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:12.737254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:12.758128 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:12.758017    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67" podStartSLOduration=1.203827562 podStartE2EDuration="1.758000463s" totalImagesPullingTime="554.172901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:12.75560805 +0000 UTC m=+1494.318682693" watchObservedRunningTime="2026-07-07 00:07:12.758000463 +0000 UTC m=+1494.321075094"
Jul 07 00:07:16.793034 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:16.792991    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"]
Jul 07 00:07:16.793919 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:16.793270    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67" podUID="89a46d1a-1f47-470c-82dc-a225e2a7b040" containerName="maas-api" containerID="cri-o://98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d" gracePeriod=30
Jul 07 00:07:17.049573 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.049498    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:17.141703 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.141670    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22fc5\" (UniqueName: \"kubernetes.io/projected/89a46d1a-1f47-470c-82dc-a225e2a7b040-kube-api-access-22fc5\") pod \"89a46d1a-1f47-470c-82dc-a225e2a7b040\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") "
Jul 07 00:07:17.141904 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.141719    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a46d1a-1f47-470c-82dc-a225e2a7b040-openshift-service-ca\") pod \"89a46d1a-1f47-470c-82dc-a225e2a7b040\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") "
Jul 07 00:07:17.141904 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.141783    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89a46d1a-1f47-470c-82dc-a225e2a7b040-maas-api-tls\") pod \"89a46d1a-1f47-470c-82dc-a225e2a7b040\" (UID: \"89a46d1a-1f47-470c-82dc-a225e2a7b040\") "
Jul 07 00:07:17.142258 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.142229    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a46d1a-1f47-470c-82dc-a225e2a7b040-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89a46d1a-1f47-470c-82dc-a225e2a7b040" (UID: "89a46d1a-1f47-470c-82dc-a225e2a7b040"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:07:17.144127 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.144092    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a46d1a-1f47-470c-82dc-a225e2a7b040-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89a46d1a-1f47-470c-82dc-a225e2a7b040" (UID: "89a46d1a-1f47-470c-82dc-a225e2a7b040"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:07:17.144127 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.144097    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a46d1a-1f47-470c-82dc-a225e2a7b040-kube-api-access-22fc5" (OuterVolumeSpecName: "kube-api-access-22fc5") pod "89a46d1a-1f47-470c-82dc-a225e2a7b040" (UID: "89a46d1a-1f47-470c-82dc-a225e2a7b040"). InnerVolumeSpecName "kube-api-access-22fc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:07:17.243233 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.243195    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89a46d1a-1f47-470c-82dc-a225e2a7b040-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:17.243233 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.243229    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89a46d1a-1f47-470c-82dc-a225e2a7b040-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:17.243233 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.243239    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22fc5\" (UniqueName: \"kubernetes.io/projected/89a46d1a-1f47-470c-82dc-a225e2a7b040-kube-api-access-22fc5\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:17.763481 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.763446    2581 generic.go:356] "Generic (PLEG): container finished" podID="89a46d1a-1f47-470c-82dc-a225e2a7b040" containerID="98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d" exitCode=0
Jul 07 00:07:17.763481 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.763484    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"
Jul 07 00:07:17.763693 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.763517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67" event={"ID":"89a46d1a-1f47-470c-82dc-a225e2a7b040","Type":"ContainerDied","Data":"98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d"}
Jul 07 00:07:17.763693 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.763562    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67" event={"ID":"89a46d1a-1f47-470c-82dc-a225e2a7b040","Type":"ContainerDied","Data":"9a6b760ef827f201224f237a1dd7c8febd590a004cdb2d1c9f27cba20d44a739"}
Jul 07 00:07:17.763693 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.763587    2581 scope.go:117] "RemoveContainer" containerID="98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d"
Jul 07 00:07:17.772983 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.772963    2581 scope.go:117] "RemoveContainer" containerID="98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d"
Jul 07 00:07:17.773264 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:07:17.773245    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d\": container with ID starting with 98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d not found: ID does not exist" containerID="98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d"
Jul 07 00:07:17.773340 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.773278    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d"} err="failed to get container status \"98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d\": rpc error: code = NotFound desc = could not find container \"98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d\": container with ID starting with 98a5ff7f45427708aa325b19a0820a1cd31dd3d17fa28daf34c53eda653feb2d not found: ID does not exist"
Jul 07 00:07:17.785284 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.785249    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"]
Jul 07 00:07:17.789490 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:17.789462    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-e12b8e24-7d45f89c8d-7qp67"]
Jul 07 00:07:18.944042 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:18.944008    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89a46d1a-1f47-470c-82dc-a225e2a7b040" path="/var/lib/kubelet/pods/89a46d1a-1f47-470c-82dc-a225e2a7b040/volumes"
Jul 07 00:07:18.989407 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:18.989375    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:07:18.991220 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:18.991194    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:07:24.282141 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.282095    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"]
Jul 07 00:07:24.282708 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.282674    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a46d1a-1f47-470c-82dc-a225e2a7b040" containerName="maas-api"
Jul 07 00:07:24.282708 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.282695    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a46d1a-1f47-470c-82dc-a225e2a7b040" containerName="maas-api"
Jul 07 00:07:24.282827 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.282809    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="89a46d1a-1f47-470c-82dc-a225e2a7b040" containerName="maas-api"
Jul 07 00:07:24.287527 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.287496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.290732 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.290710    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:07:24.290870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.290773    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-f7ceb5ec-serving-cert\""
Jul 07 00:07:24.300665 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.300637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"]
Jul 07 00:07:24.305508 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.305473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d96526a9-0dd3-4eb0-9649-8ee10bec4350-openshift-service-ca\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.305668 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.305579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdmbb\" (UniqueName: \"kubernetes.io/projected/d96526a9-0dd3-4eb0-9649-8ee10bec4350-kube-api-access-rdmbb\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.305668 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.305608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d96526a9-0dd3-4eb0-9649-8ee10bec4350-maas-api-tls\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.406884 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.406844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d96526a9-0dd3-4eb0-9649-8ee10bec4350-maas-api-tls\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.407066 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.406948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d96526a9-0dd3-4eb0-9649-8ee10bec4350-openshift-service-ca\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.407066 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.407013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdmbb\" (UniqueName: \"kubernetes.io/projected/d96526a9-0dd3-4eb0-9649-8ee10bec4350-kube-api-access-rdmbb\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.407764 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.407694    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d96526a9-0dd3-4eb0-9649-8ee10bec4350-openshift-service-ca\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.409563 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.409539    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d96526a9-0dd3-4eb0-9649-8ee10bec4350-maas-api-tls\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.416412 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.416392    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdmbb\" (UniqueName: \"kubernetes.io/projected/d96526a9-0dd3-4eb0-9649-8ee10bec4350-kube-api-access-rdmbb\") pod \"maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") " pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.599488 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.599401    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:24.747792 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.747745    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"]
Jul 07 00:07:24.749864 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:07:24.749836    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96526a9_0dd3_4eb0_9649_8ee10bec4350.slice/crio-c4e8949f421877b7c3ba186039177363e6909c2bcc4a851ff87df09cc3043eb9 WatchSource:0}: Error finding container c4e8949f421877b7c3ba186039177363e6909c2bcc4a851ff87df09cc3043eb9: Status 404 returned error can't find the container with id c4e8949f421877b7c3ba186039177363e6909c2bcc4a851ff87df09cc3043eb9
Jul 07 00:07:24.800216 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:24.800178    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn" event={"ID":"d96526a9-0dd3-4eb0-9649-8ee10bec4350","Type":"ContainerStarted","Data":"c4e8949f421877b7c3ba186039177363e6909c2bcc4a851ff87df09cc3043eb9"}
Jul 07 00:07:25.806807 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:25.806778    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn" event={"ID":"d96526a9-0dd3-4eb0-9649-8ee10bec4350","Type":"ContainerStarted","Data":"bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62"}
Jul 07 00:07:25.807245 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:25.806893    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:25.825710 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:25.825660    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn" podStartSLOduration=1.298943028 podStartE2EDuration="1.825644584s" totalImagesPullingTime="526.701556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:25.825052254 +0000 UTC m=+1507.388126887" watchObservedRunningTime="2026-07-07 00:07:25.825644584 +0000 UTC m=+1507.388719216"
Jul 07 00:07:29.741723 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:29.741684    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"]
Jul 07 00:07:29.742260 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:29.741903    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn" podUID="d96526a9-0dd3-4eb0-9649-8ee10bec4350" containerName="maas-api" containerID="cri-o://bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62" gracePeriod=30
Jul 07 00:07:29.994499 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:29.994435    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:30.056347 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.056315    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d96526a9-0dd3-4eb0-9649-8ee10bec4350-openshift-service-ca\") pod \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") "
Jul 07 00:07:30.056556 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.056358    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdmbb\" (UniqueName: \"kubernetes.io/projected/d96526a9-0dd3-4eb0-9649-8ee10bec4350-kube-api-access-rdmbb\") pod \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") "
Jul 07 00:07:30.056556 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.056382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d96526a9-0dd3-4eb0-9649-8ee10bec4350-maas-api-tls\") pod \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\" (UID: \"d96526a9-0dd3-4eb0-9649-8ee10bec4350\") "
Jul 07 00:07:30.056727 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.056698    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d96526a9-0dd3-4eb0-9649-8ee10bec4350-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d96526a9-0dd3-4eb0-9649-8ee10bec4350" (UID: "d96526a9-0dd3-4eb0-9649-8ee10bec4350"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:07:30.058563 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.058539    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d96526a9-0dd3-4eb0-9649-8ee10bec4350-kube-api-access-rdmbb" (OuterVolumeSpecName: "kube-api-access-rdmbb") pod "d96526a9-0dd3-4eb0-9649-8ee10bec4350" (UID: "d96526a9-0dd3-4eb0-9649-8ee10bec4350"). InnerVolumeSpecName "kube-api-access-rdmbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:07:30.058655 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.058576    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d96526a9-0dd3-4eb0-9649-8ee10bec4350-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d96526a9-0dd3-4eb0-9649-8ee10bec4350" (UID: "d96526a9-0dd3-4eb0-9649-8ee10bec4350"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:07:30.157890 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.157855    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d96526a9-0dd3-4eb0-9649-8ee10bec4350-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:30.157890 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.157885    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdmbb\" (UniqueName: \"kubernetes.io/projected/d96526a9-0dd3-4eb0-9649-8ee10bec4350-kube-api-access-rdmbb\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:30.157890 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.157895    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d96526a9-0dd3-4eb0-9649-8ee10bec4350-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:30.832432 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.832393    2581 generic.go:356] "Generic (PLEG): container finished" podID="d96526a9-0dd3-4eb0-9649-8ee10bec4350" containerID="bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62" exitCode=0
Jul 07 00:07:30.832900 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.832444    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"
Jul 07 00:07:30.832900 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.832482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn" event={"ID":"d96526a9-0dd3-4eb0-9649-8ee10bec4350","Type":"ContainerDied","Data":"bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62"}
Jul 07 00:07:30.832900 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.832537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn" event={"ID":"d96526a9-0dd3-4eb0-9649-8ee10bec4350","Type":"ContainerDied","Data":"c4e8949f421877b7c3ba186039177363e6909c2bcc4a851ff87df09cc3043eb9"}
Jul 07 00:07:30.832900 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.832559    2581 scope.go:117] "RemoveContainer" containerID="bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62"
Jul 07 00:07:30.841885 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.841864    2581 scope.go:117] "RemoveContainer" containerID="bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62"
Jul 07 00:07:30.842202 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:07:30.842178    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62\": container with ID starting with bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62 not found: ID does not exist" containerID="bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62"
Jul 07 00:07:30.842262 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.842213    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62"} err="failed to get container status \"bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62\": rpc error: code = NotFound desc = could not find container \"bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62\": container with ID starting with bf887b735c393c39afb069925eeb46b08e23f56684394e0e51068064fe50cc62 not found: ID does not exist"
Jul 07 00:07:30.853689 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.853665    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"]
Jul 07 00:07:30.858937 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.858916    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-f7ceb5ec-598fb6fc5-jzjvn"]
Jul 07 00:07:30.942833 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:30.942803    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d96526a9-0dd3-4eb0-9649-8ee10bec4350" path="/var/lib/kubelet/pods/d96526a9-0dd3-4eb0-9649-8ee10bec4350/volumes"
Jul 07 00:07:43.055400 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.055359    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"]
Jul 07 00:07:43.055861 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.055843    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d96526a9-0dd3-4eb0-9649-8ee10bec4350" containerName="maas-api"
Jul 07 00:07:43.055907 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.055864    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d96526a9-0dd3-4eb0-9649-8ee10bec4350" containerName="maas-api"
Jul 07 00:07:43.055948 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.055939    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d96526a9-0dd3-4eb0-9649-8ee10bec4350" containerName="maas-api"
Jul 07 00:07:43.060578 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.060559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.063339 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.063310    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-f3b263a4-serving-cert\""
Jul 07 00:07:43.063339 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.063334    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:07:43.068747 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.068724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"]
Jul 07 00:07:43.171835 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.171802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z556\" (UniqueName: \"kubernetes.io/projected/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-kube-api-access-2z556\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.172033 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.171863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-openshift-service-ca\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.172033 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.171928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.272969 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.272932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z556\" (UniqueName: \"kubernetes.io/projected/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-kube-api-access-2z556\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.273157 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.273003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-openshift-service-ca\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.273157 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.273052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.273291 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:07:43.273178    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-f3b263a4-serving-cert: secret "maas-api-e2e-derive-f3b263a4-serving-cert" not found
Jul 07 00:07:43.273291 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:07:43.273253    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls podName:9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31 nodeName:}" failed. No retries permitted until 2026-07-07 00:07:43.773233714 +0000 UTC m=+1525.336308324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls") pod "maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s" (UID: "9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31") : secret "maas-api-e2e-derive-f3b263a4-serving-cert" not found
Jul 07 00:07:43.273650 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.273630    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-openshift-service-ca\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.293586 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.293558    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z556\" (UniqueName: \"kubernetes.io/projected/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-kube-api-access-2z556\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.778895 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.778858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.781522 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.781497    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls\") pod \"maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") " pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:43.971617 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:43.971575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:44.114008 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:44.113956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"]
Jul 07 00:07:44.116370 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:07:44.116340    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2724af_27f8_4d2e_8d4b_ee02e3a5eb31.slice/crio-be23a938e1bfbdfe2f88549821de3917084bd1535d3955653a6ae23a51ff2817 WatchSource:0}: Error finding container be23a938e1bfbdfe2f88549821de3917084bd1535d3955653a6ae23a51ff2817: Status 404 returned error can't find the container with id be23a938e1bfbdfe2f88549821de3917084bd1535d3955653a6ae23a51ff2817
Jul 07 00:07:44.897575 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:44.897543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s" event={"ID":"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31","Type":"ContainerStarted","Data":"2e1c05916be3ff8db3fe581c0bde4370fcd53196c9dfb14db99786d6b628fde0"}
Jul 07 00:07:44.897760 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:44.897592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s" event={"ID":"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31","Type":"ContainerStarted","Data":"be23a938e1bfbdfe2f88549821de3917084bd1535d3955653a6ae23a51ff2817"}
Jul 07 00:07:44.897760 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:44.897662    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:44.917399 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:44.917350    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s" podStartSLOduration=1.6360444269999999 podStartE2EDuration="1.917333914s" totalImagesPullingTime="281.289487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:44.915931358 +0000 UTC m=+1526.479005991" watchObservedRunningTime="2026-07-07 00:07:44.917333914 +0000 UTC m=+1526.480408561"
Jul 07 00:07:47.739886 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:47.739847    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"]
Jul 07 00:07:47.740345 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:47.740038    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s" podUID="9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" containerName="maas-api" containerID="cri-o://2e1c05916be3ff8db3fe581c0bde4370fcd53196c9dfb14db99786d6b628fde0" gracePeriod=30
Jul 07 00:07:47.916633 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:47.915798    2581 generic.go:356] "Generic (PLEG): container finished" podID="9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" containerID="2e1c05916be3ff8db3fe581c0bde4370fcd53196c9dfb14db99786d6b628fde0" exitCode=0
Jul 07 00:07:47.916633 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:47.915939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s" event={"ID":"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31","Type":"ContainerDied","Data":"2e1c05916be3ff8db3fe581c0bde4370fcd53196c9dfb14db99786d6b628fde0"}
Jul 07 00:07:47.991743 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:47.991682    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:48.114161 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.114132    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-openshift-service-ca\") pod \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") "
Jul 07 00:07:48.114344 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.114188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z556\" (UniqueName: \"kubernetes.io/projected/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-kube-api-access-2z556\") pod \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") "
Jul 07 00:07:48.114344 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.114237    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls\") pod \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\" (UID: \"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31\") "
Jul 07 00:07:48.114480 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.114457    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" (UID: "9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:07:48.116317 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.116289    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" (UID: "9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:07:48.116478 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.116460    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-kube-api-access-2z556" (OuterVolumeSpecName: "kube-api-access-2z556") pod "9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" (UID: "9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31"). InnerVolumeSpecName "kube-api-access-2z556". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:07:48.215018 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.214983    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:48.215018 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.215013    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:48.215018 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.215026    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z556\" (UniqueName: \"kubernetes.io/projected/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31-kube-api-access-2z556\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:07:48.921747 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.921716    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"
Jul 07 00:07:48.922247 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.921754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s" event={"ID":"9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31","Type":"ContainerDied","Data":"be23a938e1bfbdfe2f88549821de3917084bd1535d3955653a6ae23a51ff2817"}
Jul 07 00:07:48.922247 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.921815    2581 scope.go:117] "RemoveContainer" containerID="2e1c05916be3ff8db3fe581c0bde4370fcd53196c9dfb14db99786d6b628fde0"
Jul 07 00:07:48.946741 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.946715    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"]
Jul 07 00:07:48.950287 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:48.950259    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-f3b263a4-669d4447c9-kk65s"]
Jul 07 00:07:50.947534 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:07:50.947498    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" path="/var/lib/kubelet/pods/9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31/volumes"
Jul 07 00:09:32.456463 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.456430    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"]
Jul 07 00:09:32.457042 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.456988    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" containerName="maas-api"
Jul 07 00:09:32.457042 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.457007    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" containerName="maas-api"
Jul 07 00:09:32.457193 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.457114    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e2724af-27f8-4d2e-8d4b-ee02e3a5eb31" containerName="maas-api"
Jul 07 00:09:32.460202 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.460187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.462928 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.462905    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-27ba4332-serving-cert\""
Jul 07 00:09:32.462928 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.462919    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:09:32.471253 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.471227    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"]
Jul 07 00:09:32.551893 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.551861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-openshift-service-ca\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.552127 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.551914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.552127 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.551976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrp6\" (UniqueName: \"kubernetes.io/projected/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-kube-api-access-rcrp6\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.653374 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.653338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.653549 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.653465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrp6\" (UniqueName: \"kubernetes.io/projected/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-kube-api-access-rcrp6\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.653549 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:09:32.653504    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-27ba4332-serving-cert: secret "maas-api-e2e-mt-27ba4332-serving-cert" not found
Jul 07 00:09:32.653674 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.653558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-openshift-service-ca\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.653674 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:09:32.653591    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls podName:f8fb1d0f-358d-4f91-8ab8-3715e5f362db nodeName:}" failed. No retries permitted until 2026-07-07 00:09:33.153565144 +0000 UTC m=+1634.716639757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls") pod "maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6" (UID: "f8fb1d0f-358d-4f91-8ab8-3715e5f362db") : secret "maas-api-e2e-mt-27ba4332-serving-cert" not found
Jul 07 00:09:32.654360 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.654339    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-openshift-service-ca\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:32.663460 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:32.663440    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrp6\" (UniqueName: \"kubernetes.io/projected/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-kube-api-access-rcrp6\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:33.158064 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:33.158029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:33.160639 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:33.160621    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls\") pod \"maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") " pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:33.372503 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:33.372468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:33.528161 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:33.528131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"]
Jul 07 00:09:33.530125 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:09:33.530065    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fb1d0f_358d_4f91_8ab8_3715e5f362db.slice/crio-b28cf7254974264cc8928ad9653440e24fbb1d4327e17570f4132a2d5d4a97ea WatchSource:0}: Error finding container b28cf7254974264cc8928ad9653440e24fbb1d4327e17570f4132a2d5d4a97ea: Status 404 returned error can't find the container with id b28cf7254974264cc8928ad9653440e24fbb1d4327e17570f4132a2d5d4a97ea
Jul 07 00:09:34.398030 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:34.397913    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6" event={"ID":"f8fb1d0f-358d-4f91-8ab8-3715e5f362db","Type":"ContainerStarted","Data":"eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887"}
Jul 07 00:09:34.398030 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:34.397988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6" event={"ID":"f8fb1d0f-358d-4f91-8ab8-3715e5f362db","Type":"ContainerStarted","Data":"b28cf7254974264cc8928ad9653440e24fbb1d4327e17570f4132a2d5d4a97ea"}
Jul 07 00:09:34.398030 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:34.398027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:34.414842 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:34.414793    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6" podStartSLOduration=1.899827191 podStartE2EDuration="2.414775501s" totalImagesPullingTime="514.94831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:09:34.414121418 +0000 UTC m=+1635.977196046" watchObservedRunningTime="2026-07-07 00:09:34.414775501 +0000 UTC m=+1635.977850134"
Jul 07 00:09:40.407981 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:40.407950    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:44.577321 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.577284    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"]
Jul 07 00:09:44.577808 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.577602    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6" podUID="f8fb1d0f-358d-4f91-8ab8-3715e5f362db" containerName="maas-api" containerID="cri-o://eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887" gracePeriod=30
Jul 07 00:09:44.826295 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.826270    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:44.862282 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.862208    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-openshift-service-ca\") pod \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") "
Jul 07 00:09:44.862282 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.862256    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls\") pod \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") "
Jul 07 00:09:44.862475 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.862340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcrp6\" (UniqueName: \"kubernetes.io/projected/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-kube-api-access-rcrp6\") pod \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\" (UID: \"f8fb1d0f-358d-4f91-8ab8-3715e5f362db\") "
Jul 07 00:09:44.862636 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.862606    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8fb1d0f-358d-4f91-8ab8-3715e5f362db" (UID: "f8fb1d0f-358d-4f91-8ab8-3715e5f362db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:09:44.864613 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.864585    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-kube-api-access-rcrp6" (OuterVolumeSpecName: "kube-api-access-rcrp6") pod "f8fb1d0f-358d-4f91-8ab8-3715e5f362db" (UID: "f8fb1d0f-358d-4f91-8ab8-3715e5f362db"). InnerVolumeSpecName "kube-api-access-rcrp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:09:44.864703 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.864639    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8fb1d0f-358d-4f91-8ab8-3715e5f362db" (UID: "f8fb1d0f-358d-4f91-8ab8-3715e5f362db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:09:44.963362 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.963336    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:09:44.963362 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.963360    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:09:44.963519 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:44.963369    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcrp6\" (UniqueName: \"kubernetes.io/projected/f8fb1d0f-358d-4f91-8ab8-3715e5f362db-kube-api-access-rcrp6\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:09:45.448160 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.448128    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8fb1d0f-358d-4f91-8ab8-3715e5f362db" containerID="eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887" exitCode=0
Jul 07 00:09:45.448350 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.448174    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"
Jul 07 00:09:45.448350 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.448206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6" event={"ID":"f8fb1d0f-358d-4f91-8ab8-3715e5f362db","Type":"ContainerDied","Data":"eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887"}
Jul 07 00:09:45.448350 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.448246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6" event={"ID":"f8fb1d0f-358d-4f91-8ab8-3715e5f362db","Type":"ContainerDied","Data":"b28cf7254974264cc8928ad9653440e24fbb1d4327e17570f4132a2d5d4a97ea"}
Jul 07 00:09:45.448350 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.448266    2581 scope.go:117] "RemoveContainer" containerID="eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887"
Jul 07 00:09:45.457111 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.457089    2581 scope.go:117] "RemoveContainer" containerID="eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887"
Jul 07 00:09:45.457350 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:09:45.457331    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887\": container with ID starting with eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887 not found: ID does not exist" containerID="eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887"
Jul 07 00:09:45.457396 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.457359    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887"} err="failed to get container status \"eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887\": rpc error: code = NotFound desc = could not find container \"eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887\": container with ID starting with eb38b07c976d7222d453357eef5b739838c1bb43f6625cad02ec27c03a96d887 not found: ID does not exist"
Jul 07 00:09:45.467109 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.467065    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"]
Jul 07 00:09:45.472379 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:45.472356    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-27ba4332-5d7465d8b4-56vv6"]
Jul 07 00:09:46.948226 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:09:46.948188    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8fb1d0f-358d-4f91-8ab8-3715e5f362db" path="/var/lib/kubelet/pods/f8fb1d0f-358d-4f91-8ab8-3715e5f362db/volumes"
Jul 07 00:10:14.489225 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.489184    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"]
Jul 07 00:10:14.489793 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.489754    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8fb1d0f-358d-4f91-8ab8-3715e5f362db" containerName="maas-api"
Jul 07 00:10:14.489793 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.489774    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8fb1d0f-358d-4f91-8ab8-3715e5f362db" containerName="maas-api"
Jul 07 00:10:14.489931 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.489914    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8fb1d0f-358d-4f91-8ab8-3715e5f362db" containerName="maas-api"
Jul 07 00:10:14.493154 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.493133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.496854 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.496835    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-522f0b74-serving-cert\""
Jul 07 00:10:14.496978 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.496865    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:10:14.509233 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.509208    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"]
Jul 07 00:10:14.618955 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.618919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c507-f463-4146-a837-0fa59f6e79a3-openshift-service-ca\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.619152 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.618996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cspbh\" (UniqueName: \"kubernetes.io/projected/cb83c507-f463-4146-a837-0fa59f6e79a3-kube-api-access-cspbh\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.619152 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.619036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.719588 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.719549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cspbh\" (UniqueName: \"kubernetes.io/projected/cb83c507-f463-4146-a837-0fa59f6e79a3-kube-api-access-cspbh\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.719755 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.719598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.719755 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.719649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c507-f463-4146-a837-0fa59f6e79a3-openshift-service-ca\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.719846 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:10:14.719790    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-522f0b74-serving-cert: secret "maas-api-e2e-mt-522f0b74-serving-cert" not found
Jul 07 00:10:14.719890 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:10:14.719878    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls podName:cb83c507-f463-4146-a837-0fa59f6e79a3 nodeName:}" failed. No retries permitted until 2026-07-07 00:10:15.21985592 +0000 UTC m=+1676.782930535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls") pod "maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8" (UID: "cb83c507-f463-4146-a837-0fa59f6e79a3") : secret "maas-api-e2e-mt-522f0b74-serving-cert" not found
Jul 07 00:10:14.720239 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.720223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c507-f463-4146-a837-0fa59f6e79a3-openshift-service-ca\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:14.731138 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:14.731114    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cspbh\" (UniqueName: \"kubernetes.io/projected/cb83c507-f463-4146-a837-0fa59f6e79a3-kube-api-access-cspbh\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:15.223999 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:15.223966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:15.226665 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:15.226643    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls\") pod \"maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") " pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:15.404533 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:15.404497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:15.557026 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:15.556992    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"]
Jul 07 00:10:15.561296 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:10:15.561269    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb83c507_f463_4146_a837_0fa59f6e79a3.slice/crio-a0a584f019e816d9b01fe2ab0bbd6913a22a1f214723472488afc3d8aa804c03 WatchSource:0}: Error finding container a0a584f019e816d9b01fe2ab0bbd6913a22a1f214723472488afc3d8aa804c03: Status 404 returned error can't find the container with id a0a584f019e816d9b01fe2ab0bbd6913a22a1f214723472488afc3d8aa804c03
Jul 07 00:10:15.585600 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:15.585568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8" event={"ID":"cb83c507-f463-4146-a837-0fa59f6e79a3","Type":"ContainerStarted","Data":"a0a584f019e816d9b01fe2ab0bbd6913a22a1f214723472488afc3d8aa804c03"}
Jul 07 00:10:16.591941 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:16.591906    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8" event={"ID":"cb83c507-f463-4146-a837-0fa59f6e79a3","Type":"ContainerStarted","Data":"920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f"}
Jul 07 00:10:16.592381 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:16.591968    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:16.611296 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:16.611248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8" podStartSLOduration=2.193686658 podStartE2EDuration="2.611230914s" totalImagesPullingTime="417.544256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:10:16.609323236 +0000 UTC m=+1678.172397870" watchObservedRunningTime="2026-07-07 00:10:16.611230914 +0000 UTC m=+1678.174305542"
Jul 07 00:10:22.601586 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:22.601552    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:25.855937 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:25.855904    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"]
Jul 07 00:10:25.859425 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:25.859408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:25.863675 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:25.863654    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-522f0b74\"/\"default-dockercfg-dxzxf\""
Jul 07 00:10:25.863675 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:25.863668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-522f0b74\"/\"e2e-lifecycle-model-522f0b74-kserve-self-signed-certs\""
Jul 07 00:10:25.863871 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:25.863710    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-522f0b74\"/\"kube-root-ca.crt\""
Jul 07 00:10:25.864062 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:25.864032    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-522f0b74\"/\"openshift-service-ca.crt\""
Jul 07 00:10:25.872875 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:25.872855    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"]
Jul 07 00:10:26.019474 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.019424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-home\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.019474 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.019479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-model-cache\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.019682 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.019497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tmp-dir\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.019682 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.019548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tls-certs\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.019682 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.019610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-dshm\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.019682 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.019631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g26n9\" (UniqueName: \"kubernetes.io/projected/e6fe1c22-aada-457e-804e-c6c7adbd6dba-kube-api-access-g26n9\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.120870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.120784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-dshm\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.120870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.120836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g26n9\" (UniqueName: \"kubernetes.io/projected/e6fe1c22-aada-457e-804e-c6c7adbd6dba-kube-api-access-g26n9\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.120870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.120866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-home\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.121156 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.120886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-model-cache\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.121156 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.120904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tmp-dir\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.121156 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.120927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tls-certs\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.121335 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.121306    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-home\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.121392 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.121344    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tmp-dir\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.121443 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.121395    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-model-cache\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.123160 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.123141    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-dshm\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.123554 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.123535    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tls-certs\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.129737 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.129715    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g26n9\" (UniqueName: \"kubernetes.io/projected/e6fe1c22-aada-457e-804e-c6c7adbd6dba-kube-api-access-g26n9\") pod \"e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") " pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.168782 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.168757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:26.306735 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.306707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"]
Jul 07 00:10:26.308120 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:10:26.308094    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6fe1c22_aada_457e_804e_c6c7adbd6dba.slice/crio-6106c1f46aa068f5a20edbd9a4711f81cc501899328cdb05e655d86d6258f2f7 WatchSource:0}: Error finding container 6106c1f46aa068f5a20edbd9a4711f81cc501899328cdb05e655d86d6258f2f7: Status 404 returned error can't find the container with id 6106c1f46aa068f5a20edbd9a4711f81cc501899328cdb05e655d86d6258f2f7
Jul 07 00:10:26.639213 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.639173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92" event={"ID":"e6fe1c22-aada-457e-804e-c6c7adbd6dba","Type":"ContainerStarted","Data":"5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2"}
Jul 07 00:10:26.639388 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.639227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92" event={"ID":"e6fe1c22-aada-457e-804e-c6c7adbd6dba","Type":"ContainerStarted","Data":"6106c1f46aa068f5a20edbd9a4711f81cc501899328cdb05e655d86d6258f2f7"}
Jul 07 00:10:26.660885 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:26.660837    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92" podStartSLOduration=1.660821559 podStartE2EDuration="1.660821559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:10:26.658120961 +0000 UTC m=+1688.221195595" watchObservedRunningTime="2026-07-07 00:10:26.660821559 +0000 UTC m=+1688.223896190"
Jul 07 00:10:36.169468 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:36.169436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:36.170002 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:36.169504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:36.182901 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:36.182879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:36.700045 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:36.700013    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:10:46.666872 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.666796    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"]
Jul 07 00:10:46.667350 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.667046    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8" podUID="cb83c507-f463-4146-a837-0fa59f6e79a3" containerName="maas-api" containerID="cri-o://920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f" gracePeriod=30
Jul 07 00:10:46.918179 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.918156    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:46.991958 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.991927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cspbh\" (UniqueName: \"kubernetes.io/projected/cb83c507-f463-4146-a837-0fa59f6e79a3-kube-api-access-cspbh\") pod \"cb83c507-f463-4146-a837-0fa59f6e79a3\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") "
Jul 07 00:10:46.992136 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.991977    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls\") pod \"cb83c507-f463-4146-a837-0fa59f6e79a3\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") "
Jul 07 00:10:46.992136 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.992000    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c507-f463-4146-a837-0fa59f6e79a3-openshift-service-ca\") pod \"cb83c507-f463-4146-a837-0fa59f6e79a3\" (UID: \"cb83c507-f463-4146-a837-0fa59f6e79a3\") "
Jul 07 00:10:46.992437 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.992405    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb83c507-f463-4146-a837-0fa59f6e79a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb83c507-f463-4146-a837-0fa59f6e79a3" (UID: "cb83c507-f463-4146-a837-0fa59f6e79a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:10:46.994213 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.994183    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb83c507-f463-4146-a837-0fa59f6e79a3" (UID: "cb83c507-f463-4146-a837-0fa59f6e79a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:10:46.994308 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:46.994230    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb83c507-f463-4146-a837-0fa59f6e79a3-kube-api-access-cspbh" (OuterVolumeSpecName: "kube-api-access-cspbh") pod "cb83c507-f463-4146-a837-0fa59f6e79a3" (UID: "cb83c507-f463-4146-a837-0fa59f6e79a3"). InnerVolumeSpecName "kube-api-access-cspbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:10:47.092825 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.092787    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cspbh\" (UniqueName: \"kubernetes.io/projected/cb83c507-f463-4146-a837-0fa59f6e79a3-kube-api-access-cspbh\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:10:47.092825 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.092818    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb83c507-f463-4146-a837-0fa59f6e79a3-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:10:47.092825 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.092828    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c507-f463-4146-a837-0fa59f6e79a3-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:10:47.739681 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.739644    2581 generic.go:356] "Generic (PLEG): container finished" podID="cb83c507-f463-4146-a837-0fa59f6e79a3" containerID="920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f" exitCode=0
Jul 07 00:10:47.740132 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.739681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8" event={"ID":"cb83c507-f463-4146-a837-0fa59f6e79a3","Type":"ContainerDied","Data":"920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f"}
Jul 07 00:10:47.740132 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.739734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8" event={"ID":"cb83c507-f463-4146-a837-0fa59f6e79a3","Type":"ContainerDied","Data":"a0a584f019e816d9b01fe2ab0bbd6913a22a1f214723472488afc3d8aa804c03"}
Jul 07 00:10:47.740132 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.739755    2581 scope.go:117] "RemoveContainer" containerID="920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f"
Jul 07 00:10:47.740132 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.739691    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"
Jul 07 00:10:47.749129 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.749106    2581 scope.go:117] "RemoveContainer" containerID="920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f"
Jul 07 00:10:47.749423 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:10:47.749401    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f\": container with ID starting with 920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f not found: ID does not exist" containerID="920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f"
Jul 07 00:10:47.749480 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.749432    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f"} err="failed to get container status \"920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f\": rpc error: code = NotFound desc = could not find container \"920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f\": container with ID starting with 920d01c66c1ad50ad02ecd95484bcb0ca8a7162867044c99d195d334882df65f not found: ID does not exist"
Jul 07 00:10:47.764444 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.764420    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"]
Jul 07 00:10:47.767650 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:47.767630    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-522f0b74-cff94b5dd-vv6z8"]
Jul 07 00:10:48.943528 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:48.943494    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb83c507-f463-4146-a837-0fa59f6e79a3" path="/var/lib/kubelet/pods/cb83c507-f463-4146-a837-0fa59f6e79a3/volumes"
Jul 07 00:10:57.414120 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:10:57.414067    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"]
Jul 07 00:11:12.435218 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.435143    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92" podUID="e6fe1c22-aada-457e-804e-c6c7adbd6dba" containerName="main" containerID="cri-o://5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2" gracePeriod=45
Jul 07 00:11:12.690035 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.689979    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:11:12.826438 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826397    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-home\") pod \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") "
Jul 07 00:11:12.826438 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826445    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tmp-dir\") pod \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") "
Jul 07 00:11:12.826655 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tls-certs\") pod \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") "
Jul 07 00:11:12.826655 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826510    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g26n9\" (UniqueName: \"kubernetes.io/projected/e6fe1c22-aada-457e-804e-c6c7adbd6dba-kube-api-access-g26n9\") pod \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") "
Jul 07 00:11:12.826655 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-dshm\") pod \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") "
Jul 07 00:11:12.826655 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826554    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-model-cache\") pod \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\" (UID: \"e6fe1c22-aada-457e-804e-c6c7adbd6dba\") "
Jul 07 00:11:12.826855 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826737    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-home" (OuterVolumeSpecName: "home") pod "e6fe1c22-aada-457e-804e-c6c7adbd6dba" (UID: "e6fe1c22-aada-457e-804e-c6c7adbd6dba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:11:12.826855 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826745    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e6fe1c22-aada-457e-804e-c6c7adbd6dba" (UID: "e6fe1c22-aada-457e-804e-c6c7adbd6dba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:11:12.826964 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826890    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-home\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:11:12.826964 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826911    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tmp-dir\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:11:12.827107 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.826950    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-model-cache" (OuterVolumeSpecName: "model-cache") pod "e6fe1c22-aada-457e-804e-c6c7adbd6dba" (UID: "e6fe1c22-aada-457e-804e-c6c7adbd6dba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:11:12.828894 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.828871    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-dshm" (OuterVolumeSpecName: "dshm") pod "e6fe1c22-aada-457e-804e-c6c7adbd6dba" (UID: "e6fe1c22-aada-457e-804e-c6c7adbd6dba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:11:12.829120 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.828946    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e6fe1c22-aada-457e-804e-c6c7adbd6dba" (UID: "e6fe1c22-aada-457e-804e-c6c7adbd6dba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:11:12.829120 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.828957    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fe1c22-aada-457e-804e-c6c7adbd6dba-kube-api-access-g26n9" (OuterVolumeSpecName: "kube-api-access-g26n9") pod "e6fe1c22-aada-457e-804e-c6c7adbd6dba" (UID: "e6fe1c22-aada-457e-804e-c6c7adbd6dba"). InnerVolumeSpecName "kube-api-access-g26n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:11:12.859063 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.859033    2581 generic.go:356] "Generic (PLEG): container finished" podID="e6fe1c22-aada-457e-804e-c6c7adbd6dba" containerID="5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2" exitCode=0
Jul 07 00:11:12.859191 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.859094    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"
Jul 07 00:11:12.859191 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.859109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92" event={"ID":"e6fe1c22-aada-457e-804e-c6c7adbd6dba","Type":"ContainerDied","Data":"5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2"}
Jul 07 00:11:12.859191 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.859149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92" event={"ID":"e6fe1c22-aada-457e-804e-c6c7adbd6dba","Type":"ContainerDied","Data":"6106c1f46aa068f5a20edbd9a4711f81cc501899328cdb05e655d86d6258f2f7"}
Jul 07 00:11:12.859191 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.859166    2581 scope.go:117] "RemoveContainer" containerID="5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2"
Jul 07 00:11:12.868153 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.868136    2581 scope.go:117] "RemoveContainer" containerID="5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2"
Jul 07 00:11:12.868406 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:11:12.868387    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2\": container with ID starting with 5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2 not found: ID does not exist" containerID="5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2"
Jul 07 00:11:12.868467 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.868417    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2"} err="failed to get container status \"5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2\": rpc error: code = NotFound desc = could not find container \"5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2\": container with ID starting with 5d91069f6d01f64233efd3e6727d8bfd459db3aa8b7cf477fce0b505b6b5e3f2 not found: ID does not exist"
Jul 07 00:11:12.879870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.879846    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"]
Jul 07 00:11:12.883521 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.883497    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-522f0b74/e2e-lifecycle-model-522f0b74-kserve-79b67cb475-rsw92"]
Jul 07 00:11:12.927850 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.927820    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g26n9\" (UniqueName: \"kubernetes.io/projected/e6fe1c22-aada-457e-804e-c6c7adbd6dba-kube-api-access-g26n9\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:11:12.927850 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.927842    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-dshm\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:11:12.927850 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.927852    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6fe1c22-aada-457e-804e-c6c7adbd6dba-model-cache\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:11:12.928022 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.927860    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6fe1c22-aada-457e-804e-c6c7adbd6dba-tls-certs\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:11:12.942627 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:11:12.942567    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6fe1c22-aada-457e-804e-c6c7adbd6dba" path="/var/lib/kubelet/pods/e6fe1c22-aada-457e-804e-c6c7adbd6dba/volumes"
Jul 07 00:12:19.016328 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:19.016299    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:12:19.018986 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:19.018964    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:12:53.292671 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.292631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"]
Jul 07 00:12:53.293215 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.293198    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fe1c22-aada-457e-804e-c6c7adbd6dba" containerName="main"
Jul 07 00:12:53.293264 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.293219    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fe1c22-aada-457e-804e-c6c7adbd6dba" containerName="main"
Jul 07 00:12:53.293264 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.293235    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb83c507-f463-4146-a837-0fa59f6e79a3" containerName="maas-api"
Jul 07 00:12:53.293264 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.293244    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb83c507-f463-4146-a837-0fa59f6e79a3" containerName="maas-api"
Jul 07 00:12:53.293355 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.293337    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb83c507-f463-4146-a837-0fa59f6e79a3" containerName="maas-api"
Jul 07 00:12:53.293389 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.293353    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6fe1c22-aada-457e-804e-c6c7adbd6dba" containerName="main"
Jul 07 00:12:53.296730 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.296710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.299369 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.299345    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-02e2a5-serving-cert\""
Jul 07 00:12:53.299520 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.299388    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:12:53.307293 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.307266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"]
Jul 07 00:12:53.387771 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.387740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8659d200-cad2-4a0d-b571-55dea31282d8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.387960 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.387803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7k2\" (UniqueName: \"kubernetes.io/projected/8659d200-cad2-4a0d-b571-55dea31282d8-kube-api-access-dg7k2\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.387960 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.387856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8659d200-cad2-4a0d-b571-55dea31282d8-maas-api-tls\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.488850 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.488813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8659d200-cad2-4a0d-b571-55dea31282d8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.489035 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.488914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7k2\" (UniqueName: \"kubernetes.io/projected/8659d200-cad2-4a0d-b571-55dea31282d8-kube-api-access-dg7k2\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.489035 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.488972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8659d200-cad2-4a0d-b571-55dea31282d8-maas-api-tls\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.489592 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.489570    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8659d200-cad2-4a0d-b571-55dea31282d8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.491680 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.491649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8659d200-cad2-4a0d-b571-55dea31282d8-maas-api-tls\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.498420 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.498394    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7k2\" (UniqueName: \"kubernetes.io/projected/8659d200-cad2-4a0d-b571-55dea31282d8-kube-api-access-dg7k2\") pod \"maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") " pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.608509 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.608416    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:53.750528 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.750498    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"]
Jul 07 00:12:53.754122 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:12:53.754063    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8659d200_cad2_4a0d_b571_55dea31282d8.slice/crio-d045cd7e298243afb31d3cccd149b3fb048cf2100c7456af72cf335a9dd14936 WatchSource:0}: Error finding container d045cd7e298243afb31d3cccd149b3fb048cf2100c7456af72cf335a9dd14936: Status 404 returned error can't find the container with id d045cd7e298243afb31d3cccd149b3fb048cf2100c7456af72cf335a9dd14936
Jul 07 00:12:53.755827 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:53.755807    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:12:54.359384 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:54.359349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq" event={"ID":"8659d200-cad2-4a0d-b571-55dea31282d8","Type":"ContainerStarted","Data":"d045cd7e298243afb31d3cccd149b3fb048cf2100c7456af72cf335a9dd14936"}
Jul 07 00:12:55.366297 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:55.366260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq" event={"ID":"8659d200-cad2-4a0d-b571-55dea31282d8","Type":"ContainerStarted","Data":"0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81"}
Jul 07 00:12:55.366722 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:55.366422    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:12:55.386808 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:12:55.386762    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq" podStartSLOduration=1.786528572 podStartE2EDuration="2.386748263s" totalImagesPullingTime="600.219691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:12:55.384944344 +0000 UTC m=+1836.948018976" watchObservedRunningTime="2026-07-07 00:12:55.386748263 +0000 UTC m=+1836.949822894"
Jul 07 00:13:01.308985 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.308942    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"]
Jul 07 00:13:01.312924 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.312904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.315587 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.315560    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-b40adc-serving-cert\""
Jul 07 00:13:01.324827 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.324800    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"]
Jul 07 00:13:01.376032 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.376006    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:13:01.464615 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.464581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssthx\" (UniqueName: \"kubernetes.io/projected/8ad1c782-9a6e-4301-b162-615cf87da007-kube-api-access-ssthx\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.464817 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.464733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad1c782-9a6e-4301-b162-615cf87da007-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.464898 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.464864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad1c782-9a6e-4301-b162-615cf87da007-maas-api-tls\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.566234 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.566131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssthx\" (UniqueName: \"kubernetes.io/projected/8ad1c782-9a6e-4301-b162-615cf87da007-kube-api-access-ssthx\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.566234 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.566178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad1c782-9a6e-4301-b162-615cf87da007-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.566234 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.566225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad1c782-9a6e-4301-b162-615cf87da007-maas-api-tls\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.567027 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.567006    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad1c782-9a6e-4301-b162-615cf87da007-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.569038 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.569015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad1c782-9a6e-4301-b162-615cf87da007-maas-api-tls\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.578152 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.578126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssthx\" (UniqueName: \"kubernetes.io/projected/8ad1c782-9a6e-4301-b162-615cf87da007-kube-api-access-ssthx\") pod \"maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") " pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.626938 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.626904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:01.978252 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:01.978212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"]
Jul 07 00:13:01.980895 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:13:01.980866    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad1c782_9a6e_4301_b162_615cf87da007.slice/crio-af683e044125b9f40d80f753b6f60a4ed6a04cad11e3682a7b815cb793faff78 WatchSource:0}: Error finding container af683e044125b9f40d80f753b6f60a4ed6a04cad11e3682a7b815cb793faff78: Status 404 returned error can't find the container with id af683e044125b9f40d80f753b6f60a4ed6a04cad11e3682a7b815cb793faff78
Jul 07 00:13:02.399723 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:02.399650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6" event={"ID":"8ad1c782-9a6e-4301-b162-615cf87da007","Type":"ContainerStarted","Data":"af683e044125b9f40d80f753b6f60a4ed6a04cad11e3682a7b815cb793faff78"}
Jul 07 00:13:03.406907 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:03.406866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6" event={"ID":"8ad1c782-9a6e-4301-b162-615cf87da007","Type":"ContainerStarted","Data":"b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8"}
Jul 07 00:13:03.407603 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:03.406978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:03.425188 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:03.425143    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6" podStartSLOduration=1.999419176 podStartE2EDuration="2.425126252s" totalImagesPullingTime="425.707076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:13:03.423390724 +0000 UTC m=+1844.986465365" watchObservedRunningTime="2026-07-07 00:13:03.425126252 +0000 UTC m=+1844.988200883"
Jul 07 00:13:09.417893 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:09.417864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:13:33.341979 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.341944    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"]
Jul 07 00:13:33.345936 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.345915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.351837 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.351801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b40adc\"/\"openshift-service-ca.crt\""
Jul 07 00:13:33.351961 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.351810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b40adc\"/\"default-dockercfg-ps7jg\""
Jul 07 00:13:33.351961 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.351904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b40adc\"/\"kube-root-ca.crt\""
Jul 07 00:13:33.351961 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.351917    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b40adc\"/\"test-model-b40adc-kserve-self-signed-certs\""
Jul 07 00:13:33.358438 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.358415    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"]
Jul 07 00:13:33.447149 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.447123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d154857-9238-48fa-ae3a-8de824c7c659-tls-certs\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.447312 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.447163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-tmp-dir\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.447312 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.447246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-model-cache\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.447312 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.447302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-home\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.447423 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.447326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-dshm\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.447423 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.447391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9l9\" (UniqueName: \"kubernetes.io/projected/5d154857-9238-48fa-ae3a-8de824c7c659-kube-api-access-6b9l9\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.548622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.548591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-model-cache\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.548812 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.548629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-home\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.548812 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.548651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-dshm\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.548812 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.548690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9l9\" (UniqueName: \"kubernetes.io/projected/5d154857-9238-48fa-ae3a-8de824c7c659-kube-api-access-6b9l9\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.548812 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.548709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d154857-9238-48fa-ae3a-8de824c7c659-tls-certs\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.548812 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.548734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-tmp-dir\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.549119 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.549064    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-home\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.549204 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.549172    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-tmp-dir\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.549250 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.549229    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-model-cache\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.551207 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.551184    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-dshm\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.551426 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.551407    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d154857-9238-48fa-ae3a-8de824c7c659-tls-certs\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.557426 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.557405    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9l9\" (UniqueName: \"kubernetes.io/projected/5d154857-9238-48fa-ae3a-8de824c7c659-kube-api-access-6b9l9\") pod \"test-model-b40adc-kserve-6c7889994f-ldbcw\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") " pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.654831 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.654757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:33.793884 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:33.793861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"]
Jul 07 00:13:33.795780 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:13:33.795747    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d154857_9238_48fa_ae3a_8de824c7c659.slice/crio-94d40466c53e85edf4203b70dedb8958af0701f47fca260763e08952c5482328 WatchSource:0}: Error finding container 94d40466c53e85edf4203b70dedb8958af0701f47fca260763e08952c5482328: Status 404 returned error can't find the container with id 94d40466c53e85edf4203b70dedb8958af0701f47fca260763e08952c5482328
Jul 07 00:13:34.552835 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:34.552798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw" event={"ID":"5d154857-9238-48fa-ae3a-8de824c7c659","Type":"ContainerStarted","Data":"8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb"}
Jul 07 00:13:34.553235 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:34.552842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw" event={"ID":"5d154857-9238-48fa-ae3a-8de824c7c659","Type":"ContainerStarted","Data":"94d40466c53e85edf4203b70dedb8958af0701f47fca260763e08952c5482328"}
Jul 07 00:13:34.572708 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:34.572660    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw" podStartSLOduration=1.5726449200000001 podStartE2EDuration="1.57264492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:13:34.570440155 +0000 UTC m=+1876.133514783" watchObservedRunningTime="2026-07-07 00:13:34.57264492 +0000 UTC m=+1876.135719552"
Jul 07 00:13:43.655659 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:43.655567    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:43.656191 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:43.655881    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:43.668403 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:43.668375    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:44.610473 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:44.610442    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:13:55.147719 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:55.147684    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"]
Jul 07 00:13:55.949321 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:55.949277    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"]
Jul 07 00:13:55.949585 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:55.949534    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq" podUID="8659d200-cad2-4a0d-b571-55dea31282d8" containerName="maas-api" containerID="cri-o://0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81" gracePeriod=30
Jul 07 00:13:56.208660 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.208540    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:13:56.358614 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.358574    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8659d200-cad2-4a0d-b571-55dea31282d8-openshift-service-ca\") pod \"8659d200-cad2-4a0d-b571-55dea31282d8\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") "
Jul 07 00:13:56.358788 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.358698    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8659d200-cad2-4a0d-b571-55dea31282d8-maas-api-tls\") pod \"8659d200-cad2-4a0d-b571-55dea31282d8\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") "
Jul 07 00:13:56.358788 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.358738    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg7k2\" (UniqueName: \"kubernetes.io/projected/8659d200-cad2-4a0d-b571-55dea31282d8-kube-api-access-dg7k2\") pod \"8659d200-cad2-4a0d-b571-55dea31282d8\" (UID: \"8659d200-cad2-4a0d-b571-55dea31282d8\") "
Jul 07 00:13:56.358971 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.358947    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8659d200-cad2-4a0d-b571-55dea31282d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8659d200-cad2-4a0d-b571-55dea31282d8" (UID: "8659d200-cad2-4a0d-b571-55dea31282d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:13:56.360991 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.360957    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8659d200-cad2-4a0d-b571-55dea31282d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8659d200-cad2-4a0d-b571-55dea31282d8" (UID: "8659d200-cad2-4a0d-b571-55dea31282d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:13:56.360991 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.360982    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8659d200-cad2-4a0d-b571-55dea31282d8-kube-api-access-dg7k2" (OuterVolumeSpecName: "kube-api-access-dg7k2") pod "8659d200-cad2-4a0d-b571-55dea31282d8" (UID: "8659d200-cad2-4a0d-b571-55dea31282d8"). InnerVolumeSpecName "kube-api-access-dg7k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:13:56.459856 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.459765    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8659d200-cad2-4a0d-b571-55dea31282d8-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:13:56.459856 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.459797    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg7k2\" (UniqueName: \"kubernetes.io/projected/8659d200-cad2-4a0d-b571-55dea31282d8-kube-api-access-dg7k2\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:13:56.459856 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.459807    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8659d200-cad2-4a0d-b571-55dea31282d8-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:13:56.666217 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.666182    2581 generic.go:356] "Generic (PLEG): container finished" podID="8659d200-cad2-4a0d-b571-55dea31282d8" containerID="0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81" exitCode=0
Jul 07 00:13:56.666390 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.666227    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"
Jul 07 00:13:56.666390 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.666247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq" event={"ID":"8659d200-cad2-4a0d-b571-55dea31282d8","Type":"ContainerDied","Data":"0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81"}
Jul 07 00:13:56.666390 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.666288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq" event={"ID":"8659d200-cad2-4a0d-b571-55dea31282d8","Type":"ContainerDied","Data":"d045cd7e298243afb31d3cccd149b3fb048cf2100c7456af72cf335a9dd14936"}
Jul 07 00:13:56.666390 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.666309    2581 scope.go:117] "RemoveContainer" containerID="0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81"
Jul 07 00:13:56.675627 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.675606    2581 scope.go:117] "RemoveContainer" containerID="0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81"
Jul 07 00:13:56.675924 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:13:56.675902    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81\": container with ID starting with 0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81 not found: ID does not exist" containerID="0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81"
Jul 07 00:13:56.675975 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.675933    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81"} err="failed to get container status \"0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81\": rpc error: code = NotFound desc = could not find container \"0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81\": container with ID starting with 0d65fe420babe1ee0f6a90f7f55fdf61aecfd1f39e553baf16c705733055de81 not found: ID does not exist"
Jul 07 00:13:56.688965 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.688936    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"]
Jul 07 00:13:56.695125 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.695098    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-02e2a5-7fb76944f9-sd6fq"]
Jul 07 00:13:56.944094 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:13:56.944040    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8659d200-cad2-4a0d-b571-55dea31282d8" path="/var/lib/kubelet/pods/8659d200-cad2-4a0d-b571-55dea31282d8/volumes"
Jul 07 00:14:10.168838 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.168794    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw" podUID="5d154857-9238-48fa-ae3a-8de824c7c659" containerName="main" containerID="cri-o://8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb" gracePeriod=45
Jul 07 00:14:10.427052 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.426991    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:14:10.484396 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484365    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-dshm\") pod \"5d154857-9238-48fa-ae3a-8de824c7c659\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") "
Jul 07 00:14:10.484396 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b9l9\" (UniqueName: \"kubernetes.io/projected/5d154857-9238-48fa-ae3a-8de824c7c659-kube-api-access-6b9l9\") pod \"5d154857-9238-48fa-ae3a-8de824c7c659\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") "
Jul 07 00:14:10.484609 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484430    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-home\") pod \"5d154857-9238-48fa-ae3a-8de824c7c659\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") "
Jul 07 00:14:10.484609 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484454    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d154857-9238-48fa-ae3a-8de824c7c659-tls-certs\") pod \"5d154857-9238-48fa-ae3a-8de824c7c659\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") "
Jul 07 00:14:10.484609 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484491    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-model-cache\") pod \"5d154857-9238-48fa-ae3a-8de824c7c659\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") "
Jul 07 00:14:10.484609 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484525    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-tmp-dir\") pod \"5d154857-9238-48fa-ae3a-8de824c7c659\" (UID: \"5d154857-9238-48fa-ae3a-8de824c7c659\") "
Jul 07 00:14:10.484822 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484693    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-home" (OuterVolumeSpecName: "home") pod "5d154857-9238-48fa-ae3a-8de824c7c659" (UID: "5d154857-9238-48fa-ae3a-8de824c7c659"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:14:10.484822 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484771    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-home\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:10.484822 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484793    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d154857-9238-48fa-ae3a-8de824c7c659" (UID: "5d154857-9238-48fa-ae3a-8de824c7c659"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:14:10.484927 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.484842    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d154857-9238-48fa-ae3a-8de824c7c659" (UID: "5d154857-9238-48fa-ae3a-8de824c7c659"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:14:10.486739 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.486719    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-dshm" (OuterVolumeSpecName: "dshm") pod "5d154857-9238-48fa-ae3a-8de824c7c659" (UID: "5d154857-9238-48fa-ae3a-8de824c7c659"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:14:10.486829 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.486809    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d154857-9238-48fa-ae3a-8de824c7c659-kube-api-access-6b9l9" (OuterVolumeSpecName: "kube-api-access-6b9l9") pod "5d154857-9238-48fa-ae3a-8de824c7c659" (UID: "5d154857-9238-48fa-ae3a-8de824c7c659"). InnerVolumeSpecName "kube-api-access-6b9l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:14:10.486871 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.486841    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d154857-9238-48fa-ae3a-8de824c7c659-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d154857-9238-48fa-ae3a-8de824c7c659" (UID: "5d154857-9238-48fa-ae3a-8de824c7c659"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:14:10.591534 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.586108    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-tmp-dir\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:10.591534 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.586146    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-dshm\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:10.591534 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.586161    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b9l9\" (UniqueName: \"kubernetes.io/projected/5d154857-9238-48fa-ae3a-8de824c7c659-kube-api-access-6b9l9\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:10.591534 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.586182    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d154857-9238-48fa-ae3a-8de824c7c659-tls-certs\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:10.591534 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.586197    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d154857-9238-48fa-ae3a-8de824c7c659-model-cache\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:10.742425 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.742327    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d154857-9238-48fa-ae3a-8de824c7c659" containerID="8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb" exitCode=0
Jul 07 00:14:10.742425 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.742385    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"
Jul 07 00:14:10.742425 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.742402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw" event={"ID":"5d154857-9238-48fa-ae3a-8de824c7c659","Type":"ContainerDied","Data":"8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb"}
Jul 07 00:14:10.742673 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.742450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw" event={"ID":"5d154857-9238-48fa-ae3a-8de824c7c659","Type":"ContainerDied","Data":"94d40466c53e85edf4203b70dedb8958af0701f47fca260763e08952c5482328"}
Jul 07 00:14:10.742673 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.742472    2581 scope.go:117] "RemoveContainer" containerID="8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb"
Jul 07 00:14:10.751844 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.751826    2581 scope.go:117] "RemoveContainer" containerID="8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb"
Jul 07 00:14:10.752176 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:14:10.752153    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb\": container with ID starting with 8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb not found: ID does not exist" containerID="8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb"
Jul 07 00:14:10.752231 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.752187    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb"} err="failed to get container status \"8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb\": rpc error: code = NotFound desc = could not find container \"8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb\": container with ID starting with 8773084be2521a95c521fc995968dcfa942f86db090b2bd82df801444132ecfb not found: ID does not exist"
Jul 07 00:14:10.764503 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.764483    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"]
Jul 07 00:14:10.767823 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.767801    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b40adc/test-model-b40adc-kserve-6c7889994f-ldbcw"]
Jul 07 00:14:10.942848 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:10.942813    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d154857-9238-48fa-ae3a-8de824c7c659" path="/var/lib/kubelet/pods/5d154857-9238-48fa-ae3a-8de824c7c659/volumes"
Jul 07 00:14:39.210881 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.210841    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"]
Jul 07 00:14:39.211714 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.211230    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6" podUID="8ad1c782-9a6e-4301-b162-615cf87da007" containerName="maas-api" containerID="cri-o://b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8" gracePeriod=30
Jul 07 00:14:39.493639 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.493611    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:14:39.641949 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.641918    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssthx\" (UniqueName: \"kubernetes.io/projected/8ad1c782-9a6e-4301-b162-615cf87da007-kube-api-access-ssthx\") pod \"8ad1c782-9a6e-4301-b162-615cf87da007\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") "
Jul 07 00:14:39.642168 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.641968    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad1c782-9a6e-4301-b162-615cf87da007-maas-api-tls\") pod \"8ad1c782-9a6e-4301-b162-615cf87da007\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") "
Jul 07 00:14:39.642168 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.642063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad1c782-9a6e-4301-b162-615cf87da007-openshift-service-ca\") pod \"8ad1c782-9a6e-4301-b162-615cf87da007\" (UID: \"8ad1c782-9a6e-4301-b162-615cf87da007\") "
Jul 07 00:14:39.642390 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.642363    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ad1c782-9a6e-4301-b162-615cf87da007-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ad1c782-9a6e-4301-b162-615cf87da007" (UID: "8ad1c782-9a6e-4301-b162-615cf87da007"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:14:39.642455 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.642444    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad1c782-9a6e-4301-b162-615cf87da007-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:39.644294 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.644272    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad1c782-9a6e-4301-b162-615cf87da007-kube-api-access-ssthx" (OuterVolumeSpecName: "kube-api-access-ssthx") pod "8ad1c782-9a6e-4301-b162-615cf87da007" (UID: "8ad1c782-9a6e-4301-b162-615cf87da007"). InnerVolumeSpecName "kube-api-access-ssthx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:14:39.644369 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.644271    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ad1c782-9a6e-4301-b162-615cf87da007-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ad1c782-9a6e-4301-b162-615cf87da007" (UID: "8ad1c782-9a6e-4301-b162-615cf87da007"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:14:39.743658 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.743559    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssthx\" (UniqueName: \"kubernetes.io/projected/8ad1c782-9a6e-4301-b162-615cf87da007-kube-api-access-ssthx\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:39.743658 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.743586    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ad1c782-9a6e-4301-b162-615cf87da007-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:14:39.880676 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.880642    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ad1c782-9a6e-4301-b162-615cf87da007" containerID="b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8" exitCode=0
Jul 07 00:14:39.880853 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.880683    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"
Jul 07 00:14:39.880853 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.880725    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6" event={"ID":"8ad1c782-9a6e-4301-b162-615cf87da007","Type":"ContainerDied","Data":"b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8"}
Jul 07 00:14:39.880853 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.880774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6" event={"ID":"8ad1c782-9a6e-4301-b162-615cf87da007","Type":"ContainerDied","Data":"af683e044125b9f40d80f753b6f60a4ed6a04cad11e3682a7b815cb793faff78"}
Jul 07 00:14:39.880853 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.880796    2581 scope.go:117] "RemoveContainer" containerID="b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8"
Jul 07 00:14:39.890177 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.890158    2581 scope.go:117] "RemoveContainer" containerID="b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8"
Jul 07 00:14:39.890429 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:14:39.890408    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8\": container with ID starting with b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8 not found: ID does not exist" containerID="b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8"
Jul 07 00:14:39.890480 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.890439    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8"} err="failed to get container status \"b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8\": rpc error: code = NotFound desc = could not find container \"b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8\": container with ID starting with b48b5f39d7b0acd28ea424c48547147a38c03f7b51f9789ad22f7e6d84ec9ce8 not found: ID does not exist"
Jul 07 00:14:39.903830 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.903806    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"]
Jul 07 00:14:39.907952 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:39.907932    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6"]
Jul 07 00:14:40.943622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:40.943582    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad1c782-9a6e-4301-b162-615cf87da007" path="/var/lib/kubelet/pods/8ad1c782-9a6e-4301-b162-615cf87da007/volumes"
Jul 07 00:14:42.413144 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:42.413064    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-b-b40adc-5b9b8774f9-c6bg6" podUID="8ad1c782-9a6e-4301-b162-615cf87da007" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.50:8443/health\": context deadline exceeded"
Jul 07 00:14:48.921119 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921090    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"]
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921491    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad1c782-9a6e-4301-b162-615cf87da007" containerName="maas-api"
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921504    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad1c782-9a6e-4301-b162-615cf87da007" containerName="maas-api"
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921517    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d154857-9238-48fa-ae3a-8de824c7c659" containerName="main"
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921522    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d154857-9238-48fa-ae3a-8de824c7c659" containerName="main"
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921540    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8659d200-cad2-4a0d-b571-55dea31282d8" containerName="maas-api"
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921549    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8659d200-cad2-4a0d-b571-55dea31282d8" containerName="maas-api"
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921621    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad1c782-9a6e-4301-b162-615cf87da007" containerName="maas-api"
Jul 07 00:14:48.921632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921634    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d154857-9238-48fa-ae3a-8de824c7c659" containerName="main"
Jul 07 00:14:48.922169 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.921642    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8659d200-cad2-4a0d-b571-55dea31282d8" containerName="maas-api"
Jul 07 00:14:48.926043 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.926019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:48.928796 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.928777    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:14:48.928882 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.928833    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-1d88cc-serving-cert\""
Jul 07 00:14:48.935757 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:48.935735    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"]
Jul 07 00:14:49.023275 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.023237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2xhh\" (UniqueName: \"kubernetes.io/projected/12ff9689-7f82-4e85-9aa8-28aae39eb551-kube-api-access-c2xhh\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.023449 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.023302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.023449 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.023422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ff9689-7f82-4e85-9aa8-28aae39eb551-openshift-service-ca\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.124660 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.124624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ff9689-7f82-4e85-9aa8-28aae39eb551-openshift-service-ca\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.124824 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.124715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2xhh\" (UniqueName: \"kubernetes.io/projected/12ff9689-7f82-4e85-9aa8-28aae39eb551-kube-api-access-c2xhh\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.124824 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.124751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.124902 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:14:49.124863    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-1d88cc-serving-cert: secret "maas-api-e2e-api-a-1d88cc-serving-cert" not found
Jul 07 00:14:49.124936 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:14:49.124925    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls podName:12ff9689-7f82-4e85-9aa8-28aae39eb551 nodeName:}" failed. No retries permitted until 2026-07-07 00:14:49.624906332 +0000 UTC m=+1951.187980961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls") pod "maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x" (UID: "12ff9689-7f82-4e85-9aa8-28aae39eb551") : secret "maas-api-e2e-api-a-1d88cc-serving-cert" not found
Jul 07 00:14:49.125332 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.125308    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ff9689-7f82-4e85-9aa8-28aae39eb551-openshift-service-ca\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.136031 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.136008    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2xhh\" (UniqueName: \"kubernetes.io/projected/12ff9689-7f82-4e85-9aa8-28aae39eb551-kube-api-access-c2xhh\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.630732 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.630699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.633261 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.633240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls\") pod \"maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") " pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.838171 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.838139    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:49.979517 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:49.979487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"]
Jul 07 00:14:49.980973 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:14:49.980949    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ff9689_7f82_4e85_9aa8_28aae39eb551.slice/crio-a5b0b39a9f257a8b22c4062de34406365dc022d40e032160199a8427a908ae2c WatchSource:0}: Error finding container a5b0b39a9f257a8b22c4062de34406365dc022d40e032160199a8427a908ae2c: Status 404 returned error can't find the container with id a5b0b39a9f257a8b22c4062de34406365dc022d40e032160199a8427a908ae2c
Jul 07 00:14:50.935192 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:50.935157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x" event={"ID":"12ff9689-7f82-4e85-9aa8-28aae39eb551","Type":"ContainerStarted","Data":"6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf"}
Jul 07 00:14:50.935454 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:50.935206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x" event={"ID":"12ff9689-7f82-4e85-9aa8-28aae39eb551","Type":"ContainerStarted","Data":"a5b0b39a9f257a8b22c4062de34406365dc022d40e032160199a8427a908ae2c"}
Jul 07 00:14:50.935454 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:50.935295    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:50.954489 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:50.954440    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x" podStartSLOduration=2.521291202 podStartE2EDuration="2.954424756s" totalImagesPullingTime="433.133554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:14:50.953243182 +0000 UTC m=+1952.516317815" watchObservedRunningTime="2026-07-07 00:14:50.954424756 +0000 UTC m=+1952.517499453"
Jul 07 00:14:56.946789 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:56.946761    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:14:57.018972 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.018937    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"]
Jul 07 00:14:57.023240 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.023201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.026594 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.026572    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-179c25-serving-cert\""
Jul 07 00:14:57.037138 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.037060    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"]
Jul 07 00:14:57.200066 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.199974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4h6c\" (UniqueName: \"kubernetes.io/projected/ba343666-60e7-4b27-9368-b70843c67b9b-kube-api-access-g4h6c\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.200066 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.200022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba343666-60e7-4b27-9368-b70843c67b9b-maas-api-tls\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.200315 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.200154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba343666-60e7-4b27-9368-b70843c67b9b-openshift-service-ca\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.301142 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.301102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4h6c\" (UniqueName: \"kubernetes.io/projected/ba343666-60e7-4b27-9368-b70843c67b9b-kube-api-access-g4h6c\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.301315 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.301152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba343666-60e7-4b27-9368-b70843c67b9b-maas-api-tls\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.301315 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.301203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba343666-60e7-4b27-9368-b70843c67b9b-openshift-service-ca\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.301797 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.301776    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba343666-60e7-4b27-9368-b70843c67b9b-openshift-service-ca\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.303940 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.303917    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba343666-60e7-4b27-9368-b70843c67b9b-maas-api-tls\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.310281 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.310258    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4h6c\" (UniqueName: \"kubernetes.io/projected/ba343666-60e7-4b27-9368-b70843c67b9b-kube-api-access-g4h6c\") pod \"maas-api-e2e-api-b-179c25-6b65497f-bltjd\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") " pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.336414 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.336383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.477311 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.477284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"]
Jul 07 00:14:57.479667 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:14:57.479637    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba343666_60e7_4b27_9368_b70843c67b9b.slice/crio-55f487079f8bac59a0eff47e362beea4595ee4aebfbcadb094dee13ab93493af WatchSource:0}: Error finding container 55f487079f8bac59a0eff47e362beea4595ee4aebfbcadb094dee13ab93493af: Status 404 returned error can't find the container with id 55f487079f8bac59a0eff47e362beea4595ee4aebfbcadb094dee13ab93493af
Jul 07 00:14:57.967622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.967586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd" event={"ID":"ba343666-60e7-4b27-9368-b70843c67b9b","Type":"ContainerStarted","Data":"0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d"}
Jul 07 00:14:57.968031 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.967647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd" event={"ID":"ba343666-60e7-4b27-9368-b70843c67b9b","Type":"ContainerStarted","Data":"55f487079f8bac59a0eff47e362beea4595ee4aebfbcadb094dee13ab93493af"}
Jul 07 00:14:57.968031 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.967671    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:14:57.986527 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:14:57.986468    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd" podStartSLOduration=1.597908235 podStartE2EDuration="1.986446151s" totalImagesPullingTime="388.537916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:14:57.984121618 +0000 UTC m=+1959.547196250" watchObservedRunningTime="2026-07-07 00:14:57.986446151 +0000 UTC m=+1959.549520785"
Jul 07 00:15:03.978267 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:03.978234    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:15:10.572937 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.572851    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"]
Jul 07 00:15:10.573398 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.573128    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x" podUID="12ff9689-7f82-4e85-9aa8-28aae39eb551" containerName="maas-api" containerID="cri-o://6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf" gracePeriod=30
Jul 07 00:15:10.824816 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.824746    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:15:10.919650 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.919613    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls\") pod \"12ff9689-7f82-4e85-9aa8-28aae39eb551\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") "
Jul 07 00:15:10.919830 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.919724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2xhh\" (UniqueName: \"kubernetes.io/projected/12ff9689-7f82-4e85-9aa8-28aae39eb551-kube-api-access-c2xhh\") pod \"12ff9689-7f82-4e85-9aa8-28aae39eb551\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") "
Jul 07 00:15:10.919830 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.919747    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ff9689-7f82-4e85-9aa8-28aae39eb551-openshift-service-ca\") pod \"12ff9689-7f82-4e85-9aa8-28aae39eb551\" (UID: \"12ff9689-7f82-4e85-9aa8-28aae39eb551\") "
Jul 07 00:15:10.920130 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.920104    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12ff9689-7f82-4e85-9aa8-28aae39eb551-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12ff9689-7f82-4e85-9aa8-28aae39eb551" (UID: "12ff9689-7f82-4e85-9aa8-28aae39eb551"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:15:10.921982 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.921951    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12ff9689-7f82-4e85-9aa8-28aae39eb551" (UID: "12ff9689-7f82-4e85-9aa8-28aae39eb551"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:15:10.922118 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:10.922003    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ff9689-7f82-4e85-9aa8-28aae39eb551-kube-api-access-c2xhh" (OuterVolumeSpecName: "kube-api-access-c2xhh") pod "12ff9689-7f82-4e85-9aa8-28aae39eb551" (UID: "12ff9689-7f82-4e85-9aa8-28aae39eb551"). InnerVolumeSpecName "kube-api-access-c2xhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:15:11.021357 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.021327    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12ff9689-7f82-4e85-9aa8-28aae39eb551-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:15:11.021357 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.021355    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2xhh\" (UniqueName: \"kubernetes.io/projected/12ff9689-7f82-4e85-9aa8-28aae39eb551-kube-api-access-c2xhh\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:15:11.021557 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.021367    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12ff9689-7f82-4e85-9aa8-28aae39eb551-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:15:11.028469 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.028439    2581 generic.go:356] "Generic (PLEG): container finished" podID="12ff9689-7f82-4e85-9aa8-28aae39eb551" containerID="6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf" exitCode=0
Jul 07 00:15:11.028603 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.028491    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"
Jul 07 00:15:11.028603 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.028534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x" event={"ID":"12ff9689-7f82-4e85-9aa8-28aae39eb551","Type":"ContainerDied","Data":"6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf"}
Jul 07 00:15:11.028603 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.028587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x" event={"ID":"12ff9689-7f82-4e85-9aa8-28aae39eb551","Type":"ContainerDied","Data":"a5b0b39a9f257a8b22c4062de34406365dc022d40e032160199a8427a908ae2c"}
Jul 07 00:15:11.028790 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.028615    2581 scope.go:117] "RemoveContainer" containerID="6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf"
Jul 07 00:15:11.037422 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.037319    2581 scope.go:117] "RemoveContainer" containerID="6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf"
Jul 07 00:15:11.037652 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:15:11.037633    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf\": container with ID starting with 6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf not found: ID does not exist" containerID="6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf"
Jul 07 00:15:11.037707 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.037660    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf"} err="failed to get container status \"6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf\": rpc error: code = NotFound desc = could not find container \"6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf\": container with ID starting with 6d0abb8341b5dd01d6fb6472d68657e8199ae675b9499f8a3de4ca0569607bbf not found: ID does not exist"
Jul 07 00:15:11.046316 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.046296    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"]
Jul 07 00:15:11.053085 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:11.053050    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-1d88cc-b657b5bd4-vc46x"]
Jul 07 00:15:12.942289 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:12.942252    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ff9689-7f82-4e85-9aa8-28aae39eb551" path="/var/lib/kubelet/pods/12ff9689-7f82-4e85-9aa8-28aae39eb551/volumes"
Jul 07 00:15:17.509763 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.509730    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"]
Jul 07 00:15:17.510232 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.509973    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd" podUID="ba343666-60e7-4b27-9368-b70843c67b9b" containerName="maas-api" containerID="cri-o://0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d" gracePeriod=30
Jul 07 00:15:17.760536 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.760471    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:15:17.878468 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.878440    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba343666-60e7-4b27-9368-b70843c67b9b-openshift-service-ca\") pod \"ba343666-60e7-4b27-9368-b70843c67b9b\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") "
Jul 07 00:15:17.878623 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.878478    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba343666-60e7-4b27-9368-b70843c67b9b-maas-api-tls\") pod \"ba343666-60e7-4b27-9368-b70843c67b9b\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") "
Jul 07 00:15:17.878623 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.878512    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4h6c\" (UniqueName: \"kubernetes.io/projected/ba343666-60e7-4b27-9368-b70843c67b9b-kube-api-access-g4h6c\") pod \"ba343666-60e7-4b27-9368-b70843c67b9b\" (UID: \"ba343666-60e7-4b27-9368-b70843c67b9b\") "
Jul 07 00:15:17.878839 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.878816    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba343666-60e7-4b27-9368-b70843c67b9b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba343666-60e7-4b27-9368-b70843c67b9b" (UID: "ba343666-60e7-4b27-9368-b70843c67b9b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:15:17.880785 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.880758    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba343666-60e7-4b27-9368-b70843c67b9b-kube-api-access-g4h6c" (OuterVolumeSpecName: "kube-api-access-g4h6c") pod "ba343666-60e7-4b27-9368-b70843c67b9b" (UID: "ba343666-60e7-4b27-9368-b70843c67b9b"). InnerVolumeSpecName "kube-api-access-g4h6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:15:17.880785 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.880778    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba343666-60e7-4b27-9368-b70843c67b9b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba343666-60e7-4b27-9368-b70843c67b9b" (UID: "ba343666-60e7-4b27-9368-b70843c67b9b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:15:17.980181 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.980147    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba343666-60e7-4b27-9368-b70843c67b9b-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:15:17.980181 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.980176    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba343666-60e7-4b27-9368-b70843c67b9b-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:15:17.980181 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:17.980185    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4h6c\" (UniqueName: \"kubernetes.io/projected/ba343666-60e7-4b27-9368-b70843c67b9b-kube-api-access-g4h6c\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:15:18.064054 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.063969    2581 generic.go:356] "Generic (PLEG): container finished" podID="ba343666-60e7-4b27-9368-b70843c67b9b" containerID="0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d" exitCode=0
Jul 07 00:15:18.064054 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.064014    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"
Jul 07 00:15:18.064254 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.064097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd" event={"ID":"ba343666-60e7-4b27-9368-b70843c67b9b","Type":"ContainerDied","Data":"0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d"}
Jul 07 00:15:18.064254 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.064163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd" event={"ID":"ba343666-60e7-4b27-9368-b70843c67b9b","Type":"ContainerDied","Data":"55f487079f8bac59a0eff47e362beea4595ee4aebfbcadb094dee13ab93493af"}
Jul 07 00:15:18.064254 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.064196    2581 scope.go:117] "RemoveContainer" containerID="0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d"
Jul 07 00:15:18.073321 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.073304    2581 scope.go:117] "RemoveContainer" containerID="0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d"
Jul 07 00:15:18.073566 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:15:18.073549    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d\": container with ID starting with 0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d not found: ID does not exist" containerID="0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d"
Jul 07 00:15:18.073614 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.073574    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d"} err="failed to get container status \"0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d\": rpc error: code = NotFound desc = could not find container \"0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d\": container with ID starting with 0f445a7a139c1678f2eb33a85a2c936f5f931a030df7f9f527c174d9180b483d not found: ID does not exist"
Jul 07 00:15:18.086866 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.086842    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"]
Jul 07 00:15:18.089957 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.089935    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-179c25-6b65497f-bltjd"]
Jul 07 00:15:18.943591 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:18.943560    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba343666-60e7-4b27-9368-b70843c67b9b" path="/var/lib/kubelet/pods/ba343666-60e7-4b27-9368-b70843c67b9b/volumes"
Jul 07 00:15:27.322017 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.321983    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"]
Jul 07 00:15:27.322605 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.322563    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ff9689-7f82-4e85-9aa8-28aae39eb551" containerName="maas-api"
Jul 07 00:15:27.322605 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.322584    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ff9689-7f82-4e85-9aa8-28aae39eb551" containerName="maas-api"
Jul 07 00:15:27.322723 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.322623    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba343666-60e7-4b27-9368-b70843c67b9b" containerName="maas-api"
Jul 07 00:15:27.322723 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.322631    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba343666-60e7-4b27-9368-b70843c67b9b" containerName="maas-api"
Jul 07 00:15:27.322835 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.322773    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba343666-60e7-4b27-9368-b70843c67b9b" containerName="maas-api"
Jul 07 00:15:27.322835 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.322818    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ff9689-7f82-4e85-9aa8-28aae39eb551" containerName="maas-api"
Jul 07 00:15:27.326252 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.326231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.328935 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.328914    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-aedad1-serving-cert\""
Jul 07 00:15:27.329097 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.328953    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-66b26\""
Jul 07 00:15:27.338960 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.338926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"]
Jul 07 00:15:27.460620 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.460585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpjsr\" (UniqueName: \"kubernetes.io/projected/62a5bd88-22a9-463b-8893-9fd3f58798f4-kube-api-access-lpjsr\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.460790 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.460627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.460790 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.460717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a5bd88-22a9-463b-8893-9fd3f58798f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.561634 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.561600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a5bd88-22a9-463b-8893-9fd3f58798f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.561826 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.561692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjsr\" (UniqueName: \"kubernetes.io/projected/62a5bd88-22a9-463b-8893-9fd3f58798f4-kube-api-access-lpjsr\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.561826 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.561736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.561960 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:15:27.561911    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-aedad1-serving-cert: secret "maas-api-e2e-shared-a-aedad1-serving-cert" not found
Jul 07 00:15:27.562021 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:15:27.561976    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls podName:62a5bd88-22a9-463b-8893-9fd3f58798f4 nodeName:}" failed. No retries permitted until 2026-07-07 00:15:28.061956681 +0000 UTC m=+1989.625031292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls") pod "maas-api-e2e-shared-a-aedad1-865696849d-zmdc7" (UID: "62a5bd88-22a9-463b-8893-9fd3f58798f4") : secret "maas-api-e2e-shared-a-aedad1-serving-cert" not found
Jul 07 00:15:27.562549 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.562529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a5bd88-22a9-463b-8893-9fd3f58798f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:27.571455 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:27.571432    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpjsr\" (UniqueName: \"kubernetes.io/projected/62a5bd88-22a9-463b-8893-9fd3f58798f4-kube-api-access-lpjsr\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:28.067565 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:28.067520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:28.072884 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:28.072849    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-aedad1-865696849d-zmdc7\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") " pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:28.237467 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:28.237429    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:28.378907 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:28.378875    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"]
Jul 07 00:15:28.380812 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:15:28.380785    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a5bd88_22a9_463b_8893_9fd3f58798f4.slice/crio-e18d3b6d341eb635a141eb5c6f9a1d2fbc81394ddcf7f85b91271b829af465d2 WatchSource:0}: Error finding container e18d3b6d341eb635a141eb5c6f9a1d2fbc81394ddcf7f85b91271b829af465d2: Status 404 returned error can't find the container with id e18d3b6d341eb635a141eb5c6f9a1d2fbc81394ddcf7f85b91271b829af465d2
Jul 07 00:15:29.122011 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:29.121898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7" event={"ID":"62a5bd88-22a9-463b-8893-9fd3f58798f4","Type":"ContainerStarted","Data":"bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533"}
Jul 07 00:15:29.122011 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:29.121975    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7" event={"ID":"62a5bd88-22a9-463b-8893-9fd3f58798f4","Type":"ContainerStarted","Data":"e18d3b6d341eb635a141eb5c6f9a1d2fbc81394ddcf7f85b91271b829af465d2"}
Jul 07 00:15:29.122011 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:29.122005    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:29.142628 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:29.142580    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7" podStartSLOduration=1.729762169 podStartE2EDuration="2.142561986s" totalImagesPullingTime="412.799817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:29.140573574 +0000 UTC m=+1990.703648207" watchObservedRunningTime="2026-07-07 00:15:29.142561986 +0000 UTC m=+1990.705636618"
Jul 07 00:15:35.133440 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.133411    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:15:35.381892 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.381846    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"]
Jul 07 00:15:35.385785 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.385725    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.388945 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.388925    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-72fa7c-serving-cert\""
Jul 07 00:15:35.399498 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.399473    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"]
Jul 07 00:15:35.536399 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.536366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.536399 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.536400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99n4r\" (UniqueName: \"kubernetes.io/projected/f79284db-1036-4309-81b1-5e2a3bc293c5-kube-api-access-99n4r\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.536637 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.536422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79284db-1036-4309-81b1-5e2a3bc293c5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.637422 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.637326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.637422 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.637367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99n4r\" (UniqueName: \"kubernetes.io/projected/f79284db-1036-4309-81b1-5e2a3bc293c5-kube-api-access-99n4r\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.637422 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.637397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79284db-1036-4309-81b1-5e2a3bc293c5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.637728 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:15:35.637482    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-72fa7c-serving-cert: secret "maas-api-e2e-shared-b-72fa7c-serving-cert" not found
Jul 07 00:15:35.637728 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:15:35.637547    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls podName:f79284db-1036-4309-81b1-5e2a3bc293c5 nodeName:}" failed. No retries permitted until 2026-07-07 00:15:36.137530075 +0000 UTC m=+1997.700604685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls") pod "maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp" (UID: "f79284db-1036-4309-81b1-5e2a3bc293c5") : secret "maas-api-e2e-shared-b-72fa7c-serving-cert" not found
Jul 07 00:15:35.638129 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.638107    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79284db-1036-4309-81b1-5e2a3bc293c5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:35.647020 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:35.646992    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99n4r\" (UniqueName: \"kubernetes.io/projected/f79284db-1036-4309-81b1-5e2a3bc293c5-kube-api-access-99n4r\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:36.141085 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:36.141024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:36.143715 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:36.143689    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls\") pod \"maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") " pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:36.295896 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:36.295857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:36.439575 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:36.439384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"]
Jul 07 00:15:36.442264 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:15:36.442230    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf79284db_1036_4309_81b1_5e2a3bc293c5.slice/crio-65e5f579fec0b5f090bb979f8a26bfc0f2b8afe409802ca92005da8d880e3f4a WatchSource:0}: Error finding container 65e5f579fec0b5f090bb979f8a26bfc0f2b8afe409802ca92005da8d880e3f4a: Status 404 returned error can't find the container with id 65e5f579fec0b5f090bb979f8a26bfc0f2b8afe409802ca92005da8d880e3f4a
Jul 07 00:15:37.160141 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:37.160047    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp" event={"ID":"f79284db-1036-4309-81b1-5e2a3bc293c5","Type":"ContainerStarted","Data":"fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3"}
Jul 07 00:15:37.160141 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:37.160113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp" event={"ID":"f79284db-1036-4309-81b1-5e2a3bc293c5","Type":"ContainerStarted","Data":"65e5f579fec0b5f090bb979f8a26bfc0f2b8afe409802ca92005da8d880e3f4a"}
Jul 07 00:15:37.160545 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:37.160263    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:37.183854 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:37.183811    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp" podStartSLOduration=1.725686934 podStartE2EDuration="2.183794907s" totalImagesPullingTime="458.107973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:37.18268773 +0000 UTC m=+1998.745762362" watchObservedRunningTime="2026-07-07 00:15:37.183794907 +0000 UTC m=+1998.746869574"
Jul 07 00:15:43.171152 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:43.171122    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:15:48.943939 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:48.943910    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"]
Jul 07 00:15:48.947813 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:48.947789    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:48.952132 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:48.952105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"kube-root-ca.crt\""
Jul 07 00:15:48.952297 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:48.952135    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"default-dockercfg-v94q6\""
Jul 07 00:15:48.952391 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:48.952228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"openshift-service-ca.crt\""
Jul 07 00:15:48.952446 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:48.952274    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"auth-test-model-aedad1-kserve-self-signed-certs\""
Jul 07 00:15:48.954202 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:48.954182    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"]
Jul 07 00:15:49.057234 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.057204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-model-cache\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.057408 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.057240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-home\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.057408 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.057258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tls-certs\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.057408 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.057291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-dshm\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.057408 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.057310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tmp-dir\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.057566 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.057432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-644b8\" (UniqueName: \"kubernetes.io/projected/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-kube-api-access-644b8\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.158671 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.158639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-home\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.158671 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.158673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tls-certs\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.158871 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.158718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-dshm\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.158871 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.158747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tmp-dir\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.158871 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.158792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-644b8\" (UniqueName: \"kubernetes.io/projected/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-kube-api-access-644b8\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.159010 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.158882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-model-cache\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.159135 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.159106    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-home\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.159230 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.159177    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tmp-dir\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.159295 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.159223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-model-cache\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.161147 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.161129    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-dshm\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.161414 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.161396    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tls-certs\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.167730 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.167706    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-644b8\" (UniqueName: \"kubernetes.io/projected/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-kube-api-access-644b8\") pod \"auth-test-model-aedad1-kserve-84cc9744cf-mrxjb\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") " pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.259088 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.258995    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:49.404332 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:49.404295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"]
Jul 07 00:15:49.407353 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:15:49.407322    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a6530b4_d49c_4f4a_ae2f_b41b26148a65.slice/crio-aa3ee590c076320f60d15260d2e3f9a1b8db1955284e9d203c01c6c2b118658a WatchSource:0}: Error finding container aa3ee590c076320f60d15260d2e3f9a1b8db1955284e9d203c01c6c2b118658a: Status 404 returned error can't find the container with id aa3ee590c076320f60d15260d2e3f9a1b8db1955284e9d203c01c6c2b118658a
Jul 07 00:15:50.224306 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:50.224272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb" event={"ID":"3a6530b4-d49c-4f4a-ae2f-b41b26148a65","Type":"ContainerStarted","Data":"b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39"}
Jul 07 00:15:50.224306 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:50.224313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb" event={"ID":"3a6530b4-d49c-4f4a-ae2f-b41b26148a65","Type":"ContainerStarted","Data":"aa3ee590c076320f60d15260d2e3f9a1b8db1955284e9d203c01c6c2b118658a"}
Jul 07 00:15:50.243483 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:50.243437    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb" podStartSLOduration=2.243423158 podStartE2EDuration="2.243423158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:50.241990606 +0000 UTC m=+2011.805065250" watchObservedRunningTime="2026-07-07 00:15:50.243423158 +0000 UTC m=+2011.806497790"
Jul 07 00:15:59.259162 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:59.259128    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:59.259617 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:59.259173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:59.272027 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:59.272003    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:15:59.283225 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:15:59.283197    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:17:19.046093 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:17:19.046041    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:17:19.049304 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:17:19.049281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:18:13.925979 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:13.925888    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"]
Jul 07 00:18:28.946895 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:28.946853    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb" podUID="3a6530b4-d49c-4f4a-ae2f-b41b26148a65" containerName="main" containerID="cri-o://b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39" gracePeriod=45
Jul 07 00:18:29.208023 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.207948    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:18:29.278017 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.277980    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-dshm\") pod \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") "
Jul 07 00:18:29.278017 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278020    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tls-certs\") pod \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") "
Jul 07 00:18:29.278310 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-644b8\" (UniqueName: \"kubernetes.io/projected/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-kube-api-access-644b8\") pod \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") "
Jul 07 00:18:29.278310 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-model-cache\") pod \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") "
Jul 07 00:18:29.278310 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278171    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tmp-dir\") pod \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") "
Jul 07 00:18:29.278310 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278208    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-home\") pod \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\" (UID: \"3a6530b4-d49c-4f4a-ae2f-b41b26148a65\") "
Jul 07 00:18:29.278544 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278438    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a6530b4-d49c-4f4a-ae2f-b41b26148a65" (UID: "3a6530b4-d49c-4f4a-ae2f-b41b26148a65"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:18:29.278544 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278507    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a6530b4-d49c-4f4a-ae2f-b41b26148a65" (UID: "3a6530b4-d49c-4f4a-ae2f-b41b26148a65"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:18:29.278544 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.278524    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-home" (OuterVolumeSpecName: "home") pod "3a6530b4-d49c-4f4a-ae2f-b41b26148a65" (UID: "3a6530b4-d49c-4f4a-ae2f-b41b26148a65"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:18:29.280504 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.280479    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-kube-api-access-644b8" (OuterVolumeSpecName: "kube-api-access-644b8") pod "3a6530b4-d49c-4f4a-ae2f-b41b26148a65" (UID: "3a6530b4-d49c-4f4a-ae2f-b41b26148a65"). InnerVolumeSpecName "kube-api-access-644b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:18:29.280709 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.280687    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a6530b4-d49c-4f4a-ae2f-b41b26148a65" (UID: "3a6530b4-d49c-4f4a-ae2f-b41b26148a65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:18:29.280709 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.280693    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-dshm" (OuterVolumeSpecName: "dshm") pod "3a6530b4-d49c-4f4a-ae2f-b41b26148a65" (UID: "3a6530b4-d49c-4f4a-ae2f-b41b26148a65"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:18:29.379297 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.379259    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-model-cache\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:18:29.379297 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.379289    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tmp-dir\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:18:29.379297 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.379297    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-home\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:18:29.379297 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.379305    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-dshm\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:18:29.379569 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.379313    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-tls-certs\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:18:29.379569 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.379321    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-644b8\" (UniqueName: \"kubernetes.io/projected/3a6530b4-d49c-4f4a-ae2f-b41b26148a65-kube-api-access-644b8\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:18:29.995414 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.995378    2581 generic.go:356] "Generic (PLEG): container finished" podID="3a6530b4-d49c-4f4a-ae2f-b41b26148a65" containerID="b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39" exitCode=0
Jul 07 00:18:29.995880 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.995422    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"
Jul 07 00:18:29.995880 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.995477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb" event={"ID":"3a6530b4-d49c-4f4a-ae2f-b41b26148a65","Type":"ContainerDied","Data":"b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39"}
Jul 07 00:18:29.995880 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.995515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb" event={"ID":"3a6530b4-d49c-4f4a-ae2f-b41b26148a65","Type":"ContainerDied","Data":"aa3ee590c076320f60d15260d2e3f9a1b8db1955284e9d203c01c6c2b118658a"}
Jul 07 00:18:29.995880 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:29.995531    2581 scope.go:117] "RemoveContainer" containerID="b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39"
Jul 07 00:18:30.005392 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:30.005372    2581 scope.go:117] "RemoveContainer" containerID="b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39"
Jul 07 00:18:30.005696 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:18:30.005676    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39\": container with ID starting with b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39 not found: ID does not exist" containerID="b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39"
Jul 07 00:18:30.005776 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:30.005708    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39"} err="failed to get container status \"b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39\": rpc error: code = NotFound desc = could not find container \"b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39\": container with ID starting with b2e7b3343f3b3b2705e9f39c3738685c7d93bf0ecef07872051c7adaabdadd39 not found: ID does not exist"
Jul 07 00:18:30.019896 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:30.019859    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"]
Jul 07 00:18:30.026786 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:30.026748    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/auth-test-model-aedad1-kserve-84cc9744cf-mrxjb"]
Jul 07 00:18:30.944393 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:30.944356    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a6530b4-d49c-4f4a-ae2f-b41b26148a65" path="/var/lib/kubelet/pods/3a6530b4-d49c-4f4a-ae2f-b41b26148a65/volumes"
Jul 07 00:18:59.168016 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.167984    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"]
Jul 07 00:18:59.168572 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.168391    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6530b4-d49c-4f4a-ae2f-b41b26148a65" containerName="main"
Jul 07 00:18:59.168572 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.168404    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6530b4-d49c-4f4a-ae2f-b41b26148a65" containerName="main"
Jul 07 00:18:59.168572 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.168488    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6530b4-d49c-4f4a-ae2f-b41b26148a65" containerName="main"
Jul 07 00:18:59.171482 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.171465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.174414 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.174384    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-72fa7c\"/\"kube-root-ca.crt\""
Jul 07 00:18:59.175741 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.175720    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-72fa7c\"/\"sub-test-model-72fa7c-kserve-self-signed-certs\""
Jul 07 00:18:59.175864 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.175765    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-72fa7c\"/\"openshift-service-ca.crt\""
Jul 07 00:18:59.175864 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.175775    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-72fa7c\"/\"default-dockercfg-jjd4n\""
Jul 07 00:18:59.183655 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.183630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"]
Jul 07 00:18:59.233879 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.233848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hjbx\" (UniqueName: \"kubernetes.io/projected/c436000a-6664-4e71-a31d-c626e891782b-kube-api-access-9hjbx\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.234035 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.233909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-home\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.234035 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.233930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-model-cache\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.234035 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.233994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-tmp-dir\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.234168 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.234038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c436000a-6664-4e71-a31d-c626e891782b-tls-certs\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.234168 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.234095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-dshm\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.334809 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.334771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-home\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.334809 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.334813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-model-cache\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.335052 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.334839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-tmp-dir\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.335052 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.334894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c436000a-6664-4e71-a31d-c626e891782b-tls-certs\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.335052 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.335044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-dshm\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.335246 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.335068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hjbx\" (UniqueName: \"kubernetes.io/projected/c436000a-6664-4e71-a31d-c626e891782b-kube-api-access-9hjbx\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.335308 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.335283    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-home\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.335369 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.335332    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-model-cache\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.335369 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.335355    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-tmp-dir\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.337377 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.337353    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-dshm\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.337792 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.337772    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c436000a-6664-4e71-a31d-c626e891782b-tls-certs\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.344994 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.344969    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hjbx\" (UniqueName: \"kubernetes.io/projected/c436000a-6664-4e71-a31d-c626e891782b-kube-api-access-9hjbx\") pod \"sub-test-model-72fa7c-kserve-5966465787-njrv7\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") " pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.480687 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.480588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:18:59.625896 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:18:59.625870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"]
Jul 07 00:18:59.627756 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:18:59.627730    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc436000a_6664_4e71_a31d_c626e891782b.slice/crio-4980966c9e51fcabfc18e654e25ea7548edc265905a483857bcdc002ebe0cab6 WatchSource:0}: Error finding container 4980966c9e51fcabfc18e654e25ea7548edc265905a483857bcdc002ebe0cab6: Status 404 returned error can't find the container with id 4980966c9e51fcabfc18e654e25ea7548edc265905a483857bcdc002ebe0cab6
Jul 07 00:19:00.138017 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:00.137980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7" event={"ID":"c436000a-6664-4e71-a31d-c626e891782b","Type":"ContainerStarted","Data":"9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40"}
Jul 07 00:19:00.138017 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:00.138024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7" event={"ID":"c436000a-6664-4e71-a31d-c626e891782b","Type":"ContainerStarted","Data":"4980966c9e51fcabfc18e654e25ea7548edc265905a483857bcdc002ebe0cab6"}
Jul 07 00:19:00.158799 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:00.158746    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7" podStartSLOduration=1.158730514 podStartE2EDuration="1.158730514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:19:00.157255839 +0000 UTC m=+2201.720330473" watchObservedRunningTime="2026-07-07 00:19:00.158730514 +0000 UTC m=+2201.721805147"
Jul 07 00:19:09.481629 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:09.481577    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:19:09.481629 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:09.481640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:19:09.494041 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:09.494014    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:19:10.197003 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:10.196974    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:19:58.756843 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:19:58.756765    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"]
Jul 07 00:20:04.349673 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.349633    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"]
Jul 07 00:20:04.353759 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.353727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.359778 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.359746    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"rate-test-model-aedad1-kserve-self-signed-certs\""
Jul 07 00:20:04.359934 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.359747    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"default-dockercfg-v94q6\""
Jul 07 00:20:04.359934 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.359757    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"kube-root-ca.crt\""
Jul 07 00:20:04.359934 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.359756    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-aedad1\"/\"openshift-service-ca.crt\""
Jul 07 00:20:04.369742 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.369710    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"]
Jul 07 00:20:04.510742 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.510697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-home\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.510931 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.510755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-model-cache\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.510931 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.510781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tls-certs\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.510931 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.510876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-dshm\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.511049 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.510942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tmp-dir\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.511049 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.510973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrj8g\" (UniqueName: \"kubernetes.io/projected/3896b43e-b3de-4eb1-92b6-d3a960400e0f-kube-api-access-vrj8g\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612113 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.611977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-dshm\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612113 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tmp-dir\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612113 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrj8g\" (UniqueName: \"kubernetes.io/projected/3896b43e-b3de-4eb1-92b6-d3a960400e0f-kube-api-access-vrj8g\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-home\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-model-cache\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tls-certs\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612612 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612588    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tmp-dir\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612680 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-home\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.612680 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.612657    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-model-cache\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.614548 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.614530    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-dshm\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.614828 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.614809    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tls-certs\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.621403 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.621376    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrj8g\" (UniqueName: \"kubernetes.io/projected/3896b43e-b3de-4eb1-92b6-d3a960400e0f-kube-api-access-vrj8g\") pod \"rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") " pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.662436 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.662396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:04.807086 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:04.807041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"]
Jul 07 00:20:04.808730 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:20:04.808706    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3896b43e_b3de_4eb1_92b6_d3a960400e0f.slice/crio-8d2bf5401326636a7b5ad24288568e9b5471c6a00a69766905aad0953ee65db7 WatchSource:0}: Error finding container 8d2bf5401326636a7b5ad24288568e9b5471c6a00a69766905aad0953ee65db7: Status 404 returned error can't find the container with id 8d2bf5401326636a7b5ad24288568e9b5471c6a00a69766905aad0953ee65db7
Jul 07 00:20:05.450019 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:05.449986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn" event={"ID":"3896b43e-b3de-4eb1-92b6-d3a960400e0f","Type":"ContainerStarted","Data":"9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29"}
Jul 07 00:20:05.450489 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:05.450030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn" event={"ID":"3896b43e-b3de-4eb1-92b6-d3a960400e0f","Type":"ContainerStarted","Data":"8d2bf5401326636a7b5ad24288568e9b5471c6a00a69766905aad0953ee65db7"}
Jul 07 00:20:05.469915 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:05.469871    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn" podStartSLOduration=1.4698564539999999 podStartE2EDuration="1.469856454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:20:05.468718072 +0000 UTC m=+2267.031792704" watchObservedRunningTime="2026-07-07 00:20:05.469856454 +0000 UTC m=+2267.032931086"
Jul 07 00:20:13.777661 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:13.777600    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7" podUID="c436000a-6664-4e71-a31d-c626e891782b" containerName="main" containerID="cri-o://9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40" gracePeriod=45
Jul 07 00:20:14.031120 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.031055    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:20:14.204508 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204474    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-dshm\") pod \"c436000a-6664-4e71-a31d-c626e891782b\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") "
Jul 07 00:20:14.204710 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204529    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hjbx\" (UniqueName: \"kubernetes.io/projected/c436000a-6664-4e71-a31d-c626e891782b-kube-api-access-9hjbx\") pod \"c436000a-6664-4e71-a31d-c626e891782b\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") "
Jul 07 00:20:14.204710 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204547    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c436000a-6664-4e71-a31d-c626e891782b-tls-certs\") pod \"c436000a-6664-4e71-a31d-c626e891782b\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") "
Jul 07 00:20:14.204710 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-model-cache\") pod \"c436000a-6664-4e71-a31d-c626e891782b\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") "
Jul 07 00:20:14.204710 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204630    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-tmp-dir\") pod \"c436000a-6664-4e71-a31d-c626e891782b\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") "
Jul 07 00:20:14.204710 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-home\") pod \"c436000a-6664-4e71-a31d-c626e891782b\" (UID: \"c436000a-6664-4e71-a31d-c626e891782b\") "
Jul 07 00:20:14.204998 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204912    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c436000a-6664-4e71-a31d-c626e891782b" (UID: "c436000a-6664-4e71-a31d-c626e891782b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:14.204998 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204929    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-model-cache" (OuterVolumeSpecName: "model-cache") pod "c436000a-6664-4e71-a31d-c626e891782b" (UID: "c436000a-6664-4e71-a31d-c626e891782b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:14.204998 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.204945    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-home" (OuterVolumeSpecName: "home") pod "c436000a-6664-4e71-a31d-c626e891782b" (UID: "c436000a-6664-4e71-a31d-c626e891782b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:14.207010 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.206989    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c436000a-6664-4e71-a31d-c626e891782b-kube-api-access-9hjbx" (OuterVolumeSpecName: "kube-api-access-9hjbx") pod "c436000a-6664-4e71-a31d-c626e891782b" (UID: "c436000a-6664-4e71-a31d-c626e891782b"). InnerVolumeSpecName "kube-api-access-9hjbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:20:14.207263 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.207241    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-dshm" (OuterVolumeSpecName: "dshm") pod "c436000a-6664-4e71-a31d-c626e891782b" (UID: "c436000a-6664-4e71-a31d-c626e891782b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:20:14.207263 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.207247    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c436000a-6664-4e71-a31d-c626e891782b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c436000a-6664-4e71-a31d-c626e891782b" (UID: "c436000a-6664-4e71-a31d-c626e891782b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:20:14.306130 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.306020    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-dshm\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:20:14.306130 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.306052    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hjbx\" (UniqueName: \"kubernetes.io/projected/c436000a-6664-4e71-a31d-c626e891782b-kube-api-access-9hjbx\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:20:14.306130 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.306063    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c436000a-6664-4e71-a31d-c626e891782b-tls-certs\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:20:14.306130 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.306100    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-model-cache\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:20:14.306130 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.306112    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-tmp-dir\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:20:14.306130 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.306121    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c436000a-6664-4e71-a31d-c626e891782b-home\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:20:14.494500 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.494464    2581 generic.go:356] "Generic (PLEG): container finished" podID="c436000a-6664-4e71-a31d-c626e891782b" containerID="9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40" exitCode=0
Jul 07 00:20:14.494701 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.494510    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"
Jul 07 00:20:14.494701 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.494563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7" event={"ID":"c436000a-6664-4e71-a31d-c626e891782b","Type":"ContainerDied","Data":"9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40"}
Jul 07 00:20:14.494701 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.494612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7" event={"ID":"c436000a-6664-4e71-a31d-c626e891782b","Type":"ContainerDied","Data":"4980966c9e51fcabfc18e654e25ea7548edc265905a483857bcdc002ebe0cab6"}
Jul 07 00:20:14.494701 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.494633    2581 scope.go:117] "RemoveContainer" containerID="9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40"
Jul 07 00:20:14.503661 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.503639    2581 scope.go:117] "RemoveContainer" containerID="9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40"
Jul 07 00:20:14.503923 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:20:14.503906    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40\": container with ID starting with 9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40 not found: ID does not exist" containerID="9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40"
Jul 07 00:20:14.503992 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.503932    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40"} err="failed to get container status \"9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40\": rpc error: code = NotFound desc = could not find container \"9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40\": container with ID starting with 9e6b51a94190b34266ba6f9d58eca381ede529791a94f989b762db0d5b566a40 not found: ID does not exist"
Jul 07 00:20:14.516091 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.516050    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"]
Jul 07 00:20:14.519980 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.519958    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-72fa7c/sub-test-model-72fa7c-kserve-5966465787-njrv7"]
Jul 07 00:20:14.662666 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.662572    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:14.662666 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.662632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:14.674910 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.674887    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:20:14.943247 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:14.943215    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c436000a-6664-4e71-a31d-c626e891782b" path="/var/lib/kubelet/pods/c436000a-6664-4e71-a31d-c626e891782b/volumes"
Jul 07 00:20:15.511115 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:20:15.511085    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:21:09.999116 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:09.999012    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"]
Jul 07 00:21:12.717325 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:12.717283    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"]
Jul 07 00:21:12.717744 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:12.717564    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7" podUID="62a5bd88-22a9-463b-8893-9fd3f58798f4" containerName="maas-api" containerID="cri-o://bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533" gracePeriod=30
Jul 07 00:21:12.973984 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:12.973916    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:21:13.023374 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.023342    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls\") pod \"62a5bd88-22a9-463b-8893-9fd3f58798f4\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") "
Jul 07 00:21:13.023566 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.023393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a5bd88-22a9-463b-8893-9fd3f58798f4-openshift-service-ca\") pod \"62a5bd88-22a9-463b-8893-9fd3f58798f4\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") "
Jul 07 00:21:13.023566 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.023478    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpjsr\" (UniqueName: \"kubernetes.io/projected/62a5bd88-22a9-463b-8893-9fd3f58798f4-kube-api-access-lpjsr\") pod \"62a5bd88-22a9-463b-8893-9fd3f58798f4\" (UID: \"62a5bd88-22a9-463b-8893-9fd3f58798f4\") "
Jul 07 00:21:13.023832 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.023802    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a5bd88-22a9-463b-8893-9fd3f58798f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62a5bd88-22a9-463b-8893-9fd3f58798f4" (UID: "62a5bd88-22a9-463b-8893-9fd3f58798f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:21:13.025682 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.025644    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62a5bd88-22a9-463b-8893-9fd3f58798f4" (UID: "62a5bd88-22a9-463b-8893-9fd3f58798f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:21:13.025682 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.025677    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a5bd88-22a9-463b-8893-9fd3f58798f4-kube-api-access-lpjsr" (OuterVolumeSpecName: "kube-api-access-lpjsr") pod "62a5bd88-22a9-463b-8893-9fd3f58798f4" (UID: "62a5bd88-22a9-463b-8893-9fd3f58798f4"). InnerVolumeSpecName "kube-api-access-lpjsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:21:13.124951 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.124909    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpjsr\" (UniqueName: \"kubernetes.io/projected/62a5bd88-22a9-463b-8893-9fd3f58798f4-kube-api-access-lpjsr\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:13.124951 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.124946    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62a5bd88-22a9-463b-8893-9fd3f58798f4-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:13.124951 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.124958    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62a5bd88-22a9-463b-8893-9fd3f58798f4-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:13.777783 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.777748    2581 generic.go:356] "Generic (PLEG): container finished" podID="62a5bd88-22a9-463b-8893-9fd3f58798f4" containerID="bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533" exitCode=0
Jul 07 00:21:13.778307 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.777805    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"
Jul 07 00:21:13.778307 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.777816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7" event={"ID":"62a5bd88-22a9-463b-8893-9fd3f58798f4","Type":"ContainerDied","Data":"bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533"}
Jul 07 00:21:13.778307 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.777863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7" event={"ID":"62a5bd88-22a9-463b-8893-9fd3f58798f4","Type":"ContainerDied","Data":"e18d3b6d341eb635a141eb5c6f9a1d2fbc81394ddcf7f85b91271b829af465d2"}
Jul 07 00:21:13.778307 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.777885    2581 scope.go:117] "RemoveContainer" containerID="bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533"
Jul 07 00:21:13.787978 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.787956    2581 scope.go:117] "RemoveContainer" containerID="bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533"
Jul 07 00:21:13.788301 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:21:13.788280    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533\": container with ID starting with bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533 not found: ID does not exist" containerID="bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533"
Jul 07 00:21:13.788384 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.788315    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533"} err="failed to get container status \"bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533\": rpc error: code = NotFound desc = could not find container \"bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533\": container with ID starting with bb86f87aac5870dfc1a31e6bf41b331d37102d1ec7819176acb7114d10041533 not found: ID does not exist"
Jul 07 00:21:13.800957 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.800931    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"]
Jul 07 00:21:13.805632 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:13.805610    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-aedad1-865696849d-zmdc7"]
Jul 07 00:21:14.943245 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:14.943209    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a5bd88-22a9-463b-8893-9fd3f58798f4" path="/var/lib/kubelet/pods/62a5bd88-22a9-463b-8893-9fd3f58798f4/volumes"
Jul 07 00:21:25.019598 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.019561    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn" podUID="3896b43e-b3de-4eb1-92b6-d3a960400e0f" containerName="main" containerID="cri-o://9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29" gracePeriod=45
Jul 07 00:21:25.278645 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.278588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:21:25.340332 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340297    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-model-cache\") pod \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") "
Jul 07 00:21:25.340332 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-dshm\") pod \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") "
Jul 07 00:21:25.340558 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrj8g\" (UniqueName: \"kubernetes.io/projected/3896b43e-b3de-4eb1-92b6-d3a960400e0f-kube-api-access-vrj8g\") pod \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") "
Jul 07 00:21:25.340558 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340408    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tls-certs\") pod \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") "
Jul 07 00:21:25.340558 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340453    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tmp-dir\") pod \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") "
Jul 07 00:21:25.340558 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-home\") pod \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\" (UID: \"3896b43e-b3de-4eb1-92b6-d3a960400e0f\") "
Jul 07 00:21:25.340753 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340596    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "3896b43e-b3de-4eb1-92b6-d3a960400e0f" (UID: "3896b43e-b3de-4eb1-92b6-d3a960400e0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:21:25.340806 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340740    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3896b43e-b3de-4eb1-92b6-d3a960400e0f" (UID: "3896b43e-b3de-4eb1-92b6-d3a960400e0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:21:25.340806 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340750    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-home" (OuterVolumeSpecName: "home") pod "3896b43e-b3de-4eb1-92b6-d3a960400e0f" (UID: "3896b43e-b3de-4eb1-92b6-d3a960400e0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:21:25.340888 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340832    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tmp-dir\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:25.340888 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340846    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-home\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:25.340888 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.340854    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-model-cache\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:25.342529 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.342499    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-dshm" (OuterVolumeSpecName: "dshm") pod "3896b43e-b3de-4eb1-92b6-d3a960400e0f" (UID: "3896b43e-b3de-4eb1-92b6-d3a960400e0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:21:25.342696 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.342676    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3896b43e-b3de-4eb1-92b6-d3a960400e0f" (UID: "3896b43e-b3de-4eb1-92b6-d3a960400e0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:21:25.342696 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.342677    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3896b43e-b3de-4eb1-92b6-d3a960400e0f-kube-api-access-vrj8g" (OuterVolumeSpecName: "kube-api-access-vrj8g") pod "3896b43e-b3de-4eb1-92b6-d3a960400e0f" (UID: "3896b43e-b3de-4eb1-92b6-d3a960400e0f"). InnerVolumeSpecName "kube-api-access-vrj8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:21:25.442152 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.442116    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3896b43e-b3de-4eb1-92b6-d3a960400e0f-dshm\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:25.442152 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.442147    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrj8g\" (UniqueName: \"kubernetes.io/projected/3896b43e-b3de-4eb1-92b6-d3a960400e0f-kube-api-access-vrj8g\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:25.442348 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.442162    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3896b43e-b3de-4eb1-92b6-d3a960400e0f-tls-certs\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:25.835783 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.835752    2581 generic.go:356] "Generic (PLEG): container finished" podID="3896b43e-b3de-4eb1-92b6-d3a960400e0f" containerID="9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29" exitCode=0
Jul 07 00:21:25.836014 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.835795    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"
Jul 07 00:21:25.836014 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.835827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn" event={"ID":"3896b43e-b3de-4eb1-92b6-d3a960400e0f","Type":"ContainerDied","Data":"9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29"}
Jul 07 00:21:25.836014 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.835872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn" event={"ID":"3896b43e-b3de-4eb1-92b6-d3a960400e0f","Type":"ContainerDied","Data":"8d2bf5401326636a7b5ad24288568e9b5471c6a00a69766905aad0953ee65db7"}
Jul 07 00:21:25.836014 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.835890    2581 scope.go:117] "RemoveContainer" containerID="9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29"
Jul 07 00:21:25.845031 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.845010    2581 scope.go:117] "RemoveContainer" containerID="9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29"
Jul 07 00:21:25.845378 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:21:25.845330    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29\": container with ID starting with 9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29 not found: ID does not exist" containerID="9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29"
Jul 07 00:21:25.845378 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.845363    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29"} err="failed to get container status \"9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29\": rpc error: code = NotFound desc = could not find container \"9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29\": container with ID starting with 9a2eff139fd874d7321d84319bd33b8190f85d30c17c12c050cd108f3da91c29 not found: ID does not exist"
Jul 07 00:21:25.850932 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:21:25.850911    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3896b43e_b3de_4eb1_92b6_d3a960400e0f.slice\": RecentStats: unable to find data in memory cache]"
Jul 07 00:21:25.861471 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.861449    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"]
Jul 07 00:21:25.866153 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:25.866134    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-aedad1/rate-test-model-aedad1-kserve-78bdbc9f47-lb6hn"]
Jul 07 00:21:26.943357 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:26.943318    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3896b43e-b3de-4eb1-92b6-d3a960400e0f" path="/var/lib/kubelet/pods/3896b43e-b3de-4eb1-92b6-d3a960400e0f/volumes"
Jul 07 00:21:55.962368 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:55.962333    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"]
Jul 07 00:21:55.963021 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:55.962569    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp" podUID="f79284db-1036-4309-81b1-5e2a3bc293c5" containerName="maas-api" containerID="cri-o://fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3" gracePeriod=30
Jul 07 00:21:56.221870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.221799    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:21:56.417771 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.417738    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99n4r\" (UniqueName: \"kubernetes.io/projected/f79284db-1036-4309-81b1-5e2a3bc293c5-kube-api-access-99n4r\") pod \"f79284db-1036-4309-81b1-5e2a3bc293c5\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") "
Jul 07 00:21:56.417970 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.417791    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls\") pod \"f79284db-1036-4309-81b1-5e2a3bc293c5\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") "
Jul 07 00:21:56.417970 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.417814    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79284db-1036-4309-81b1-5e2a3bc293c5-openshift-service-ca\") pod \"f79284db-1036-4309-81b1-5e2a3bc293c5\" (UID: \"f79284db-1036-4309-81b1-5e2a3bc293c5\") "
Jul 07 00:21:56.418265 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.418238    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79284db-1036-4309-81b1-5e2a3bc293c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f79284db-1036-4309-81b1-5e2a3bc293c5" (UID: "f79284db-1036-4309-81b1-5e2a3bc293c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:21:56.420153 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.420122    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f79284db-1036-4309-81b1-5e2a3bc293c5-kube-api-access-99n4r" (OuterVolumeSpecName: "kube-api-access-99n4r") pod "f79284db-1036-4309-81b1-5e2a3bc293c5" (UID: "f79284db-1036-4309-81b1-5e2a3bc293c5"). InnerVolumeSpecName "kube-api-access-99n4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:21:56.420253 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.420171    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f79284db-1036-4309-81b1-5e2a3bc293c5" (UID: "f79284db-1036-4309-81b1-5e2a3bc293c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:21:56.519571 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.519481    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99n4r\" (UniqueName: \"kubernetes.io/projected/f79284db-1036-4309-81b1-5e2a3bc293c5-kube-api-access-99n4r\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:56.519571 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.519511    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f79284db-1036-4309-81b1-5e2a3bc293c5-maas-api-tls\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:56.519571 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.519520    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79284db-1036-4309-81b1-5e2a3bc293c5-openshift-service-ca\") on node \"ip-10-0-141-135.ec2.internal\" DevicePath \"\""
Jul 07 00:21:56.988745 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.988711    2581 generic.go:356] "Generic (PLEG): container finished" podID="f79284db-1036-4309-81b1-5e2a3bc293c5" containerID="fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3" exitCode=0
Jul 07 00:21:56.989198 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.988758    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"
Jul 07 00:21:56.989198 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.988798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp" event={"ID":"f79284db-1036-4309-81b1-5e2a3bc293c5","Type":"ContainerDied","Data":"fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3"}
Jul 07 00:21:56.989198 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.988853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp" event={"ID":"f79284db-1036-4309-81b1-5e2a3bc293c5","Type":"ContainerDied","Data":"65e5f579fec0b5f090bb979f8a26bfc0f2b8afe409802ca92005da8d880e3f4a"}
Jul 07 00:21:56.989198 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.988880    2581 scope.go:117] "RemoveContainer" containerID="fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3"
Jul 07 00:21:56.998016 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.997991    2581 scope.go:117] "RemoveContainer" containerID="fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3"
Jul 07 00:21:56.998331 ip-10-0-141-135 kubenswrapper[2581]: E0707 00:21:56.998312    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3\": container with ID starting with fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3 not found: ID does not exist" containerID="fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3"
Jul 07 00:21:56.998383 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:56.998342    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3"} err="failed to get container status \"fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3\": rpc error: code = NotFound desc = could not find container \"fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3\": container with ID starting with fafc0326f587f6c85928ce1eb3abefffaabfbbb58ce3aa338e83b20d8ecd26c3 not found: ID does not exist"
Jul 07 00:21:57.006937 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:57.006899    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"]
Jul 07 00:21:57.008988 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:57.008964    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-72fa7c-7c87bf84bc-5sjzp"]
Jul 07 00:21:58.942384 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:21:58.942348    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f79284db-1036-4309-81b1-5e2a3bc293c5" path="/var/lib/kubelet/pods/f79284db-1036-4309-81b1-5e2a3bc293c5/volumes"
Jul 07 00:22:07.488786 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:07.488758    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9kbjz_d7e17545-9c1f-4967-a037-7893dde433e6/manager/0.log"
Jul 07 00:22:07.612314 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:07.612280    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rh6tc_0b2f4893-bee3-4d9c-810f-5993a9ddb282/manager/0.log"
Jul 07 00:22:07.746371 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:07.746287    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74c7cd457b-4zxz7_3db69ad6-545f-48b6-9e36-a35346187c19/maas-api/0.log"
Jul 07 00:22:08.135711 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:08.135624    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-694cd7b67-xphvj_80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3/manager/0.log"
Jul 07 00:22:08.510266 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:08.510229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-6zhrb_5f5fb811-84c3-442a-b500-f0a3ab4c9a7d/copy-manifests/0.log"
Jul 07 00:22:08.517764 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:08.517737    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-6zhrb_5f5fb811-84c3-442a-b500-f0a3ab4c9a7d/manager/0.log"
Jul 07 00:22:08.909772 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:08.909693    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hkr8c_1a54fef2-76aa-485f-981e-c79358256d0b/postgres/0.log"
Jul 07 00:22:12.184208 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:12.184175    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x846l_878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8/payload-pre-processing/0.log"
Jul 07 00:22:12.319355 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:12.319327    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl6jj_12fccffb-03a0-470d-8fad-f5c946e9d765/payload-processing/0.log"
Jul 07 00:22:12.445865 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:12.445783    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-564bc8fbd9-sfkr9_60199009-fd69-4b69-9cfc-cf7d1b796ee5/router/0.log"
Jul 07 00:22:12.799388 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:12.799310    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rbgnf_02491d49-b5da-425e-a905-cc519b31e0ec/main/0.log"
Jul 07 00:22:13.049551 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:13.049472    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5k4bl_9b4a9751-a97a-4121-b46d-92757bf13029/main/0.log"
Jul 07 00:22:19.075441 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:19.075343    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:22:19.090734 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:19.078940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:22:20.432231 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:20.432198    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5ngh2_eb53126f-6e71-4ae7-9cc7-4bb6234aa3bb/global-pull-secret-syncer/0.log"
Jul 07 00:22:20.617170 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:20.617139    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tbpqg_7ee05db7-407c-4ae3-8853-93838cb15fa7/konnectivity-agent/0.log"
Jul 07 00:22:20.721465 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:20.721389    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-135.ec2.internal_dd626705719bc16cf230177693ed77f5/haproxy/0.log"
Jul 07 00:22:28.450614 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:28.450583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-nnqcf_a52cf257-070d-4088-ac86-64ec27c8411d/cluster-monitoring-operator/0.log"
Jul 07 00:22:28.644323 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:28.644292    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7mvr_83eb7085-bbb9-4114-8f27-66389b8f9b3e/node-exporter/0.log"
Jul 07 00:22:28.666690 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:28.666664    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7mvr_83eb7085-bbb9-4114-8f27-66389b8f9b3e/kube-rbac-proxy/0.log"
Jul 07 00:22:28.689626 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:28.689606    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7mvr_83eb7085-bbb9-4114-8f27-66389b8f9b3e/init-textfile/0.log"
Jul 07 00:22:30.498235 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498199    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"]
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498553    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a5bd88-22a9-463b-8893-9fd3f58798f4" containerName="maas-api"
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498564    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a5bd88-22a9-463b-8893-9fd3f58798f4" containerName="maas-api"
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498577    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f79284db-1036-4309-81b1-5e2a3bc293c5" containerName="maas-api"
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498584    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79284db-1036-4309-81b1-5e2a3bc293c5" containerName="maas-api"
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498599    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3896b43e-b3de-4eb1-92b6-d3a960400e0f" containerName="main"
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498605    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3896b43e-b3de-4eb1-92b6-d3a960400e0f" containerName="main"
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498617    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c436000a-6664-4e71-a31d-c626e891782b" containerName="main"
Jul 07 00:22:30.498622 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498622    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c436000a-6664-4e71-a31d-c626e891782b" containerName="main"
Jul 07 00:22:30.498870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498676    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c436000a-6664-4e71-a31d-c626e891782b" containerName="main"
Jul 07 00:22:30.498870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498685    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a5bd88-22a9-463b-8893-9fd3f58798f4" containerName="maas-api"
Jul 07 00:22:30.498870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498693    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f79284db-1036-4309-81b1-5e2a3bc293c5" containerName="maas-api"
Jul 07 00:22:30.498870 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.498697    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3896b43e-b3de-4eb1-92b6-d3a960400e0f" containerName="main"
Jul 07 00:22:30.501825 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.501801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.505013 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.504996    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rg28k\"/\"default-dockercfg-dqkqt\""
Jul 07 00:22:30.505165 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.505039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg28k\"/\"openshift-service-ca.crt\""
Jul 07 00:22:30.506312 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.506292    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rg28k\"/\"kube-root-ca.crt\""
Jul 07 00:22:30.511200 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.511168    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"]
Jul 07 00:22:30.628693 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.628642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-podres\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.628892 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.628772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z579c\" (UniqueName: \"kubernetes.io/projected/e3cddb83-1bf9-4160-950e-24e621d63bd1-kube-api-access-z579c\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.628892 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.628807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-lib-modules\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.628892 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.628830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-proc\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.628892 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.628859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-sys\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730203 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-podres\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z579c\" (UniqueName: \"kubernetes.io/projected/e3cddb83-1bf9-4160-950e-24e621d63bd1-kube-api-access-z579c\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-lib-modules\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-proc\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-sys\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730377    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-podres\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730410 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730408    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-lib-modules\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730623 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730383    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-proc\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.730623 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.730383    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3cddb83-1bf9-4160-950e-24e621d63bd1-sys\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.736375 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.736356    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-wp4kf_e4823edc-cfe8-4199-be26-cd3b7aa17ef9/networking-console-plugin/0.log"
Jul 07 00:22:30.739113 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.739093    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z579c\" (UniqueName: \"kubernetes.io/projected/e3cddb83-1bf9-4160-950e-24e621d63bd1-kube-api-access-z579c\") pod \"perf-node-gather-daemonset-xxk5f\" (UID: \"e3cddb83-1bf9-4160-950e-24e621d63bd1\") " pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.812383 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.812287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:30.943999 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:30.943975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"]
Jul 07 00:22:30.946411 ip-10-0-141-135 kubenswrapper[2581]: W0707 00:22:30.946382    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode3cddb83_1bf9_4160_950e_24e621d63bd1.slice/crio-ad7273e3c48752678ed80e55bafa78993229cd82567a0520dae4a703582309ed WatchSource:0}: Error finding container ad7273e3c48752678ed80e55bafa78993229cd82567a0520dae4a703582309ed: Status 404 returned error can't find the container with id ad7273e3c48752678ed80e55bafa78993229cd82567a0520dae4a703582309ed
Jul 07 00:22:31.148768 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:31.148669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f" event={"ID":"e3cddb83-1bf9-4160-950e-24e621d63bd1","Type":"ContainerStarted","Data":"01ba69c7503f117b0ae2222705c14270c237216e58c15b8c7a6f18977f5d4353"}
Jul 07 00:22:31.148768 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:31.148721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f" event={"ID":"e3cddb83-1bf9-4160-950e-24e621d63bd1","Type":"ContainerStarted","Data":"ad7273e3c48752678ed80e55bafa78993229cd82567a0520dae4a703582309ed"}
Jul 07 00:22:31.148968 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:31.148771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:31.168019 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:31.167965    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f" podStartSLOduration=1.1679493220000001 podStartE2EDuration="1.167949322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:22:31.166699407 +0000 UTC m=+2412.729774040" watchObservedRunningTime="2026-07-07 00:22:31.167949322 +0000 UTC m=+2412.731023987"
Jul 07 00:22:31.313344 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:31.313306    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/1.log"
Jul 07 00:22:31.317751 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:31.317734    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pr4j6_9e62260e-42e4-428d-b1bd-1fd5abb4c5e5/console-operator/2.log"
Jul 07 00:22:32.362133 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:32.362101    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-6fqnp_b35e4cf1-62eb-48c9-8f8e-c96fd76ac249/volume-data-source-validator/0.log"
Jul 07 00:22:33.504264 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:33.504233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gv9xc_b5f5d941-3bd4-4de7-bdfd-1102b287a465/dns/0.log"
Jul 07 00:22:33.526064 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:33.526037    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gv9xc_b5f5d941-3bd4-4de7-bdfd-1102b287a465/kube-rbac-proxy/0.log"
Jul 07 00:22:33.630451 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:33.630426    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4zmkt_5ff51189-b638-4fe8-8fa0-fbc7cd197639/dns-node-resolver/0.log"
Jul 07 00:22:34.321260 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:34.321233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvqqp_d3353df0-539e-4d70-b25d-51ca45b40093/node-ca/0.log"
Jul 07 00:22:35.591107 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:35.591066    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x846l_878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8/payload-pre-processing/0.log"
Jul 07 00:22:35.626429 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:35.626399    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl6jj_12fccffb-03a0-470d-8fad-f5c946e9d765/payload-processing/0.log"
Jul 07 00:22:35.648800 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:35.648776    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-564bc8fbd9-sfkr9_60199009-fd69-4b69-9cfc-cf7d1b796ee5/router/0.log"
Jul 07 00:22:36.389918 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:36.389889    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbgpl_2810faf7-3674-4286-9266-a034c71c86b4/serve-healthcheck-canary/0.log"
Jul 07 00:22:36.853235 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:36.853203    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mzzc9_5005f58d-c89e-4ed4-8e6d-44a0b1276564/insights-operator/0.log"
Jul 07 00:22:36.853665 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:36.853451    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mzzc9_5005f58d-c89e-4ed4-8e6d-44a0b1276564/insights-operator/1.log"
Jul 07 00:22:36.947950 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:36.947920    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8vhw_3229f575-4f59-4884-b78a-effff7a0d69d/kube-rbac-proxy/0.log"
Jul 07 00:22:36.971393 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:36.971366    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8vhw_3229f575-4f59-4884-b78a-effff7a0d69d/exporter/0.log"
Jul 07 00:22:36.993310 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:36.993281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8vhw_3229f575-4f59-4884-b78a-effff7a0d69d/extractor/0.log"
Jul 07 00:22:37.164586 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:37.164512    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rg28k/perf-node-gather-daemonset-xxk5f"
Jul 07 00:22:39.487557 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:39.487531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9kbjz_d7e17545-9c1f-4967-a037-7893dde433e6/manager/0.log"
Jul 07 00:22:39.625852 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:39.625815    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rh6tc_0b2f4893-bee3-4d9c-810f-5993a9ddb282/manager/0.log"
Jul 07 00:22:39.665273 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:39.665191    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74c7cd457b-4zxz7_3db69ad6-545f-48b6-9e36-a35346187c19/maas-api/0.log"
Jul 07 00:22:39.818945 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:39.818908    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-694cd7b67-xphvj_80f826d1-bfa6-4d5c-a82f-17a8d9cef6f3/manager/0.log"
Jul 07 00:22:39.957050 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:39.957020    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-6zhrb_5f5fb811-84c3-442a-b500-f0a3ab4c9a7d/manager/0.log"
Jul 07 00:22:39.982379 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:39.982354    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bfc4f9689-6zhrb_5f5fb811-84c3-442a-b500-f0a3ab4c9a7d/copy-manifests/0.log"
Jul 07 00:22:40.187482 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:40.187445    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hkr8c_1a54fef2-76aa-485f-981e-c79358256d0b/postgres/0.log"
Jul 07 00:22:41.563464 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:41.563436    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58544fcc46-hdjbt_ce8e4fac-869d-42b1-a2ac-16c7e679550a/manager/0.log"
Jul 07 00:22:41.795146 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:41.795044    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x846l_878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8/payload-pre-processing/0.log"
Jul 07 00:22:41.815771 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:41.815741    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl6jj_12fccffb-03a0-470d-8fad-f5c946e9d765/payload-processing/0.log"
Jul 07 00:22:41.831040 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:41.831016    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-564bc8fbd9-sfkr9_60199009-fd69-4b69-9cfc-cf7d1b796ee5/router/0.log"
Jul 07 00:22:43.243978 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:43.243942    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-x846l_878f8ff6-ba3b-428c-bd2a-bbf0a8874aa8/payload-pre-processing/0.log"
Jul 07 00:22:43.276811 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:43.276780    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cl6jj_12fccffb-03a0-470d-8fad-f5c946e9d765/payload-processing/0.log"
Jul 07 00:22:43.294356 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:43.294326    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-564bc8fbd9-sfkr9_60199009-fd69-4b69-9cfc-cf7d1b796ee5/router/0.log"
Jul 07 00:22:46.687100 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:46.687042    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-6jvqf_44354eec-8a4a-45bf-b0d5-927361975a5a/migrator/0.log"
Jul 07 00:22:46.711577 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:46.711545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-6jvqf_44354eec-8a4a-45bf-b0d5-927361975a5a/graceful-termination/0.log"
Jul 07 00:22:47.083102 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:47.083057    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-9zbgd_2cb7fb66-e9d3-465c-96c3-2b1267c185d4/kube-storage-version-migrator-operator/1.log"
Jul 07 00:22:47.083815 ip-10-0-141-135 kubenswrapper[2581]: I0707 00:22:47.083797    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-9zbgd_2cb7fb66-e9d3-465c-96c3-2b1267c185d4/kube-storage-version-migrator-operator/0.log"