Jul 23 11:09:44.835006 ip-10-0-132-77 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 11:09:45.259095 ip-10-0-132-77 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 11:09:45.259095 ip-10-0-132-77 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 11:09:45.259095 ip-10-0-132-77 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 11:09:45.259095 ip-10-0-132-77 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 11:09:45.259095 ip-10-0-132-77 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 11:09:45.259095 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.254539    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259879    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259893    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259899    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259904    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259909    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259914    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259918    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259925    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259930    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259935    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259941    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259947    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259958    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259963    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259970    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259974    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259979    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259983    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259988    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:09:45.261859 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259992    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.259997    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260002    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260008    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260012    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260017    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260022    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260026    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260031    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260035    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260040    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260044    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260048    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260052    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260055    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260067    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260071    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260075    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260080    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260090    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:09:45.263990 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260094    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260099    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260103    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260107    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260111    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260115    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260119    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260121    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260124    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260127    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260130    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260133    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260135    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260138    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260140    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260143    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260146    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260149    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260151    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260154    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:09:45.266217 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260156    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260159    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260163    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260166    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260169    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260171    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260174    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260177    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260180    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260182    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260185    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260188    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260192    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260195    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260198    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260201    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260203    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260206    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260209    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260212    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:09:45.267994 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260214    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260217    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260221    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260226    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260230    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260232    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260236    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260239    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260241    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260244    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260246    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260250    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260254    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260257    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260260    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260264    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260268    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260271    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260274    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:09:45.281884 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.260277    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261077    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261084    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261087    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261092    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261095    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261100    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261103    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261106    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261109    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261112    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261114    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261117    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261120    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261125    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261129    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261132    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261135    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261138    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:09:45.332233 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261141    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:09:45.331872 ip-10-0-132-77 systemd[1]: Started Kubernetes Kubelet.
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261144    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261147    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261150    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261153    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261155    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261158    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261160    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261164    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261168    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261172    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261175    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261178    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261181    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261183    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261186    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261188    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261193    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261196    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261199    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:09:45.353947 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261202    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261205    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261208    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261210    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261213    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261216    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261219    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261222    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261225    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261227    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261230    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261232    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261235    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261239    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261242    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261245    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261248    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261250    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261252    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261256    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:09:45.594839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261259    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261261    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261265    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261268    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261271    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261274    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261276    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261279    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261281    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261285    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261288    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261290    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261293    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261296    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261299    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261302    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261304    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261307    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261310    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261312    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:09:45.610187 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261314    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261317    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261319    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261322    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261324    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261327    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261329    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261332    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261335    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261338    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261340    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261343    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261345    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261348    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261350    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261352    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261355    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261357    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261360    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:09:45.611457 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261362    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261365    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261798    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261807    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261811    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261818    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261824    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261829    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261833    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261840    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261844    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261848    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261852    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261856    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261860    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261864    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261868    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261872    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261877    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:09:45.612426 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261881    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261885    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261889    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261893    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261897    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261901    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261905    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261909    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261913    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261917    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261921    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261926    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261930    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261934    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261939    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261943    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261947    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261952    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261956    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:09:45.613244 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261961    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261967    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261971    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261976    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261980    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261984    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261988    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261992    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.261996    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262001    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262006    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262010    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262014    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262018    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262022    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262028    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262034    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262039    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262044    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262048    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:09:45.614050 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262052    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262057    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262061    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262065    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262070    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262073    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262078    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262082    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262086    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262090    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262094    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262099    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262103    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262107    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262112    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262117    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262121    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262125    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262129    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262134    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:09:45.615087 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262138    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262142    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262146    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262150    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262154    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262158    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262162    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262166    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262170    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262176    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262180    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262184    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262188    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262193    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262197    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262201    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262207    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262211    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262215    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:09:45.615720 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262219    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262223    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262228    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.262232    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262339    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262350    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262363    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262370    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262385    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262392    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262399    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262406    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262411    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262415    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262421    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262426    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262435    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262440    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262445    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262450    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262454    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262458    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262470    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262475    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 11:09:45.616318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262481    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262486    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262491    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262497    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262502    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262507    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262513    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262518    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262523    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262528    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262532    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262537    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262543    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262548    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262555    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262560    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262565    2573 flags.go:64] FLAG: --enable-server="true"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262579    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262590    2573 flags.go:64] FLAG: --event-burst="100"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262595    2573 flags.go:64] FLAG: --event-qps="50"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262599    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262605    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262609    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262616    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 11:09:45.617033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262623    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262628    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262633    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262638    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262642    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262647    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262652    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262656    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262660    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262665    2573 flags.go:64] FLAG: --feature-gates=""
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262671    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262676    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262681    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262686    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262691    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262696    2573 flags.go:64] FLAG: --help="false"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262700    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262705    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262709    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262713    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262718    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262723    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262728    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 11:09:45.617696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262732    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262757    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262763    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262776    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262782    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262786    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262791    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262795    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262799    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262803    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262807    2573 flags.go:64] FLAG: --lock-file=""
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262809    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262812    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262816    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262822    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262826    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262829    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262832    2573 flags.go:64] FLAG: --logging-format="text"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262835    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262840    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262843    2573 flags.go:64] FLAG: --manifest-url=""
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262846    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262851    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262854    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262858    2573 flags.go:64] FLAG: --max-pods="110"
Jul 23 11:09:45.618431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262861    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262864    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262867    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262870    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262873    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262876    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262879    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262887    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262890    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262893    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262896    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262900    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262906    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262909    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262912    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262915    2573 flags.go:64] FLAG: --port="10250"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262918    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262923    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aadcecf683a82ee9"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262926    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262929    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262932    2573 flags.go:64] FLAG: --register-node="true"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262935    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262938    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262941    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 23 11:09:45.619147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262944    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262947    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262952    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262956    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262958    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262962    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262965    2573 flags.go:64] FLAG: --runonce="false"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262967    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262971    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262974    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262977    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262979    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262982    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262985    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262989    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262991    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262994    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.262997    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263001    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263005    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263011    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263014    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263020    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263023    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263026    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 11:09:45.619877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263032    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263035    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263038    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263042    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263045    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263048    2573 flags.go:64] FLAG: --v="2"
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263052    2573 flags.go:64] FLAG: --version="false"
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263056    2573 flags.go:64] FLAG: --vmodule=""
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263060    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263064    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263200    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263205    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263208    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263213    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263217    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263221    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263223    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263226    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263230    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263232    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263235    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:09:45.620550 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263239    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263243    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263246    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263249    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263254    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263257    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263260    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263265    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263268    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263271    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263273    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263278    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263281    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263283    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263286    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263314    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263331    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263337    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263341    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:09:45.621237 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263345    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263350    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263353    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263356    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263361    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263364    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263367    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263371    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263374    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263377    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263381    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263386    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263389    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263394    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263397    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263400    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263403    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263407    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263410    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:09:45.621821 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263413    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263417    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263425    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263428    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263432    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263436    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263439    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263442    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263445    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263447    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263452    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263456    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263461    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263465    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263468    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263470    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263474    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263478    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263481    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263484    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263488    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:09:45.622362 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263490    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263496    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263502    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263505    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263509    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263513    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263516    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263518    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263522    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263525    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263528    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263531    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263535    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263539    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263542    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263545    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263549    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263552    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263554    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:09:45.622934 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263558    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263561    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263564    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263568    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263572    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263575    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263578    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263582    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263585    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.263587    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.263594    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.272234    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.272251    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.272267    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 11:09:45.623467 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.272275    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272329    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272334    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272338    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272340    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272343    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272346    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272349    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272352    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272355    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272358    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272361    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272363    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272366    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272369    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272371    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272374    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272377    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272379    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272383    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:09:45.626055 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272386    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272388    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272392    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272395    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272397    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272400    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272402    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272405    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272407    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272410    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272412    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272415    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272417    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272420    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272423    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272426    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272428    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272431    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272433    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272436    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:09:45.627059 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272438    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272440    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272443    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272445    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272448    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272450    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272453    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272455    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272458    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272460    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272465    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272468    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272471    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272474    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272476    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272480    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272483    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272485    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272488    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272490    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:09:45.785288 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272493    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272495    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272498    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272501    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272503    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272505    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272508    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272511    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272513    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272515    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272518    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272520    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272524    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272527    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272530    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272533    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272536    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272538    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272541    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:09:45.785983 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272543    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272546    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272548    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272550    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272553    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272555    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272558    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272561    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272563    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272568    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272572    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272576    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272579    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272582    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272584    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272587    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272589    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272592    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272594    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:09:45.786505 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272597    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272599    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.272605    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272710    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272715    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272719    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272722    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272724    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272728    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272731    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272733    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272736    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272758    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272762    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:09:45.787073 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272766    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272768    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272771    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272774    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272777    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272780    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272783    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272785    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272788    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272793    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272796    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272799    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272802    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272804    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272807    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272810    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272812    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272815    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272817    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272820    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:09:45.787463 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272823    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272825    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272828    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272830    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272833    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272835    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272838    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272842    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272845    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272848    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272851    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272853    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272856    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272858    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272861    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272863    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272866    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272868    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272871    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272873    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:09:45.788041 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272876    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272879    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272883    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272885    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272888    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272890    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272893    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272895    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272898    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272901    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272903    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272905    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272908    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272910    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272913    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272915    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272919    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272922    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272924    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:09:45.788573 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272926    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272929    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272932    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272934    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272937    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272939    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272941    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272944    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272946    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272949    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272951    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272953    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272956    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272958    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272963    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272965    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272968    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272972    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272976    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:09:45.789139 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272979    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272982    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272985    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272988    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272990    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272993    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272995    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.272997    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.273000    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:45.273002    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.273009    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.273113    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.275946    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.277293    2573 server.go:1019] "Starting client certificate rotation"
Jul 23 11:09:45.789668 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.277392    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.277431    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.279687    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.284245    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.294626    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.297526    2573 log.go:25] "Validated CRI v1 image API"
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.300420    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.302513    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9cc6d11e-3872-4a30-9d04-c53567d47edb:/dev/nvme0n1p4 e666da87-77e8-4d4c-8bc5-f796364eef61:/dev/nvme0n1p3]
Jul 23 11:09:45.790117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.302534    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.307855    2573 manager.go:216] Machine: {Timestamp:2026-07-23 11:09:45.306500783 +0000 UTC m=+0.352597888 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100523 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b4f15503c13978ece328d7b7d6e49 SystemUUID:ec2b4f15-503c-1397-8ece-328d7b7d6e49 BootID:9bc9b7b8-ab03-4633-b54e-499a2bf538c0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:f1:71:28:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:f1:71:28:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:43:91:a2:8c:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.307957    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.308039    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.310899    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.310928    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.311829    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.311843    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.311854    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.311861    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.312724    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.315402    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.319397    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.319526    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.319553    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.319563    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.319574    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 11:09:45.790445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.319582    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.319591    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.320087    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.320120    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.322310    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.325322    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.325353    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326625    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326638    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326645    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326650    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326659    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326664    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326671    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326677    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326683    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326688    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326696    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.326702    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.327437    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.327444    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.331062    2573 server.go:1268] "Started kubelet"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.331509    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.332215    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.332291    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.332708    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.332874    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.332930    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.333612    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.334288    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.335912    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-77.ec2.internal.18c4e6ad8800ab64  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-77.ec2.internal,UID:ip-10-0-132-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-77.ec2.internal,},FirstTimestamp:2026-07-23 11:09:45.33103498 +0000 UTC m=+0.377132072,LastTimestamp:2026-07-23 11:09:45.33103498 +0000 UTC m=+0.377132072,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-77.ec2.internal,}"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.337182    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.340757    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.340763    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.340885    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341533    2573 factory.go:55] Registering systemd factory
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341571    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341664    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341694    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341707    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341820    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 11:09:45.790966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341834    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341929    2573 factory.go:153] Registering CRI-O factory
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341947    2573 factory.go:223] Registration of the crio container factory successfully
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.341997    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.342017    2573 factory.go:103] Registering Raw factory
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.342032    2573 manager.go:1196] Started watching for new ooms in manager
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.342551    2573 manager.go:349] Starting recovery of all containers
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.354413    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.354569    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.355596    2573 manager.go:354] Recovery completed
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.361037    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.362715    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8vg9"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.363585    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.363615    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.363628    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.364191    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.364200    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.364216    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.364199    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.365309    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.365337    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.365350    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.365945    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-77.ec2.internal.18c4e6ad89f19080  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-77.ec2.internal,UID:ip-10-0-132-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-77.ec2.internal,},FirstTimestamp:2026-07-23 11:09:45.363599488 +0000 UTC m=+0.409696599,LastTimestamp:2026-07-23 11:09:45.363599488 +0000 UTC m=+0.409696599,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-77.ec2.internal,}"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.366401    2573 policy_none.go:49] "None policy: Start"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.366415    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.366427    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.368401    2573 policy_none.go:47] "Start"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.372597    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8vg9"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.378308    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-77.ec2.internal.18c4e6ad89f1e9d0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-77.ec2.internal,UID:ip-10-0-132-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-77.ec2.internal,},FirstTimestamp:2026-07-23 11:09:45.363622352 +0000 UTC m=+0.409719462,LastTimestamp:2026-07-23 11:09:45.363622352 +0000 UTC m=+0.409719462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-77.ec2.internal,}"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.438390    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.439585    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.439622    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 11:09:45.792074 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.439646    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.439685    2573 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.440915    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.442354    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.443424    2573 manager.go:337] "Starting Device Plugin manager"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.443452    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.443461    2573 server.go:87] "Starting device plugin registration server"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.443735    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.443762    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.443855    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.443952    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.443965    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.444294    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.444349    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.540668    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal"]
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.540774    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.541760    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.541795    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.541804    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.542147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec13888fcd0d268cc5722f2014f6efe0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal\" (UID: \"ec13888fcd0d268cc5722f2014f6efe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.542168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec13888fcd0d268cc5722f2014f6efe0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal\" (UID: \"ec13888fcd0d268cc5722f2014f6efe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544091    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544104    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544180    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544200    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544860    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544884    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544898    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.544922    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.545456    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.545484    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.545493    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.545462    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.545549    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.545564    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.547726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.547766    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.548612    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:45.792946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.548634    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.548644    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.557668    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.557684    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-77.ec2.internal\": node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.584538    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-77.ec2.internal\" not found" node="ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.589199    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-77.ec2.internal\" not found" node="ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.630509    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.642620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec13888fcd0d268cc5722f2014f6efe0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal\" (UID: \"ec13888fcd0d268cc5722f2014f6efe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.642644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec13888fcd0d268cc5722f2014f6efe0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal\" (UID: \"ec13888fcd0d268cc5722f2014f6efe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.642700    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec13888fcd0d268cc5722f2014f6efe0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal\" (UID: \"ec13888fcd0d268cc5722f2014f6efe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.642708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec13888fcd0d268cc5722f2014f6efe0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal\" (UID: \"ec13888fcd0d268cc5722f2014f6efe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.731286    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:45.794022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.742848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b32f8d5cefe9b5ce058a0460b5a27a5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-77.ec2.internal\" (UID: \"4b32f8d5cefe9b5ce058a0460b5a27a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.905473 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.832375    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:45.905473 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.843728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b32f8d5cefe9b5ce058a0460b5a27a5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-77.ec2.internal\" (UID: \"4b32f8d5cefe9b5ce058a0460b5a27a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.905473 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.843825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b32f8d5cefe9b5ce058a0460b5a27a5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-77.ec2.internal\" (UID: \"4b32f8d5cefe9b5ce058a0460b5a27a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.905473 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.887876    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:45.905473 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:45.892542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:46.065509 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:45.933163    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:46.065509 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:46.033724    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:46.222850 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:46.134184    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:46.364071 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:46.234672    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:46.364071 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.277045    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 11:09:46.364071 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.277211    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 11:09:46.364071 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:46.335193    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:46.495961 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.377914    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 11:04:45 +0000 UTC" deadline="2028-02-04 00:51:01.071107419 +0000 UTC"
Jul 23 11:09:46.495961 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.377936    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13453h41m14.693174152s"
Jul 23 11:09:46.495961 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.415341    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:09:46.495961 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:46.435449    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:46.626716 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.535760    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:09:46.626716 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:46.535774    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-77.ec2.internal\" not found"
Jul 23 11:09:46.626716 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.536802    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:09:46.626716 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.536834    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:09:46.626716 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.536845    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:09:46.626716 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.598188    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:09:46.732166 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.642883    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:46.732166 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.666646    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 11:09:46.732166 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.667846    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal"
Jul 23 11:09:46.732166 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.677966    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 11:09:46.732166 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.706481    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:09:47.101049 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:46.974880    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec13888fcd0d268cc5722f2014f6efe0.slice/crio-bd36815e3e536b23a4ea9b26546f34a38abe0aafe58a803d77e4242e0d6c2567 WatchSource:0}: Error finding container bd36815e3e536b23a4ea9b26546f34a38abe0aafe58a803d77e4242e0d6c2567: Status 404 returned error can't find the container with id bd36815e3e536b23a4ea9b26546f34a38abe0aafe58a803d77e4242e0d6c2567
Jul 23 11:09:47.101049 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:46.978834    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:09:47.109640 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.109299    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:09:47.220464 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.133808    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b32f8d5cefe9b5ce058a0460b5a27a5.slice/crio-6ca5309b6183addb0ecd4f43e3f413c08162154de371dd1d1cbd7a9cb2f8f1eb WatchSource:0}: Error finding container 6ca5309b6183addb0ecd4f43e3f413c08162154de371dd1d1cbd7a9cb2f8f1eb: Status 404 returned error can't find the container with id 6ca5309b6183addb0ecd4f43e3f413c08162154de371dd1d1cbd7a9cb2f8f1eb
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.320845    2573 apiserver.go:52] "Watching apiserver"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.328419    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.329696    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2wpkx","kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h","openshift-cluster-node-tuning-operator/tuned-smtk2","openshift-image-registry/node-ca-bc655","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal","openshift-multus/multus-szjts","openshift-multus/network-metrics-daemon-kt2sk","kube-system/konnectivity-agent-6swv4","openshift-dns/node-resolver-v4ksk","openshift-multus/multus-additional-cni-plugins-6x45g","openshift-network-diagnostics/network-check-target-l4lf4","openshift-network-operator/iptables-alerter-bbj69","openshift-ovn-kubernetes/ovnkube-node-299gm"]
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.332423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.336012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.337546    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.338674    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.339420    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.341496    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.341663    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.343712    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.345953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.348150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.348565 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.348203    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.350460    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-host\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-etc-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350589    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-sys-fs\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-kubernetes\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-node-log\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-cni-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-daemon-config\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjtr\" (UniqueName: \"kubernetes.io/projected/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-kube-api-access-qrjtr\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0126b195-0b10-4b0f-91e4-58459b6cde01-iptables-alerter-script\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-socket-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350806    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-registration-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8k6\" (UniqueName: \"kubernetes.io/projected/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-kube-api-access-8w8k6\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-kubelet\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.420372 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-cni-bin\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-host\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-os-release\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-cnibin\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-systemd\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.350978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-tmp\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-log-socket\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-cni-netd\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-modprobe-d\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-sys\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-slash\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovn-node-metrics-cert\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-kubelet\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351158    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysconfig\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351176    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-var-lib-kubelet\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovnkube-script-lib\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffh5s\" (UniqueName: \"kubernetes.io/projected/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-kube-api-access-ffh5s\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.422287 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-cni-binary-copy\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0126b195-0b10-4b0f-91e4-58459b6cde01-host-slash\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysctl-d\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-tuned\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-systemd-units\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-env-overrides\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9zjq\" (UniqueName: \"kubernetes.io/projected/0126b195-0b10-4b0f-91e4-58459b6cde01-kube-api-access-r9zjq\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-lib-modules\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-var-lib-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-serviceca\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-run-netns\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-ovn\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysctl-conf\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-system-cni-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.423154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-cni-multus\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-etc-kubernetes\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-netns\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-device-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-run\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-systemd\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjk4s\" (UniqueName: \"kubernetes.io/projected/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-kube-api-access-rjk4s\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351803    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-socket-dir-parent\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc4vd\" (UniqueName: \"kubernetes.io/projected/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-kube-api-access-nc4vd\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351866    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovnkube-config\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-k8s-cni-cncf-io\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-hostroot\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-conf-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-multus-certs\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.351962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-cni-bin\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.352646    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.424453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.354818    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.356996    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.357051    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.362734    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.362782    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.362869    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w6xbc\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.362905    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.362964    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363157    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zkn2r\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363203    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363220    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363314    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363337    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363419    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ftpzq\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363496    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363526    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363542    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363676    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2jx2j\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363708    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363769    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363881    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363889    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q2ztt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363903    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363931    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363885    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7n6f\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.363884    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.364782    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2n6rh\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.364873    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.365117    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.365171    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.365579    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.366049    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.366150    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8p45v\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.366420    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.366488    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.366588    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 11:09:47.425330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.366735    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lxvpr\""
Jul 23 11:09:47.427283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.366845    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 11:09:47.446503 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.446470    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 11:09:47.446734 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.446511    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4c2qx"
Jul 23 11:09:47.447350 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.447329    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 11:09:47.448737 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.448681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal" event={"ID":"4b32f8d5cefe9b5ce058a0460b5a27a5","Type":"ContainerStarted","Data":"6ca5309b6183addb0ecd4f43e3f413c08162154de371dd1d1cbd7a9cb2f8f1eb"}
Jul 23 11:09:47.449982 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.449950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal" event={"ID":"ec13888fcd0d268cc5722f2014f6efe0","Type":"ContainerStarted","Data":"bd36815e3e536b23a4ea9b26546f34a38abe0aafe58a803d77e4242e0d6c2567"}
Jul 23 11:09:47.452157 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysconfig\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.452254 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-var-lib-kubelet\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.452254 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovnkube-script-lib\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.452254 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffh5s\" (UniqueName: \"kubernetes.io/projected/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-kube-api-access-ffh5s\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.452254 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-cni-binary-copy\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0126b195-0b10-4b0f-91e4-58459b6cde01-host-slash\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452283    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-var-lib-kubelet\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysctl-d\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysctl-d\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452454    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0126b195-0b10-4b0f-91e4-58459b6cde01-host-slash\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-tuned\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-systemd-units\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-env-overrides\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.452675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9zjq\" (UniqueName: \"kubernetes.io/projected/0126b195-0b10-4b0f-91e4-58459b6cde01-kube-api-access-r9zjq\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452676    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-systemd-units\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae831ed-40dd-4963-a986-39bd625bc6b2-agent-certs\") pod \"konnectivity-agent-6swv4\" (UID: \"6ae831ed-40dd-4963-a986-39bd625bc6b2\") " pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-lib-modules\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-var-lib-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-serviceca\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-run-netns\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452873    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-ovn\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-cni-binary-copy\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42b0290a-0169-43a6-bc50-7ef9f3a83307-kubelet-config\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452988    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-lib-modules\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysctl-conf\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.453099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453035    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-var-lib-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-system-cni-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-env-overrides\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-cni-multus\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453082    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-system-cni-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qdss\" (UniqueName: \"kubernetes.io/projected/aab107ec-362a-46b6-8bf0-cd3bebfcc169-kube-api-access-8qdss\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-run-netns\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-etc-kubernetes\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab107ec-362a-46b6-8bf0-cd3bebfcc169-tmp-dir\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-netns\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysctl-conf\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-device-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453246    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453257    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-netns\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-etc-kubernetes\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-ovn\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-run\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-device-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.453850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453307    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-sysconfig\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453317    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-cni-multus\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-systemd\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.452879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovnkube-script-lib\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42b0290a-0169-43a6-bc50-7ef9f3a83307-dbus\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-run-systemd\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9gbg\" (UniqueName: \"kubernetes.io/projected/07af3fec-8472-46a7-9bb6-3c398effb78a-kube-api-access-x9gbg\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-run\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae831ed-40dd-4963-a986-39bd625bc6b2-konnectivity-ca\") pod \"konnectivity-agent-6swv4\" (UID: \"6ae831ed-40dd-4963-a986-39bd625bc6b2\") " pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjk4s\" (UniqueName: \"kubernetes.io/projected/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-kube-api-access-rjk4s\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453460    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-serviceca\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-socket-dir-parent\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc4vd\" (UniqueName: \"kubernetes.io/projected/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-kube-api-access-nc4vd\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-socket-dir-parent\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovnkube-config\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-k8s-cni-cncf-io\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.454686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453584    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-hostroot\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453624    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-hostroot\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-conf-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-multus-certs\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-conf-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453698    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-k8s-cni-cncf-io\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-cni-bin\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453733    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-cni-bin\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-run-multus-certs\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-cni-binary-copy\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453841    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453887    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-host\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.455491 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-etc-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453949    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-system-cni-dir\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453968    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453974    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.453987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-host\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-sys-fs\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454038    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovnkube-config\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-kubernetes\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-etc-openvswitch\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-node-log\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454075    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-sys-fs\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-kubernetes\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454105    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-cni-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-node-log\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-daemon-config\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjtr\" (UniqueName: \"kubernetes.io/projected/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-kube-api-access-qrjtr\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0126b195-0b10-4b0f-91e4-58459b6cde01-iptables-alerter-script\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.456377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-cni-dir\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab107ec-362a-46b6-8bf0-cd3bebfcc169-hosts-file\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-socket-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-registration-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8k6\" (UniqueName: \"kubernetes.io/projected/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-kube-api-access-8w8k6\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-kubelet\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454351    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-registration-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454397    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-socket-dir\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-cni-bin\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-kubelet\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-cni-bin\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-cnibin\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-os-release\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-host\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0126b195-0b10-4b0f-91e4-58459b6cde01-iptables-alerter-script\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-os-release\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:47.456957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-cnibin\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-systemd\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-tmp\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-log-socket\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-cni-netd\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcffr\" (UniqueName: \"kubernetes.io/projected/5590e4e5-e701-4509-bea1-6b76bc99f091-kube-api-access-dcffr\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454928    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-modprobe-d\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454982    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-sys\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-multus-daemon-config\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-slash\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455043    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-slash\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovn-node-metrics-cert\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454800    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-os-release\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-kubelet\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-systemd\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455156    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-host-var-lib-kubelet\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455372    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-log-socket\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.457606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-host-cni-netd\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.458411 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455514    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-modprobe-d\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.458411 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-sys\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.458411 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.454793    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-host\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.458411 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.455627    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-cnibin\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.465044 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.465020    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-tmp\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.465140 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.465069    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-etc-tuned\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.465207 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.465130    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-ovn-node-metrics-cert\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.468097 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.468067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffh5s\" (UniqueName: \"kubernetes.io/projected/fe52d80f-5815-40ac-8d13-e3e5a97bb8fc-kube-api-access-ffh5s\") pod \"ovnkube-node-299gm\" (UID: \"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.468200 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.468150    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9zjq\" (UniqueName: \"kubernetes.io/projected/0126b195-0b10-4b0f-91e4-58459b6cde01-kube-api-access-r9zjq\") pod \"iptables-alerter-bbj69\" (UID: \"0126b195-0b10-4b0f-91e4-58459b6cde01\") " pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.468490 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.468468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjtr\" (UniqueName: \"kubernetes.io/projected/88de2d63-6b8d-47f4-8fe1-12e15cfffa10-kube-api-access-qrjtr\") pod \"multus-szjts\" (UID: \"88de2d63-6b8d-47f4-8fe1-12e15cfffa10\") " pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.469283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.469258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjk4s\" (UniqueName: \"kubernetes.io/projected/ed3115ae-cfe1-4f38-8288-3aff58fee3b1-kube-api-access-rjk4s\") pod \"aws-ebs-csi-driver-node-5tl9h\" (UID: \"ed3115ae-cfe1-4f38-8288-3aff58fee3b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.470147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.470128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc4vd\" (UniqueName: \"kubernetes.io/projected/27c2e954-39ee-42f6-91f5-29b5a62ae5ed-kube-api-access-nc4vd\") pod \"node-ca-bc655\" (UID: \"27c2e954-39ee-42f6-91f5-29b5a62ae5ed\") " pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.470147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.470136    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8k6\" (UniqueName: \"kubernetes.io/projected/1827c3b9-11ea-4472-95ce-c6b41d75dcb4-kube-api-access-8w8k6\") pod \"tuned-smtk2\" (UID: \"1827c3b9-11ea-4472-95ce-c6b41d75dcb4\") " pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.555612 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-os-release\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.555612 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555623    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcffr\" (UniqueName: \"kubernetes.io/projected/5590e4e5-e701-4509-bea1-6b76bc99f091-kube-api-access-dcffr\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-os-release\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae831ed-40dd-4963-a986-39bd625bc6b2-agent-certs\") pod \"konnectivity-agent-6swv4\" (UID: \"6ae831ed-40dd-4963-a986-39bd625bc6b2\") " pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.555779    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42b0290a-0169-43a6-bc50-7ef9f3a83307-kubelet-config\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qdss\" (UniqueName: \"kubernetes.io/projected/aab107ec-362a-46b6-8bf0-cd3bebfcc169-kube-api-access-8qdss\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.555882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab107ec-362a-46b6-8bf0-cd3bebfcc169-tmp-dir\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.555904    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:09:48.055868948 +0000 UTC m=+3.101966060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.555942    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42b0290a-0169-43a6-bc50-7ef9f3a83307-kubelet-config\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42b0290a-0169-43a6-bc50-7ef9f3a83307-dbus\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9gbg\" (UniqueName: \"kubernetes.io/projected/07af3fec-8472-46a7-9bb6-3c398effb78a-kube-api-access-x9gbg\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae831ed-40dd-4963-a986-39bd625bc6b2-konnectivity-ca\") pod \"konnectivity-agent-6swv4\" (UID: \"6ae831ed-40dd-4963-a986-39bd625bc6b2\") " pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-cni-binary-copy\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42b0290a-0169-43a6-bc50-7ef9f3a83307-dbus\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556170    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab107ec-362a-46b6-8bf0-cd3bebfcc169-tmp-dir\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-system-cni-dir\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab107ec-362a-46b6-8bf0-cd3bebfcc169-hosts-file\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.556262    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:47.556294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-cnibin\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.556335    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret podName:42b0290a-0169-43a6-bc50-7ef9f3a83307 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:48.056317726 +0000 UTC m=+3.102414835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret") pod "global-pull-secret-syncer-2wpkx" (UID: "42b0290a-0169-43a6-bc50-7ef9f3a83307") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556343    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-cnibin\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556386    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-system-cni-dir\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556388    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab107ec-362a-46b6-8bf0-cd3bebfcc169-hosts-file\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5590e4e5-e701-4509-bea1-6b76bc99f091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-cni-binary-copy\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae831ed-40dd-4963-a986-39bd625bc6b2-konnectivity-ca\") pod \"konnectivity-agent-6swv4\" (UID: \"6ae831ed-40dd-4963-a986-39bd625bc6b2\") " pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556867    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.557045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.556883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5590e4e5-e701-4509-bea1-6b76bc99f091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.558369 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.558345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae831ed-40dd-4963-a986-39bd625bc6b2-agent-certs\") pod \"konnectivity-agent-6swv4\" (UID: \"6ae831ed-40dd-4963-a986-39bd625bc6b2\") " pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.569726 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.569701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9gbg\" (UniqueName: \"kubernetes.io/projected/07af3fec-8472-46a7-9bb6-3c398effb78a-kube-api-access-x9gbg\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:47.569926 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.569905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qdss\" (UniqueName: \"kubernetes.io/projected/aab107ec-362a-46b6-8bf0-cd3bebfcc169-kube-api-access-8qdss\") pod \"node-resolver-v4ksk\" (UID: \"aab107ec-362a-46b6-8bf0-cd3bebfcc169\") " pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.572057 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.572035    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:09:47.572057 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.572061    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:09:47.572176 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.572072    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gx5l8 for pod openshift-network-diagnostics/network-check-target-l4lf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:47.572176 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:47.572135    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8 podName:9944c7e1-695e-42dc-8e88-b3d54884a9b7 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:48.072120576 +0000 UTC m=+3.118217684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gx5l8" (UniqueName: "kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8") pod "network-check-target-l4lf4" (UID: "9944c7e1-695e-42dc-8e88-b3d54884a9b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:47.575210 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.575140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcffr\" (UniqueName: \"kubernetes.io/projected/5590e4e5-e701-4509-bea1-6b76bc99f091-kube-api-access-dcffr\") pod \"multus-additional-cni-plugins-6x45g\" (UID: \"5590e4e5-e701-4509-bea1-6b76bc99f091\") " pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.641814 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.641774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szjts"
Jul 23 11:09:47.653432 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.653399    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88de2d63_6b8d_47f4_8fe1_12e15cfffa10.slice/crio-8668dea96890e156459e27bdcf79488d85601266f20b6028377389931c953d8f WatchSource:0}: Error finding container 8668dea96890e156459e27bdcf79488d85601266f20b6028377389931c953d8f: Status 404 returned error can't find the container with id 8668dea96890e156459e27bdcf79488d85601266f20b6028377389931c953d8f
Jul 23 11:09:47.667896 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.667868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bbj69"
Jul 23 11:09:47.675429 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.675406    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h"
Jul 23 11:09:47.676972 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.676934    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0126b195_0b10_4b0f_91e4_58459b6cde01.slice/crio-5ac7ffcf731c6ded2db904e3ac1ea54e6dcd24deb6c3089d954ccd13d1cf24b2 WatchSource:0}: Error finding container 5ac7ffcf731c6ded2db904e3ac1ea54e6dcd24deb6c3089d954ccd13d1cf24b2: Status 404 returned error can't find the container with id 5ac7ffcf731c6ded2db904e3ac1ea54e6dcd24deb6c3089d954ccd13d1cf24b2
Jul 23 11:09:47.680622 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.680501    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smtk2"
Jul 23 11:09:47.686354 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.686322    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3115ae_cfe1_4f38_8288_3aff58fee3b1.slice/crio-7c6253db64150c066c3cf84236fd64e152a8c5f3e36dd1cd7637324e592737bc WatchSource:0}: Error finding container 7c6253db64150c066c3cf84236fd64e152a8c5f3e36dd1cd7637324e592737bc: Status 404 returned error can't find the container with id 7c6253db64150c066c3cf84236fd64e152a8c5f3e36dd1cd7637324e592737bc
Jul 23 11:09:47.687984 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.687896    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bc655"
Jul 23 11:09:47.690456 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.690428    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1827c3b9_11ea_4472_95ce_c6b41d75dcb4.slice/crio-9aa8f5e9b2c2c1d5c782ec016b60ace5e4531a9d5ce94027a630182c1d07aac3 WatchSource:0}: Error finding container 9aa8f5e9b2c2c1d5c782ec016b60ace5e4531a9d5ce94027a630182c1d07aac3: Status 404 returned error can't find the container with id 9aa8f5e9b2c2c1d5c782ec016b60ace5e4531a9d5ce94027a630182c1d07aac3
Jul 23 11:09:47.693847 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.693826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:09:47.697841 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.697813    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c2e954_39ee_42f6_91f5_29b5a62ae5ed.slice/crio-e1b812321f2c6312a12fb83fb8214c5478fd98c2b446f8743d2c192a7103e221 WatchSource:0}: Error finding container e1b812321f2c6312a12fb83fb8214c5478fd98c2b446f8743d2c192a7103e221: Status 404 returned error can't find the container with id e1b812321f2c6312a12fb83fb8214c5478fd98c2b446f8743d2c192a7103e221
Jul 23 11:09:47.701248 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.701157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:09:47.703090 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.703064    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe52d80f_5815_40ac_8d13_e3e5a97bb8fc.slice/crio-c109517d96ca1310c9e31392ad55b082bf489c5f2b56e80800f54fd20c10c887 WatchSource:0}: Error finding container c109517d96ca1310c9e31392ad55b082bf489c5f2b56e80800f54fd20c10c887: Status 404 returned error can't find the container with id c109517d96ca1310c9e31392ad55b082bf489c5f2b56e80800f54fd20c10c887
Jul 23 11:09:47.709193 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.709172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4ksk"
Jul 23 11:09:47.711450 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.711426    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae831ed_40dd_4963_a986_39bd625bc6b2.slice/crio-2bc4352a5459f8ec2a5046d123c07d043fc3f26d0f385d9ad06ada6df2f462bd WatchSource:0}: Error finding container 2bc4352a5459f8ec2a5046d123c07d043fc3f26d0f385d9ad06ada6df2f462bd: Status 404 returned error can't find the container with id 2bc4352a5459f8ec2a5046d123c07d043fc3f26d0f385d9ad06ada6df2f462bd
Jul 23 11:09:47.712708 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:47.712686    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6x45g"
Jul 23 11:09:47.722881 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.722856    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab107ec_362a_46b6_8bf0_cd3bebfcc169.slice/crio-0734b019c01dbf6f3c1081986e10a7653e343d6aab43a7ba9f70d807d84f179c WatchSource:0}: Error finding container 0734b019c01dbf6f3c1081986e10a7653e343d6aab43a7ba9f70d807d84f179c: Status 404 returned error can't find the container with id 0734b019c01dbf6f3c1081986e10a7653e343d6aab43a7ba9f70d807d84f179c
Jul 23 11:09:47.724076 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:09:47.724024    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5590e4e5_e701_4509_bea1_6b76bc99f091.slice/crio-1df508578100f64c531dd41e76fab89f3d07b129b7b31cbe955368acf5ece944 WatchSource:0}: Error finding container 1df508578100f64c531dd41e76fab89f3d07b129b7b31cbe955368acf5ece944: Status 404 returned error can't find the container with id 1df508578100f64c531dd41e76fab89f3d07b129b7b31cbe955368acf5ece944
Jul 23 11:09:48.060704 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.060611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:48.060704 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.060703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:48.060916 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.060780    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:48.060916 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.060799    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:48.060916 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.060848    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:09:49.060831163 +0000 UTC m=+4.106928273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:48.060916 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.060861    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret podName:42b0290a-0169-43a6-bc50-7ef9f3a83307 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:49.060855748 +0000 UTC m=+4.106952843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret") pod "global-pull-secret-syncer-2wpkx" (UID: "42b0290a-0169-43a6-bc50-7ef9f3a83307") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:48.161099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.161065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:48.161240 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.161199    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:09:48.161240 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.161216    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:09:48.161240 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.161225    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gx5l8 for pod openshift-network-diagnostics/network-check-target-l4lf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:48.161373 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:48.161277    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8 podName:9944c7e1-695e-42dc-8e88-b3d54884a9b7 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:49.161261317 +0000 UTC m=+4.207358429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx5l8" (UniqueName: "kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8") pod "network-check-target-l4lf4" (UID: "9944c7e1-695e-42dc-8e88-b3d54884a9b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:48.451657 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.451569    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 11:04:47 +0000 UTC" deadline="2028-04-30 09:53:14.631558704 +0000 UTC"
Jul 23 11:09:48.451657 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.451602    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15526h43m26.179960911s"
Jul 23 11:09:48.454574 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.454546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smtk2" event={"ID":"1827c3b9-11ea-4472-95ce-c6b41d75dcb4","Type":"ContainerStarted","Data":"9aa8f5e9b2c2c1d5c782ec016b60ace5e4531a9d5ce94027a630182c1d07aac3"}
Jul 23 11:09:48.460697 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.460666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h" event={"ID":"ed3115ae-cfe1-4f38-8288-3aff58fee3b1","Type":"ContainerStarted","Data":"7c6253db64150c066c3cf84236fd64e152a8c5f3e36dd1cd7637324e592737bc"}
Jul 23 11:09:48.462071 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.462021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szjts" event={"ID":"88de2d63-6b8d-47f4-8fe1-12e15cfffa10","Type":"ContainerStarted","Data":"8668dea96890e156459e27bdcf79488d85601266f20b6028377389931c953d8f"}
Jul 23 11:09:48.463393 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.463369    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerStarted","Data":"1df508578100f64c531dd41e76fab89f3d07b129b7b31cbe955368acf5ece944"}
Jul 23 11:09:48.467444 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.467416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"c109517d96ca1310c9e31392ad55b082bf489c5f2b56e80800f54fd20c10c887"}
Jul 23 11:09:48.472683 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.472653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bbj69" event={"ID":"0126b195-0b10-4b0f-91e4-58459b6cde01","Type":"ContainerStarted","Data":"5ac7ffcf731c6ded2db904e3ac1ea54e6dcd24deb6c3089d954ccd13d1cf24b2"}
Jul 23 11:09:48.474978 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.474954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4ksk" event={"ID":"aab107ec-362a-46b6-8bf0-cd3bebfcc169","Type":"ContainerStarted","Data":"0734b019c01dbf6f3c1081986e10a7653e343d6aab43a7ba9f70d807d84f179c"}
Jul 23 11:09:48.478198 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.478158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6swv4" event={"ID":"6ae831ed-40dd-4963-a986-39bd625bc6b2","Type":"ContainerStarted","Data":"2bc4352a5459f8ec2a5046d123c07d043fc3f26d0f385d9ad06ada6df2f462bd"}
Jul 23 11:09:48.492349 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:48.492313    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bc655" event={"ID":"27c2e954-39ee-42f6-91f5-29b5a62ae5ed","Type":"ContainerStarted","Data":"e1b812321f2c6312a12fb83fb8214c5478fd98c2b446f8743d2c192a7103e221"}
Jul 23 11:09:49.069773 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.069531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:49.069773 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.069596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:49.069773 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.069759    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:49.070059 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.069819    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:09:51.069800959 +0000 UTC m=+6.115898063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:49.070322 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.070228    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:49.070322 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.070291    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret podName:42b0290a-0169-43a6-bc50-7ef9f3a83307 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:51.070272692 +0000 UTC m=+6.116369804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret") pod "global-pull-secret-syncer-2wpkx" (UID: "42b0290a-0169-43a6-bc50-7ef9f3a83307") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:49.170843 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.170801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:49.171030 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.170960    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:09:49.171030 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.170983    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:09:49.171030 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.170994    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gx5l8 for pod openshift-network-diagnostics/network-check-target-l4lf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:49.171189 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.171050    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8 podName:9944c7e1-695e-42dc-8e88-b3d54884a9b7 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:51.171032199 +0000 UTC m=+6.217129307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx5l8" (UniqueName: "kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8") pod "network-check-target-l4lf4" (UID: "9944c7e1-695e-42dc-8e88-b3d54884a9b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:49.443068 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.442774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:49.443228 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.443127    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:09:49.443228 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.443181    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:49.443368 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.443290    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:09:49.443423 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.443375    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:49.443509 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:49.443464    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:09:49.452236 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.452170    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 11:04:47 +0000 UTC" deadline="2028-03-23 03:26:36.246541052 +0000 UTC"
Jul 23 11:09:49.452236 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.452225    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14608h16m46.794319981s"
Jul 23 11:09:49.509382 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.509346    2573 generic.go:356] "Generic (PLEG): container finished" podID="ec13888fcd0d268cc5722f2014f6efe0" containerID="f8bdaa708b06f3a4524402de7f70c8a5fc2d3078a3aa14f9c3f7b058ba3bdfce" exitCode=0
Jul 23 11:09:49.509579 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:49.509397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal" event={"ID":"ec13888fcd0d268cc5722f2014f6efe0","Type":"ContainerDied","Data":"f8bdaa708b06f3a4524402de7f70c8a5fc2d3078a3aa14f9c3f7b058ba3bdfce"}
Jul 23 11:09:50.519527 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:50.518823    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal" event={"ID":"ec13888fcd0d268cc5722f2014f6efe0","Type":"ContainerStarted","Data":"8ba6e657832f7662d94e6206bd56b725322bba8e34e9b5ae09ef4df92219bbde"}
Jul 23 11:09:51.089127 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:51.089084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:51.089318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:51.089192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:51.089318 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.089260    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:51.089416 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.089322    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:51.089416 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.089343    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:09:55.08932099 +0000 UTC m=+10.135418093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:51.089416 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.089375    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret podName:42b0290a-0169-43a6-bc50-7ef9f3a83307 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:55.089359699 +0000 UTC m=+10.135456814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret") pod "global-pull-secret-syncer-2wpkx" (UID: "42b0290a-0169-43a6-bc50-7ef9f3a83307") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:51.190453 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:51.190416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:51.190630 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.190588    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:09:51.190630 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.190612    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:09:51.190630 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.190625    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gx5l8 for pod openshift-network-diagnostics/network-check-target-l4lf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:51.190886 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.190687    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8 podName:9944c7e1-695e-42dc-8e88-b3d54884a9b7 nodeName:}" failed. No retries permitted until 2026-07-23 11:09:55.190670775 +0000 UTC m=+10.236767869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx5l8" (UniqueName: "kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8") pod "network-check-target-l4lf4" (UID: "9944c7e1-695e-42dc-8e88-b3d54884a9b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:51.441130 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:51.440310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:51.441130 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.440448    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:09:51.441130 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:51.440837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:51.441130 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.440949    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:09:51.441130 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:51.440990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:51.441130 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:51.441053    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:09:53.440636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:53.440106    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:53.440636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:53.440133    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:53.440636 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:53.440244    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:09:53.440636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:53.440298    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:53.440636 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:53.440428    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:09:53.440636 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:53.440522    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:09:55.126047 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:55.125898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:55.126047 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:55.125959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:55.126525 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.126071    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:55.126525 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.126101    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:55.126525 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.126147    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret podName:42b0290a-0169-43a6-bc50-7ef9f3a83307 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:03.126125891 +0000 UTC m=+18.172223000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret") pod "global-pull-secret-syncer-2wpkx" (UID: "42b0290a-0169-43a6-bc50-7ef9f3a83307") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:09:55.126525 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.126171    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:10:03.126160531 +0000 UTC m=+18.172257629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:09:55.226960 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:55.226921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:55.227123 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.227078    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:09:55.227123 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.227102    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:09:55.227123 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.227115    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gx5l8 for pod openshift-network-diagnostics/network-check-target-l4lf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:55.227295 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.227165    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8 podName:9944c7e1-695e-42dc-8e88-b3d54884a9b7 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:03.227148257 +0000 UTC m=+18.273245366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx5l8" (UniqueName: "kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8") pod "network-check-target-l4lf4" (UID: "9944c7e1-695e-42dc-8e88-b3d54884a9b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:09:55.444469 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:55.444392    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:55.444469 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:55.444405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:55.444700 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:55.444392    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:55.444700 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.444523    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:09:55.444700 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.444628    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:09:55.444882 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:55.444732    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:09:57.440544 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:57.440328    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:57.440544 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:57.440374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:57.440544 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:57.440487    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:09:57.441114 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:57.440584    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:09:57.441114 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:57.440637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:57.441114 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:57.440703    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:09:59.440302 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:59.440209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:09:59.440302 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:59.440243    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:09:59.440302 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:09:59.440209    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:09:59.440886 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:59.440342    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:09:59.440886 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:59.440409    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:09:59.440886 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:09:59.440461    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:01.439906 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:01.439868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:01.440321 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:01.439877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:01.440321 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:01.440022    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:01.440321 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:01.440018    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:01.440321 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:01.440124    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:01.440321 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:01.440211    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:03.181284 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:03.181191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:03.181284 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:03.181256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:03.181780 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.181354    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:03.181780 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.181376    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:03.181780 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.181443    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret podName:42b0290a-0169-43a6-bc50-7ef9f3a83307 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:19.181420016 +0000 UTC m=+34.227517111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret") pod "global-pull-secret-syncer-2wpkx" (UID: "42b0290a-0169-43a6-bc50-7ef9f3a83307") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:03.181780 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.181465    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:10:19.18145486 +0000 UTC m=+34.227551952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:03.282427 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:03.282393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:03.282602 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.282581    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:03.282666 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.282607    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:03.282666 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.282616    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gx5l8 for pod openshift-network-diagnostics/network-check-target-l4lf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:03.282757 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.282674    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8 podName:9944c7e1-695e-42dc-8e88-b3d54884a9b7 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:19.282654268 +0000 UTC m=+34.328751376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx5l8" (UniqueName: "kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8") pod "network-check-target-l4lf4" (UID: "9944c7e1-695e-42dc-8e88-b3d54884a9b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:03.440469 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:03.440384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:03.440620 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:03.440384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:03.440620 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.440505    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:03.440728 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.440612    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:03.440728 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:03.440672    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:03.440844 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:03.440774    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:05.441557 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:05.441523    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:05.442077 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:05.441633    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:05.442077 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:05.441639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:05.442077 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:05.441675    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:05.442077 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:05.441752    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:05.442077 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:05.441827    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:07.440161 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:07.440134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:07.440581 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:07.440273    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:07.440581 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:07.440341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:07.440581 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:07.440424    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:07.440581 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:07.440569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:07.440795 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:07.440690    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:08.559799 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.559414    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal" event={"ID":"4b32f8d5cefe9b5ce058a0460b5a27a5","Type":"ContainerStarted","Data":"67689dea80ebb380ded2cae6eff1f2cdf7f58fe53193443b6b4ad21fb843ceb3"}
Jul 23 11:10:08.561034 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.561013    2573 generic.go:356] "Generic (PLEG): container finished" podID="5590e4e5-e701-4509-bea1-6b76bc99f091" containerID="f92847028c816bea71482e5f41fae8dfc9794f83c5a775c5f994707756fb804e" exitCode=0
Jul 23 11:10:08.561120 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.561087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerDied","Data":"f92847028c816bea71482e5f41fae8dfc9794f83c5a775c5f994707756fb804e"}
Jul 23 11:10:08.564732 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.564708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"4e1103dd4ed49be7628f92f3fc70eed41090e570737b636bed278ac9737e6cc4"}
Jul 23 11:10:08.564844 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.564822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"6ffadcca8575f38108c93ed21fcc9ff922cd5c457b4ddced66035b50e4150f64"}
Jul 23 11:10:08.564884 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.564871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"fa8c9e137ae92d43243c4df83d3fc58870ffb8ba2859f5faee13d918d0d04641"}
Jul 23 11:10:08.564925 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.564912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"9d92f3dd1a8ea9ac4a707d74e478aabd814acc3604f168f8f224fee20b142745"}
Jul 23 11:10:08.564978 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.564962    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"e24a8ee0a4a4b5e50770199f61572d70ec7b87d14f4b4b78ab9bda72029e5697"}
Jul 23 11:10:08.565023 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.565009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"659a71a3ee8c5b37a66fff35fd4d24b2a0875b3af0588cfb3c7d52d9eec9fe49"}
Jul 23 11:10:08.566138 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.566105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4ksk" event={"ID":"aab107ec-362a-46b6-8bf0-cd3bebfcc169","Type":"ContainerStarted","Data":"3ad466afbc8f9491b81c719fb3126d347b5272e746c20eb2e503eb564140056a"}
Jul 23 11:10:08.567542 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.567522    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6swv4" event={"ID":"6ae831ed-40dd-4963-a986-39bd625bc6b2","Type":"ContainerStarted","Data":"79b9fba5f6e423a7bf1cf35fca2a2a45fc26fdc98d2f26ff9776a2faceb9fde7"}
Jul 23 11:10:08.568859 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.568840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bc655" event={"ID":"27c2e954-39ee-42f6-91f5-29b5a62ae5ed","Type":"ContainerStarted","Data":"9d2649fc597528180e84301cd664ac1f15350a5e4c2474d633d702818fd1745b"}
Jul 23 11:10:08.570143 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.570124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smtk2" event={"ID":"1827c3b9-11ea-4472-95ce-c6b41d75dcb4","Type":"ContainerStarted","Data":"125fe8b6fe9147088ef0b515140566a89f4e45b741cb0c927c147edd0ddae91e"}
Jul 23 11:10:08.571458 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.571439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h" event={"ID":"ed3115ae-cfe1-4f38-8288-3aff58fee3b1","Type":"ContainerStarted","Data":"bebac8a9659d3c687eb2f16f9a56bf7d258be951cc6d21965833a57cae9955c1"}
Jul 23 11:10:08.572680 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.572660    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szjts" event={"ID":"88de2d63-6b8d-47f4-8fe1-12e15cfffa10","Type":"ContainerStarted","Data":"41a9a1ff48451286eb020d50d70a4a0834e5e9142059504b02c1b8eb68e7dd53"}
Jul 23 11:10:08.576326 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.576275    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-77.ec2.internal" podStartSLOduration=22.576264189 podStartE2EDuration="22.576264189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:09:50.5374473 +0000 UTC m=+5.583544418" watchObservedRunningTime="2026-07-23 11:10:08.576264189 +0000 UTC m=+23.622361302"
Jul 23 11:10:08.576773 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.576734    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-77.ec2.internal" podStartSLOduration=22.576728229 podStartE2EDuration="22.576728229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:08.576250514 +0000 UTC m=+23.622347628" watchObservedRunningTime="2026-07-23 11:10:08.576728229 +0000 UTC m=+23.622825342"
Jul 23 11:10:08.594031 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.593992    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-szjts" podStartSLOduration=3.814018418 podStartE2EDuration="23.59398125s" totalImagesPullingTime="19.779962832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:08.593793389 +0000 UTC m=+23.639890504" watchObservedRunningTime="2026-07-23 11:10:08.59398125 +0000 UTC m=+23.640078363"
Jul 23 11:10:08.653080 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.653033    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-smtk2" podStartSLOduration=3.93453643 podStartE2EDuration="23.653018004s" totalImagesPullingTime="19.718481574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:08.621762509 +0000 UTC m=+23.667859622" watchObservedRunningTime="2026-07-23 11:10:08.653018004 +0000 UTC m=+23.699115117"
Jul 23 11:10:08.653405 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.653365    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6swv4" podStartSLOduration=8.682457876 podStartE2EDuration="23.653351652s" totalImagesPullingTime="14.970893776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:08.653337385 +0000 UTC m=+23.699434501" watchObservedRunningTime="2026-07-23 11:10:08.653351652 +0000 UTC m=+23.699448768"
Jul 23 11:10:08.668283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.668251    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 11:10:08.679539 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.679501    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bc655" podStartSLOduration=8.694705194 podStartE2EDuration="23.679487447s" totalImagesPullingTime="14.984782253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:08.679133815 +0000 UTC m=+23.725230929" watchObservedRunningTime="2026-07-23 11:10:08.679487447 +0000 UTC m=+23.725584562"
Jul 23 11:10:08.753442 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:08.753343    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v4ksk" podStartSLOduration=4.065894121 podStartE2EDuration="23.753327558s" totalImagesPullingTime="19.687433437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:08.72614801 +0000 UTC m=+23.772245138" watchObservedRunningTime="2026-07-23 11:10:08.753327558 +0000 UTC m=+23.799424739"
Jul 23 11:10:09.444154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.444116    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:09.444423 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:09.444218    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:09.444423 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.444125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:09.444423 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.444125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:09.444423 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:09.444308    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:09.444423 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:09.444374    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:09.457991 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.457860    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T11:10:08.668277538Z","UUID":"436874a1-0798-421b-ad9e-0820b09d2328","Handler":null,"Name":"","Endpoint":""}
Jul 23 11:10:09.459468 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.459444    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 11:10:09.459591 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.459498    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 11:10:09.576123 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.576083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bbj69" event={"ID":"0126b195-0b10-4b0f-91e4-58459b6cde01","Type":"ContainerStarted","Data":"d06787fa2793922247b6a5fc362890cf024189ad7e78ed86de130d5d1b2f1a2f"}
Jul 23 11:10:09.577775 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.577723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h" event={"ID":"ed3115ae-cfe1-4f38-8288-3aff58fee3b1","Type":"ContainerStarted","Data":"a219d016ec8e374540a7ff1e113c90e7e69edf1df4ba2bba93a1f6ee744d0745"}
Jul 23 11:10:09.618223 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.618176    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bbj69" podStartSLOduration=4.886818899 podStartE2EDuration="24.618159083s" totalImagesPullingTime="19.731340184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:09.617712728 +0000 UTC m=+24.663809854" watchObservedRunningTime="2026-07-23 11:10:09.618159083 +0000 UTC m=+24.664256196"
Jul 23 11:10:09.951212 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.951185    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:10:09.951867 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:09.951846    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:10:10.582304 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:10.582218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h" event={"ID":"ed3115ae-cfe1-4f38-8288-3aff58fee3b1","Type":"ContainerStarted","Data":"befb50f717a532242d739196540ffc62ef049830f9505445223c58094558ac81"}
Jul 23 11:10:10.586072 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:10.586030    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"8ba29df3119acd89c8c8dcbf30dbb1e88770549f6c5b2cb7d85cb1ee2ced5e53"}
Jul 23 11:10:10.586584 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:10.586563    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:10:10.587093 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:10.587077    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6swv4"
Jul 23 11:10:10.622821 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:10.622774    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5tl9h" podStartSLOduration=4.016501126 podStartE2EDuration="25.622760113s" totalImagesPullingTime="21.606258987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:10.603072837 +0000 UTC m=+25.649169952" watchObservedRunningTime="2026-07-23 11:10:10.622760113 +0000 UTC m=+25.668857224"
Jul 23 11:10:11.440512 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:11.440317    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:11.440694 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:11.440316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:11.440694 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:11.440619    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:11.440694 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:11.440317    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:11.440885 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:11.440707    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:11.440885 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:11.440762    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:13.440867 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:13.440831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:13.441452 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:13.440964    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:13.441452 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:13.441035    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:13.441452 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:13.441140    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:13.441452 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:13.441167    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:13.441452 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:13.441230    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:14.596933 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:14.596727    2573 generic.go:356] "Generic (PLEG): container finished" podID="5590e4e5-e701-4509-bea1-6b76bc99f091" containerID="734ec173f60383b32624dc360616404ad8d782ef41b3b24cbc4f9e16f6ad4230" exitCode=0
Jul 23 11:10:14.597676 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:14.596817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerDied","Data":"734ec173f60383b32624dc360616404ad8d782ef41b3b24cbc4f9e16f6ad4230"}
Jul 23 11:10:14.600820 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:14.600792    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" event={"ID":"fe52d80f-5815-40ac-8d13-e3e5a97bb8fc","Type":"ContainerStarted","Data":"8aa362f02b828a66b10420096c11cf3a0827e5bd99bfaf79ea84ffa1cd3dce94"}
Jul 23 11:10:14.601048 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:14.601033    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:10:14.601104 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:14.601093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:10:14.616335 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:14.616313    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:10:14.646069 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:14.646020    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-299gm" podStartSLOduration=9.86499117 podStartE2EDuration="29.646006246s" totalImagesPullingTime="19.781015076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:14.645230195 +0000 UTC m=+29.691327333" watchObservedRunningTime="2026-07-23 11:10:14.646006246 +0000 UTC m=+29.692103360"
Jul 23 11:10:15.440967 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.440941    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:15.441187 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.441036    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:15.441187 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:15.441042    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:15.441187 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:15.441161    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:15.441307 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.441193    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:15.441307 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:15.441271    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:15.603579 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.603548    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:10:15.618432 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.618412    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:10:15.934536 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.934502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2wpkx"]
Jul 23 11:10:15.934690 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.934601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:15.934690 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:15.934678    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:15.938758 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.938719    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4lf4"]
Jul 23 11:10:15.938877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.938846    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:15.938957 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:15.938935    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:15.939338 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.939319    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kt2sk"]
Jul 23 11:10:15.939409 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:15.939396    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:15.939488 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:15.939472    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:16.608060 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:16.608025    2573 generic.go:356] "Generic (PLEG): container finished" podID="5590e4e5-e701-4509-bea1-6b76bc99f091" containerID="1d14b1a4e0aad3367a245e34c7c4f938be3b01db96f9faf481ecdf706c703c71" exitCode=0
Jul 23 11:10:16.608412 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:16.608113    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerDied","Data":"1d14b1a4e0aad3367a245e34c7c4f938be3b01db96f9faf481ecdf706c703c71"}
Jul 23 11:10:17.441029 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:17.440853    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:17.441181 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:17.440860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:17.441181 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:17.441105    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:17.441248 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:17.440912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:17.441248 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:17.441198    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:17.441306 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:17.441290    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:18.614707 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:18.614675    2573 generic.go:356] "Generic (PLEG): container finished" podID="5590e4e5-e701-4509-bea1-6b76bc99f091" containerID="5057640108db969cf3d23124e0f8483697c95e81c49f659d9e8e1a9e9a6a9895" exitCode=0
Jul 23 11:10:18.615193 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:18.614719    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerDied","Data":"5057640108db969cf3d23124e0f8483697c95e81c49f659d9e8e1a9e9a6a9895"}
Jul 23 11:10:19.202028 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:19.201988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:19.202209 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:19.202040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:19.202209 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.202131    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:19.202209 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.202192    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:10:51.202175847 +0000 UTC m=+66.248272954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:19.202399 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.202130    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:19.202399 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.202273    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret podName:42b0290a-0169-43a6-bc50-7ef9f3a83307 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:51.202255969 +0000 UTC m=+66.248353078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret") pod "global-pull-secret-syncer-2wpkx" (UID: "42b0290a-0169-43a6-bc50-7ef9f3a83307") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:19.302637 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:19.302596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:19.302842 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.302735    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:19.302842 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.302778    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:19.302842 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.302789    2573 projected.go:196] Error preparing data for projected volume kube-api-access-gx5l8 for pod openshift-network-diagnostics/network-check-target-l4lf4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:19.302997 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.302851    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8 podName:9944c7e1-695e-42dc-8e88-b3d54884a9b7 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:51.302831053 +0000 UTC m=+66.348928145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx5l8" (UniqueName: "kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8") pod "network-check-target-l4lf4" (UID: "9944c7e1-695e-42dc-8e88-b3d54884a9b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:19.440336 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:19.440297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:19.440504 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:19.440302    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:19.440504 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:19.440417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:19.440504 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.440416    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4lf4" podUID="9944c7e1-695e-42dc-8e88-b3d54884a9b7"
Jul 23 11:10:19.440504 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.440483    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wpkx" podUID="42b0290a-0169-43a6-bc50-7ef9f3a83307"
Jul 23 11:10:19.440649 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:19.440558    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:10:20.304801 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.304733    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-77.ec2.internal" event="NodeReady"
Jul 23 11:10:20.305326 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.304891    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 11:10:20.351504 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.351238    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8cc9d968f-bsq2s"]
Jul 23 11:10:20.355481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.355449    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.361152 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.361068    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 11:10:20.361152 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.361106    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 11:10:20.361533 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.361372    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j422v\""
Jul 23 11:10:20.361859 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.361802    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 11:10:20.367112 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.367089    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 11:10:20.374889 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.374868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cc9d968f-bsq2s"]
Jul 23 11:10:20.376549 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.376512    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"]
Jul 23 11:10:20.380525 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.380496    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:20.386283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.386263    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 11:10:20.387108 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.387011    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 11:10:20.390663 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.390644    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2b25g\""
Jul 23 11:10:20.400764 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.400721    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"]
Jul 23 11:10:20.401656 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.401634    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ng7nf"]
Jul 23 11:10:20.405654 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.405619    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2q4xk"]
Jul 23 11:10:20.405787 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.405769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.409573 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.409554    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.410758 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.410725    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 11:10:20.410758 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.410757    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hxmt4\""
Jul 23 11:10:20.410902 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.410758    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 11:10:20.417202 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.414690    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 11:10:20.417202 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.414803    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-565pp\""
Jul 23 11:10:20.417487 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.417468    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 11:10:20.419407 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.419376    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 11:10:20.427019 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.426997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ng7nf"]
Jul 23 11:10:20.427786 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.427766    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2q4xk"]
Jul 23 11:10:20.510427 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.510606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce6cec9b-d877-44dc-8e1b-1a08277d7cc0-cert\") pod \"ingress-canary-2q4xk\" (UID: \"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0\") " pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.510606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-image-registry-private-configuration\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.510606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-bound-sa-token\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.510606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daec44b2-0237-448c-937f-df1659664a2b-tmp-dir\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.510606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413542c9-505a-4e44-bd4c-f6ebe21eac07-ca-trust-extracted\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.510829 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zl74\" (UniqueName: \"kubernetes.io/projected/daec44b2-0237-448c-937f-df1659664a2b-kube-api-access-6zl74\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.510829 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daec44b2-0237-448c-937f-df1659664a2b-config-volume\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.510829 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:20.510829 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510715    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dr7\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-kube-api-access-72dr7\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.510829 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f54c2d77-7029-4781-9689-2e27591917a4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:20.510829 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5862\" (UniqueName: \"kubernetes.io/projected/ce6cec9b-d877-44dc-8e1b-1a08277d7cc0-kube-api-access-h5862\") pod \"ingress-canary-2q4xk\" (UID: \"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0\") " pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.510829 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-certificates\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.511118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-trusted-ca\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.511118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-installation-pull-secrets\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.511118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.510963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.612054 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.611970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daec44b2-0237-448c-937f-df1659664a2b-tmp-dir\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.612054 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413542c9-505a-4e44-bd4c-f6ebe21eac07-ca-trust-extracted\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.612054 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zl74\" (UniqueName: \"kubernetes.io/projected/daec44b2-0237-448c-937f-df1659664a2b-kube-api-access-6zl74\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daec44b2-0237-448c-937f-df1659664a2b-config-volume\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dr7\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-kube-api-access-72dr7\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f54c2d77-7029-4781-9689-2e27591917a4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5862\" (UniqueName: \"kubernetes.io/projected/ce6cec9b-d877-44dc-8e1b-1a08277d7cc0-kube-api-access-h5862\") pod \"ingress-canary-2q4xk\" (UID: \"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0\") " pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-certificates\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-trusted-ca\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.612322 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:20.612292    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:20.612371    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:21.112348256 +0000 UTC m=+36.158445351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daec44b2-0237-448c-937f-df1659664a2b-tmp-dir\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413542c9-505a-4e44-bd4c-f6ebe21eac07-ca-trust-extracted\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-installation-pull-secrets\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612726    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/daec44b2-0237-448c-937f-df1659664a2b-config-volume\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.612807 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce6cec9b-d877-44dc-8e1b-1a08277d7cc0-cert\") pod \"ingress-canary-2q4xk\" (UID: \"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0\") " pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612825    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-image-registry-private-configuration\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-bound-sa-token\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:20.612866    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:20.612935    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:10:21.112919119 +0000 UTC m=+36.159016224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.612947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-certificates\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:20.613044    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:20.613058    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:10:20.613211 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:20.613109    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:21.113095982 +0000 UTC m=+36.159193097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:10:20.613627 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.613286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f54c2d77-7029-4781-9689-2e27591917a4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:20.613627 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.613525    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-trusted-ca\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.617340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.617279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-image-registry-private-configuration\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.617340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.617293    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce6cec9b-d877-44dc-8e1b-1a08277d7cc0-cert\") pod \"ingress-canary-2q4xk\" (UID: \"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0\") " pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.617340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.617330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-installation-pull-secrets\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.622049 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.622010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-bound-sa-token\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.622151 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.622077    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5862\" (UniqueName: \"kubernetes.io/projected/ce6cec9b-d877-44dc-8e1b-1a08277d7cc0-kube-api-access-h5862\") pod \"ingress-canary-2q4xk\" (UID: \"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0\") " pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.622151 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.622119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zl74\" (UniqueName: \"kubernetes.io/projected/daec44b2-0237-448c-937f-df1659664a2b-kube-api-access-6zl74\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:20.625369 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.625347    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dr7\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-kube-api-access-72dr7\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:20.724523 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.724490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2q4xk"
Jul 23 11:10:20.868444 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:20.868151    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2q4xk"]
Jul 23 11:10:20.874271 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:10:20.874237    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6cec9b_d877_44dc_8e1b_1a08277d7cc0.slice/crio-c788d8c7ff56c943e201896e88302feab99019df1b3c55ddacc39d560ad83262 WatchSource:0}: Error finding container c788d8c7ff56c943e201896e88302feab99019df1b3c55ddacc39d560ad83262: Status 404 returned error can't find the container with id c788d8c7ff56c943e201896e88302feab99019df1b3c55ddacc39d560ad83262
Jul 23 11:10:21.116953 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.116922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:21.117131 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.117026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:21.117131 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.117061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:21.117131 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:21.117096    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:10:21.117303 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:21.117158    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:21.117303 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:21.117182    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:22.117161535 +0000 UTC m=+37.163258644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:10:21.117303 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:21.117180    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:21.117303 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:21.117198    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:10:21.117303 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:21.117201    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:10:22.11719054 +0000 UTC m=+37.163287633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:21.117303 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:21.117270    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:22.117255138 +0000 UTC m=+37.163352241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:10:21.440962 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.440926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:21.441627 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.440972    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:21.441627 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.440925    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:21.443427 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.443389    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg9k4\""
Jul 23 11:10:21.443552 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.443396    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 11:10:21.443755 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.443721    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 11:10:21.443842 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.443766    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 11:10:21.443842 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.443785    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 11:10:21.443956 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.443873    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twtsh\""
Jul 23 11:10:21.623881 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:21.623844    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2q4xk" event={"ID":"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0","Type":"ContainerStarted","Data":"c788d8c7ff56c943e201896e88302feab99019df1b3c55ddacc39d560ad83262"}
Jul 23 11:10:22.125643 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:22.125604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:22.125850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:22.125672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:22.125850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:22.125726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:22.125850 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:22.125769    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:22.125850 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:22.125843    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:10:24.125822467 +0000 UTC m=+39.171919575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:22.126089 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:22.125849    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:22.126089 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:22.125868    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:10:22.126089 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:22.125875    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:10:22.126089 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:22.125917    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:24.125901013 +0000 UTC m=+39.171998125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:10:22.126089 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:22.125936    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:24.125926285 +0000 UTC m=+39.172023382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:10:24.141663 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.141628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.141714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.141760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:24.141811    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:24.141845    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:24.141848    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:24.141888    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:24.141891    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:28.141870191 +0000 UTC m=+43.187967302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:24.141929    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:10:28.141917193 +0000 UTC m=+43.188014290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:24.142061 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:24.141942    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:28.14193425 +0000 UTC m=+43.188031342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:10:24.631787 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.631731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2q4xk" event={"ID":"ce6cec9b-d877-44dc-8e1b-1a08277d7cc0","Type":"ContainerStarted","Data":"f15a25db39d7536d9d3ea2ada649474efed7a1ebbe4336201a8e51bbea945b42"}
Jul 23 11:10:24.634241 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.634214    2573 generic.go:356] "Generic (PLEG): container finished" podID="5590e4e5-e701-4509-bea1-6b76bc99f091" containerID="eddb96dec8b5b97f249f4cefc306f3a2aa4abb988e7f3f6954f587db0c6ac6bf" exitCode=0
Jul 23 11:10:24.634356 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.634259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerDied","Data":"eddb96dec8b5b97f249f4cefc306f3a2aa4abb988e7f3f6954f587db0c6ac6bf"}
Jul 23 11:10:24.654261 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.654214    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2q4xk" podStartSLOduration=1.305008676 podStartE2EDuration="4.654195419s" totalImagesPullingTime="3.349186743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:24.653721615 +0000 UTC m=+39.699818743" watchObservedRunningTime="2026-07-23 11:10:24.654195419 +0000 UTC m=+39.700292534"
Jul 23 11:10:24.967351 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:24.967114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:25.052804 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:25.052771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:25.639771 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:25.639722    2573 generic.go:356] "Generic (PLEG): container finished" podID="5590e4e5-e701-4509-bea1-6b76bc99f091" containerID="92a096bcec2b2d104de3179f43dc95b3768e0dd8926064fc4224137426e1d9ed" exitCode=0
Jul 23 11:10:25.639771 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:25.639770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerDied","Data":"92a096bcec2b2d104de3179f43dc95b3768e0dd8926064fc4224137426e1d9ed"}
Jul 23 11:10:26.645759 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:26.645709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6x45g" event={"ID":"5590e4e5-e701-4509-bea1-6b76bc99f091","Type":"ContainerStarted","Data":"48fcece60f657e6e069cfa6f0dcff496c50f38ec9ca1fbbe114eb1f994c3ae7a"}
Jul 23 11:10:26.686545 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:26.686495    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6x45g" podStartSLOduration=8.896267505 podStartE2EDuration="41.686478761s" totalImagesPullingTime="32.790211256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:26.684984384 +0000 UTC m=+41.731081498" watchObservedRunningTime="2026-07-23 11:10:26.686478761 +0000 UTC m=+41.732575874"
Jul 23 11:10:26.811647 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:26.811614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:26.912067 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:26.911988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:27.778334 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:27.778304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:27.849501 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:27.849461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:28.175688 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:28.175652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:28.175688 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:28.175691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:28.175906 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:28.175722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:28.175906 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:28.175835    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:10:28.175906 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:28.175840    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:28.175906 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:28.175867    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:10:28.175906 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:28.175887    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:36.175872615 +0000 UTC m=+51.221969708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:10:28.176058 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:28.175912    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:36.17589853 +0000 UTC m=+51.221995622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:10:28.176058 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:28.175837    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:28.176058 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:28.175945    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:10:36.175936078 +0000 UTC m=+51.222033173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:29.353361 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:29.353325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:29.433524 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:29.433489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:36.242710 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:36.242668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:36.242710 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:36.242713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:36.242861    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:36.242899    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:36.242924    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:10:52.24290942 +0000 UTC m=+67.289006512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:36.242973    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:36.243020    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:52.24300593 +0000 UTC m=+67.289103024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:36.243026    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:36.243041    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:10:36.243246 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:36.243081    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:52.243067302 +0000 UTC m=+67.289164409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:10:47.621811 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:47.621782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-299gm"
Jul 23 11:10:51.256989 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.256944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:10:51.257517 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.257173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:51.259432 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.259409    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 11:10:51.259488 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.259442    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 11:10:51.267177 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:51.267151    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 11:10:51.267275 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:51.267237    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:11:55.267213299 +0000 UTC m=+130.313310408 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : secret "metrics-daemon-secret" not found
Jul 23 11:10:51.271824 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.271804    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42b0290a-0169-43a6-bc50-7ef9f3a83307-original-pull-secret\") pod \"global-pull-secret-syncer-2wpkx\" (UID: \"42b0290a-0169-43a6-bc50-7ef9f3a83307\") " pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:51.357876 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.357824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:51.360359 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.360335    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 11:10:51.370384 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.370362    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 11:10:51.381396 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.381370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5l8\" (UniqueName: \"kubernetes.io/projected/9944c7e1-695e-42dc-8e88-b3d54884a9b7-kube-api-access-gx5l8\") pod \"network-check-target-l4lf4\" (UID: \"9944c7e1-695e-42dc-8e88-b3d54884a9b7\") " pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:51.462937 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.462903    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twtsh\""
Jul 23 11:10:51.466801 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.466783    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wpkx"
Jul 23 11:10:51.471448 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.471424    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:51.621434 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.621351    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2wpkx"]
Jul 23 11:10:51.626553 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:10:51.626528    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b0290a_0169_43a6_bc50_7ef9f3a83307.slice/crio-e11c88f8afffa6fc7e3a8a65b1d1bc71691c2a79bb5424acf0883e3d95b2390b WatchSource:0}: Error finding container e11c88f8afffa6fc7e3a8a65b1d1bc71691c2a79bb5424acf0883e3d95b2390b: Status 404 returned error can't find the container with id e11c88f8afffa6fc7e3a8a65b1d1bc71691c2a79bb5424acf0883e3d95b2390b
Jul 23 11:10:51.635428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.635403    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4lf4"]
Jul 23 11:10:51.638757 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:10:51.638723    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9944c7e1_695e_42dc_8e88_b3d54884a9b7.slice/crio-f37ba92cc5070d383af6bb04c523954f81fc7b1d4e06f73a5aa4b7287ebee473 WatchSource:0}: Error finding container f37ba92cc5070d383af6bb04c523954f81fc7b1d4e06f73a5aa4b7287ebee473: Status 404 returned error can't find the container with id f37ba92cc5070d383af6bb04c523954f81fc7b1d4e06f73a5aa4b7287ebee473
Jul 23 11:10:51.705386 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.705345    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2wpkx" event={"ID":"42b0290a-0169-43a6-bc50-7ef9f3a83307","Type":"ContainerStarted","Data":"e11c88f8afffa6fc7e3a8a65b1d1bc71691c2a79bb5424acf0883e3d95b2390b"}
Jul 23 11:10:51.706450 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:51.706428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4lf4" event={"ID":"9944c7e1-695e-42dc-8e88-b3d54884a9b7","Type":"ContainerStarted","Data":"f37ba92cc5070d383af6bb04c523954f81fc7b1d4e06f73a5aa4b7287ebee473"}
Jul 23 11:10:52.265820 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:52.265774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:10:52.265820 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:52.265821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:52.265917    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:52.265930    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:52.265941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:52.265975    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:11:24.26596128 +0000 UTC m=+99.312058372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:52.265916    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:52.266021    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:52.266031    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:11:24.266018637 +0000 UTC m=+99.312115729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:52.266345 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:10:52.266061    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:11:24.266047781 +0000 UTC m=+99.312144875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:10:56.720836 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:56.720787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2wpkx" event={"ID":"42b0290a-0169-43a6-bc50-7ef9f3a83307","Type":"ContainerStarted","Data":"79f490798ce20a9e3cf2b51984e68da032b5d47582ced58fbc81b428dfa7b612"}
Jul 23 11:10:56.722800 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:56.722763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4lf4" event={"ID":"9944c7e1-695e-42dc-8e88-b3d54884a9b7","Type":"ContainerStarted","Data":"ef9e695f30c34bf7f986335ba029311b351adea616978a152066be27c7399169"}
Jul 23 11:10:56.723255 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:56.723231    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:10:56.738644 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:56.738543    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2wpkx" podStartSLOduration=66.873147234 podStartE2EDuration="1m11.738527415s" totalImagesPullingTime="4.865380181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:56.737778644 +0000 UTC m=+71.783875760" watchObservedRunningTime="2026-07-23 11:10:56.738527415 +0000 UTC m=+71.784624529"
Jul 23 11:10:56.755112 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:10:56.755058    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l4lf4" podStartSLOduration=66.906058932 podStartE2EDuration="1m11.755038134s" totalImagesPullingTime="4.848979202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:56.754624392 +0000 UTC m=+71.800721522" watchObservedRunningTime="2026-07-23 11:10:56.755038134 +0000 UTC m=+71.801135242"
Jul 23 11:11:24.300645 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:11:24.300603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:11:24.300667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:11:24.300690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:24.300794    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:24.300806    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:24.300829    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:24.300856    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:12:28.300843726 +0000 UTC m=+163.346940832 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:24.300895    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:12:28.300880578 +0000 UTC m=+163.346977671 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:24.300832    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:11:24.301214 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:24.300936    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:12:28.30092978 +0000 UTC m=+163.347026871 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:11:28.729735 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:11:28.729697    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l4lf4"
Jul 23 11:11:55.325439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:11:55.325382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:11:55.325962 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:55.325539    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 11:11:55.325962 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:11:55.325620    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:13:57.325604191 +0000 UTC m=+252.371701286 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : secret "metrics-daemon-secret" not found
Jul 23 11:12:23.367170 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:23.367126    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07"
Jul 23 11:12:23.390260 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:23.390230    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh" podUID="f54c2d77-7029-4781-9689-2e27591917a4"
Jul 23 11:12:23.418614 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:23.418584    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ng7nf" podUID="daec44b2-0237-448c-937f-df1659664a2b"
Jul 23 11:12:23.934058 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:12:23.934028    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:12:23.934213 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:12:23.934028    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:12:23.934213 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:12:23.934040    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:12:24.453233 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:24.453193    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:12:28.363319 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:12:28.363272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:12:28.363346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:12:28.363389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:28.363443    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:28.363476    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:28.363491    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8cc9d968f-bsq2s: secret "image-registry-tls" not found
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:28.363514    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:28.363530    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert podName:f54c2d77-7029-4781-9689-2e27591917a4 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:30.363509794 +0000 UTC m=+285.409606909 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-m8ckh" (UID: "f54c2d77-7029-4781-9689-2e27591917a4") : secret "networking-console-plugin-cert" not found
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:28.363548    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls podName:413542c9-505a-4e44-bd4c-f6ebe21eac07 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:30.363541483 +0000 UTC m=+285.409638577 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls") pod "image-registry-8cc9d968f-bsq2s" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07") : secret "image-registry-tls" not found
Jul 23 11:12:28.363717 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:12:28.363574    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls podName:daec44b2-0237-448c-937f-df1659664a2b nodeName:}" failed. No retries permitted until 2026-07-23 11:14:30.363560839 +0000 UTC m=+285.409657931 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls") pod "dns-default-ng7nf" (UID: "daec44b2-0237-448c-937f-df1659664a2b") : secret "dns-default-metrics-tls" not found
Jul 23 11:12:38.440357 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:12:38.440260    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:13:57.404800 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:57.404722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:13:57.405288 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:13:57.404884    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 11:13:57.405288 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:13:57.404960    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs podName:07af3fec-8472-46a7-9bb6-3c398effb78a nodeName:}" failed. No retries permitted until 2026-07-23 11:15:59.404944196 +0000 UTC m=+374.451041289 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs") pod "network-metrics-daemon-kt2sk" (UID: "07af3fec-8472-46a7-9bb6-3c398effb78a") : secret "metrics-daemon-secret" not found
Jul 23 11:13:58.685548 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.685513    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"]
Jul 23 11:13:58.688553 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.688536    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"]
Jul 23 11:13:58.688668 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.688650    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.691215 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.691195    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"]
Jul 23 11:13:58.691348 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.691285    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.691685 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.691659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8bqj5\""
Jul 23 11:13:58.691787 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.691718    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.691853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.691791    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 11:13:58.691853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.691812    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.691954 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.691892    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 11:13:58.693180 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.693159    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.693640 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.693625    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jkqfn\""
Jul 23 11:13:58.693712 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.693683    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 11:13:58.693922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.693905    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5rb5v"]
Jul 23 11:13:58.694004 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.693970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.694208 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.694189    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.694780 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.694763    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 11:13:58.695868 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.695845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 11:13:58.695946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.695844    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.696174 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.696157    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.696290 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.696275    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 11:13:58.696518 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.696506    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4pltr\""
Jul 23 11:13:58.696872 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.696853    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.698613 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.698597    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.698684 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.698633    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 11:13:58.699203 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.699186    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ll4hw\""
Jul 23 11:13:58.699606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.699591    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 11:13:58.699811 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.699773    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.701258 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.701242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"]
Jul 23 11:13:58.704806 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.704785    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 11:13:58.708035 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.708013    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5rb5v"]
Jul 23 11:13:58.708804 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.708785    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"]
Jul 23 11:13:58.712500 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.712479    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"]
Jul 23 11:13:58.715636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.715608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.715721 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.715659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9de299b5-15a1-435a-948b-1aa2653e8c20-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.715800 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.715717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cscjz\" (UniqueName: \"kubernetes.io/projected/9de299b5-15a1-435a-948b-1aa2653e8c20-kube-api-access-cscjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.715862 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.715821    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6mx5\" (UniqueName: \"kubernetes.io/projected/52293a70-c85a-4730-8dd3-6020ddca452c-kube-api-access-g6mx5\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.715931 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.715907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw8mt\" (UniqueName: \"kubernetes.io/projected/cb0e899f-0f78-4288-bf6d-7ac94c73386f-kube-api-access-rw8mt\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.715990 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.715962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cb0e899f-0f78-4288-bf6d-7ac94c73386f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.716038 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cdef970-2bd2-446e-86ac-fb804aee181e-tmp\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.716093 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cdef970-2bd2-446e-86ac-fb804aee181e-serving-cert\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.716093 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdef970-2bd2-446e-86ac-fb804aee181e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.716181 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8cdef970-2bd2-446e-86ac-fb804aee181e-snapshots\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.716181 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716158    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb66z\" (UniqueName: \"kubernetes.io/projected/8cdef970-2bd2-446e-86ac-fb804aee181e-kube-api-access-mb66z\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.716269 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52293a70-c85a-4730-8dd3-6020ddca452c-config\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.716435 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716404    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9de299b5-15a1-435a-948b-1aa2653e8c20-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.716510 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52293a70-c85a-4730-8dd3-6020ddca452c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.716840 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.716823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdef970-2bd2-446e-86ac-fb804aee181e-service-ca-bundle\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.779228 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.779191    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"]
Jul 23 11:13:58.782239 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.782219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"
Jul 23 11:13:58.784157 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.784139    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-64pjl\""
Jul 23 11:13:58.789493 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.789472    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"]
Jul 23 11:13:58.817705 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52293a70-c85a-4730-8dd3-6020ddca452c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.817705 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdef970-2bd2-446e-86ac-fb804aee181e-service-ca-bundle\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.817922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.817922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9de299b5-15a1-435a-948b-1aa2653e8c20-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.817922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscjz\" (UniqueName: \"kubernetes.io/projected/9de299b5-15a1-435a-948b-1aa2653e8c20-kube-api-access-cscjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.817922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6mx5\" (UniqueName: \"kubernetes.io/projected/52293a70-c85a-4730-8dd3-6020ddca452c-kube-api-access-g6mx5\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.817922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817847    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw8mt\" (UniqueName: \"kubernetes.io/projected/cb0e899f-0f78-4288-bf6d-7ac94c73386f-kube-api-access-rw8mt\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.817922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cb0e899f-0f78-4288-bf6d-7ac94c73386f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.817922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cdef970-2bd2-446e-86ac-fb804aee181e-tmp\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:13:58.817929    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cdef970-2bd2-446e-86ac-fb804aee181e-serving-cert\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.817977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdef970-2bd2-446e-86ac-fb804aee181e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:13:58.818010    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls podName:cb0e899f-0f78-4288-bf6d-7ac94c73386f nodeName:}" failed. No retries permitted until 2026-07-23 11:13:59.317990192 +0000 UTC m=+254.364087285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7qr2l" (UID: "cb0e899f-0f78-4288-bf6d-7ac94c73386f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.818057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8cdef970-2bd2-446e-86ac-fb804aee181e-snapshots\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.818098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb66z\" (UniqueName: \"kubernetes.io/projected/8cdef970-2bd2-446e-86ac-fb804aee181e-kube-api-access-mb66z\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.818130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf2lc\" (UniqueName: \"kubernetes.io/projected/7ef9a341-5e78-4843-af66-b219fe4ab34b-kube-api-access-wf2lc\") pod \"network-check-source-7bc5b6bf85-zsj86\" (UID: \"7ef9a341-5e78-4843-af66-b219fe4ab34b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.818182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52293a70-c85a-4730-8dd3-6020ddca452c-config\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.818253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.818211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9de299b5-15a1-435a-948b-1aa2653e8c20-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.818778 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.818343    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdef970-2bd2-446e-86ac-fb804aee181e-service-ca-bundle\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.818849 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.818805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9de299b5-15a1-435a-948b-1aa2653e8c20-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.819047 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.819022    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cdef970-2bd2-446e-86ac-fb804aee181e-tmp\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.819127 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.819069    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8cdef970-2bd2-446e-86ac-fb804aee181e-snapshots\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.819359 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.819323    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52293a70-c85a-4730-8dd3-6020ddca452c-config\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.819442 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.819413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cdef970-2bd2-446e-86ac-fb804aee181e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.819884 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.819861    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cb0e899f-0f78-4288-bf6d-7ac94c73386f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.820532 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.820513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52293a70-c85a-4730-8dd3-6020ddca452c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.820799 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.820783    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cdef970-2bd2-446e-86ac-fb804aee181e-serving-cert\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.821016 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.820994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9de299b5-15a1-435a-948b-1aa2653e8c20-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.834160 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.834137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cscjz\" (UniqueName: \"kubernetes.io/projected/9de299b5-15a1-435a-948b-1aa2653e8c20-kube-api-access-cscjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-qjqsm\" (UID: \"9de299b5-15a1-435a-948b-1aa2653e8c20\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:58.839694 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.839669    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw8mt\" (UniqueName: \"kubernetes.io/projected/cb0e899f-0f78-4288-bf6d-7ac94c73386f-kube-api-access-rw8mt\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:58.839783 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.839715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6mx5\" (UniqueName: \"kubernetes.io/projected/52293a70-c85a-4730-8dd3-6020ddca452c-kube-api-access-g6mx5\") pod \"service-ca-operator-5bcbc94c78-cj5dd\" (UID: \"52293a70-c85a-4730-8dd3-6020ddca452c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:58.840103 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.840088    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb66z\" (UniqueName: \"kubernetes.io/projected/8cdef970-2bd2-446e-86ac-fb804aee181e-kube-api-access-mb66z\") pod \"insights-operator-555d9d7885-5rb5v\" (UID: \"8cdef970-2bd2-446e-86ac-fb804aee181e\") " pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:58.919270 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.919215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf2lc\" (UniqueName: \"kubernetes.io/projected/7ef9a341-5e78-4843-af66-b219fe4ab34b-kube-api-access-wf2lc\") pod \"network-check-source-7bc5b6bf85-zsj86\" (UID: \"7ef9a341-5e78-4843-af66-b219fe4ab34b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"
Jul 23 11:13:58.927266 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.927236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf2lc\" (UniqueName: \"kubernetes.io/projected/7ef9a341-5e78-4843-af66-b219fe4ab34b-kube-api-access-wf2lc\") pod \"network-check-source-7bc5b6bf85-zsj86\" (UID: \"7ef9a341-5e78-4843-af66-b219fe4ab34b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"
Jul 23 11:13:58.999152 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:58.999087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"
Jul 23 11:13:59.016370 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.016343    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"
Jul 23 11:13:59.022439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.022417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5rb5v"
Jul 23 11:13:59.092954 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.092732    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"
Jul 23 11:13:59.145196 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.145163    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd"]
Jul 23 11:13:59.156833 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:13:59.156799    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52293a70_c85a_4730_8dd3_6020ddca452c.slice/crio-ff58b3d868993672738c881737a25956ce8098a0ab1be5f2eeccdd79420f67c8 WatchSource:0}: Error finding container ff58b3d868993672738c881737a25956ce8098a0ab1be5f2eeccdd79420f67c8: Status 404 returned error can't find the container with id ff58b3d868993672738c881737a25956ce8098a0ab1be5f2eeccdd79420f67c8
Jul 23 11:13:59.180970 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.180939    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm"]
Jul 23 11:13:59.184987 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:13:59.184958    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de299b5_15a1_435a_948b_1aa2653e8c20.slice/crio-fe3ec48c546cb5d9850191576c4921c782986bb8855c18eb2b9b96bceeb60058 WatchSource:0}: Error finding container fe3ec48c546cb5d9850191576c4921c782986bb8855c18eb2b9b96bceeb60058: Status 404 returned error can't find the container with id fe3ec48c546cb5d9850191576c4921c782986bb8855c18eb2b9b96bceeb60058
Jul 23 11:13:59.205413 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.205382    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5rb5v"]
Jul 23 11:13:59.208360 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:13:59.208332    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdef970_2bd2_446e_86ac_fb804aee181e.slice/crio-32f89397d39fa80d8b36ff8ba800e95e0ea63704ad463943edc140f2eb1db905 WatchSource:0}: Error finding container 32f89397d39fa80d8b36ff8ba800e95e0ea63704ad463943edc140f2eb1db905: Status 404 returned error can't find the container with id 32f89397d39fa80d8b36ff8ba800e95e0ea63704ad463943edc140f2eb1db905
Jul 23 11:13:59.249838 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.249764    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86"]
Jul 23 11:13:59.253071 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:13:59.253044    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef9a341_5e78_4843_af66_b219fe4ab34b.slice/crio-90e049d572f36cee2392d44eff65e8c0a7ecebf99e282a04f86da3bdb0c437ea WatchSource:0}: Error finding container 90e049d572f36cee2392d44eff65e8c0a7ecebf99e282a04f86da3bdb0c437ea: Status 404 returned error can't find the container with id 90e049d572f36cee2392d44eff65e8c0a7ecebf99e282a04f86da3bdb0c437ea
Jul 23 11:13:59.322635 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:13:59.322598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:13:59.322782 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:13:59.322760    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 11:13:59.322839 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:13:59.322818    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls podName:cb0e899f-0f78-4288-bf6d-7ac94c73386f nodeName:}" failed. No retries permitted until 2026-07-23 11:14:00.322803245 +0000 UTC m=+255.368900345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7qr2l" (UID: "cb0e899f-0f78-4288-bf6d-7ac94c73386f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:00.163169 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:00.163125    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd" event={"ID":"52293a70-c85a-4730-8dd3-6020ddca452c","Type":"ContainerStarted","Data":"ff58b3d868993672738c881737a25956ce8098a0ab1be5f2eeccdd79420f67c8"}
Jul 23 11:14:00.164353 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:00.164327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5rb5v" event={"ID":"8cdef970-2bd2-446e-86ac-fb804aee181e","Type":"ContainerStarted","Data":"32f89397d39fa80d8b36ff8ba800e95e0ea63704ad463943edc140f2eb1db905"}
Jul 23 11:14:00.165495 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:00.165472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm" event={"ID":"9de299b5-15a1-435a-948b-1aa2653e8c20","Type":"ContainerStarted","Data":"fe3ec48c546cb5d9850191576c4921c782986bb8855c18eb2b9b96bceeb60058"}
Jul 23 11:14:00.166952 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:00.166924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86" event={"ID":"7ef9a341-5e78-4843-af66-b219fe4ab34b","Type":"ContainerStarted","Data":"71994d1617646e9e6bcc805dde1c7e0bb0e3fdb0eaa602a61d3fd291697064f1"}
Jul 23 11:14:00.167055 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:00.166963    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86" event={"ID":"7ef9a341-5e78-4843-af66-b219fe4ab34b","Type":"ContainerStarted","Data":"90e049d572f36cee2392d44eff65e8c0a7ecebf99e282a04f86da3bdb0c437ea"}
Jul 23 11:14:00.186470 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:00.186406    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zsj86" podStartSLOduration=2.186390627 podStartE2EDuration="2.186390627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:00.185388913 +0000 UTC m=+255.231486029" watchObservedRunningTime="2026-07-23 11:14:00.186390627 +0000 UTC m=+255.232487740"
Jul 23 11:14:00.330910 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:00.330876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:14:00.331137 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:00.331036    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:00.331137 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:00.331109    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls podName:cb0e899f-0f78-4288-bf6d-7ac94c73386f nodeName:}" failed. No retries permitted until 2026-07-23 11:14:02.331090856 +0000 UTC m=+257.377187951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7qr2l" (UID: "cb0e899f-0f78-4288-bf6d-7ac94c73386f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:02.347727 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:02.347692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:14:02.348085 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:02.347845    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:02.348085 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:02.347919    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls podName:cb0e899f-0f78-4288-bf6d-7ac94c73386f nodeName:}" failed. No retries permitted until 2026-07-23 11:14:06.347900139 +0000 UTC m=+261.393997248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7qr2l" (UID: "cb0e899f-0f78-4288-bf6d-7ac94c73386f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:03.182428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.182385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd" event={"ID":"52293a70-c85a-4730-8dd3-6020ddca452c","Type":"ContainerStarted","Data":"fb9cb3d903bcfc5e549ee7b91cc51e55a06d46c5276c22ca735c0742ea717823"}
Jul 23 11:14:03.184190 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.184153    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5rb5v" event={"ID":"8cdef970-2bd2-446e-86ac-fb804aee181e","Type":"ContainerStarted","Data":"442a51eb33c184db1415ec42b785dd30c9305ea4cb93a8e02846cfabfbcdf4d5"}
Jul 23 11:14:03.185685 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.185656    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm" event={"ID":"9de299b5-15a1-435a-948b-1aa2653e8c20","Type":"ContainerStarted","Data":"03a328242c3e7391b82e418430b8059f43a6e2174c24489521cb3a55a384fd35"}
Jul 23 11:14:03.200088 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.200006    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd" podStartSLOduration=2.050134653 podStartE2EDuration="5.199984929s" totalImagesPullingTime="3.149850276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:03.198651688 +0000 UTC m=+258.244748803" watchObservedRunningTime="2026-07-23 11:14:03.199984929 +0000 UTC m=+258.246082045"
Jul 23 11:14:03.216498 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.216442    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm" podStartSLOduration=2.091179145 podStartE2EDuration="5.216427311s" totalImagesPullingTime="3.125248166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:03.215665544 +0000 UTC m=+258.261762659" watchObservedRunningTime="2026-07-23 11:14:03.216427311 +0000 UTC m=+258.262524405"
Jul 23 11:14:03.232656 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.232586    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-5rb5v" podStartSLOduration=2.128020285 podStartE2EDuration="5.232561218s" totalImagesPullingTime="3.104540933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:03.232304755 +0000 UTC m=+258.278401871" watchObservedRunningTime="2026-07-23 11:14:03.232561218 +0000 UTC m=+258.278658353"
Jul 23 11:14:03.873297 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.873239    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h8dz5"]
Jul 23 11:14:03.877865 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.877840    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:03.885020 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.884993    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 11:14:03.885163 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.885140    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r4rm6\""
Jul 23 11:14:03.885993 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.885973    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 11:14:03.912441 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.912406    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8dz5"]
Jul 23 11:14:03.961987 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.961953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-crio-socket\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:03.962186 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.962001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:03.962186 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.962092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-data-volume\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:03.962186 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.962132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:03.962186 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:03.962180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wf67\" (UniqueName: \"kubernetes.io/projected/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-api-access-2wf67\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063213 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.063167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-data-volume\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063213 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.063211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063458 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.063282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wf67\" (UniqueName: \"kubernetes.io/projected/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-api-access-2wf67\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063458 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.063372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-crio-socket\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063458 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.063396    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:04.063458 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.063399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063693 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.063468    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:04.563450601 +0000 UTC m=+259.609547711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:04.063693 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.063469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-crio-socket\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063693 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.063599    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-data-volume\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.063693 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.063602    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.063693 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.063683    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:04.563663529 +0000 UTC m=+259.609760628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.077232 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.077203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wf67\" (UniqueName: \"kubernetes.io/projected/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-api-access-2wf67\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.567839 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.567805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.568008 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:04.567880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:04.568008 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.567970    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.568077 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.568001    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:04.568077 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.568034    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:05.568018319 +0000 UTC m=+260.614115425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.568077 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:04.568053    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:05.568040366 +0000 UTC m=+260.614137461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:05.150967 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.150935    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"]
Jul 23 11:14:05.154144 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.154128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"
Jul 23 11:14:05.156529 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.156503    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s9bwd\""
Jul 23 11:14:05.157118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.157101    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 11:14:05.157361 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.157346    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 11:14:05.165492 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.165470    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"]
Jul 23 11:14:05.273347 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.273305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nsqf\" (UniqueName: \"kubernetes.io/projected/e6106ffb-5dc6-469f-83de-1d5d3487f63e-kube-api-access-7nsqf\") pod \"migrator-7cc9c7ffd7-bjd2g\" (UID: \"e6106ffb-5dc6-469f-83de-1d5d3487f63e\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"
Jul 23 11:14:05.374044 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.374002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsqf\" (UniqueName: \"kubernetes.io/projected/e6106ffb-5dc6-469f-83de-1d5d3487f63e-kube-api-access-7nsqf\") pod \"migrator-7cc9c7ffd7-bjd2g\" (UID: \"e6106ffb-5dc6-469f-83de-1d5d3487f63e\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"
Jul 23 11:14:05.383131 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.383099    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nsqf\" (UniqueName: \"kubernetes.io/projected/e6106ffb-5dc6-469f-83de-1d5d3487f63e-kube-api-access-7nsqf\") pod \"migrator-7cc9c7ffd7-bjd2g\" (UID: \"e6106ffb-5dc6-469f-83de-1d5d3487f63e\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"
Jul 23 11:14:05.463676 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.463585    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"
Jul 23 11:14:05.576189 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.576148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:05.576349 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.576320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:05.576349 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:05.576321    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:05.576441 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:05.576384    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:05.576441 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:05.576388    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:07.576373457 +0000 UTC m=+262.622470550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:05.576516 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:05.576450    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:07.576436744 +0000 UTC m=+262.622533839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:05.596523 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:05.596491    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g"]
Jul 23 11:14:05.599395 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:05.599370    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6106ffb_5dc6_469f_83de_1d5d3487f63e.slice/crio-25963dc7adabde67c0682c2eb92376d0f7bcfdfc41bb517e2119f9169e98a7cf WatchSource:0}: Error finding container 25963dc7adabde67c0682c2eb92376d0f7bcfdfc41bb517e2119f9169e98a7cf: Status 404 returned error can't find the container with id 25963dc7adabde67c0682c2eb92376d0f7bcfdfc41bb517e2119f9169e98a7cf
Jul 23 11:14:06.110669 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.110642    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4ksk_aab107ec-362a-46b6-8bf0-cd3bebfcc169/dns-node-resolver/0.log"
Jul 23 11:14:06.196679 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.196637    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g" event={"ID":"e6106ffb-5dc6-469f-83de-1d5d3487f63e","Type":"ContainerStarted","Data":"25963dc7adabde67c0682c2eb92376d0f7bcfdfc41bb517e2119f9169e98a7cf"}
Jul 23 11:14:06.216204 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.216173    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-m5k5l"]
Jul 23 11:14:06.220515 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.220496    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.222948 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.222928    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 11:14:06.223379 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.223359    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 11:14:06.223644 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.223630    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 11:14:06.224064 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.224048    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6f44l\""
Jul 23 11:14:06.224128 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.224066    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 11:14:06.227784 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.227540    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-m5k5l"]
Jul 23 11:14:06.282111 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.282074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stjzt\" (UniqueName: \"kubernetes.io/projected/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-kube-api-access-stjzt\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.282295 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.282167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-signing-cabundle\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.282353 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.282335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-signing-key\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.383215 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.383128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stjzt\" (UniqueName: \"kubernetes.io/projected/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-kube-api-access-stjzt\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.383215 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.383198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:14:06.383449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.383232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-signing-cabundle\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.383449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.383288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-signing-key\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.383449 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:06.383377    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:06.383449 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:06.383435    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls podName:cb0e899f-0f78-4288-bf6d-7ac94c73386f nodeName:}" failed. No retries permitted until 2026-07-23 11:14:14.383418508 +0000 UTC m=+269.429515611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7qr2l" (UID: "cb0e899f-0f78-4288-bf6d-7ac94c73386f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:06.384039 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.384000    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-signing-cabundle\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.386313 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.386284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-signing-key\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.394589 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.394560    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stjzt\" (UniqueName: \"kubernetes.io/projected/41a55eee-5fe3-4d79-9f25-d02d6d112b6a-kube-api-access-stjzt\") pod \"service-ca-58598695f7-m5k5l\" (UID: \"41a55eee-5fe3-4d79-9f25-d02d6d112b6a\") " pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.530377 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.530335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-m5k5l"
Jul 23 11:14:06.665758 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.665663    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-m5k5l"]
Jul 23 11:14:06.710671 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:06.710641    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bc655_27c2e954-39ee-42f6-91f5-29b5a62ae5ed/node-ca/0.log"
Jul 23 11:14:06.862056 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:06.862017    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a55eee_5fe3_4d79_9f25_d02d6d112b6a.slice/crio-3f7304a7450a8c553addee224e72c60adb082908573fcb8e6f2d40e490c4d638 WatchSource:0}: Error finding container 3f7304a7450a8c553addee224e72c60adb082908573fcb8e6f2d40e490c4d638: Status 404 returned error can't find the container with id 3f7304a7450a8c553addee224e72c60adb082908573fcb8e6f2d40e490c4d638
Jul 23 11:14:07.201931 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.201839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-m5k5l" event={"ID":"41a55eee-5fe3-4d79-9f25-d02d6d112b6a","Type":"ContainerStarted","Data":"3152a6df74fafd67d3969c4b1c24f77358d4989f34fa06ada36351ab23eccdbe"}
Jul 23 11:14:07.201931 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.201893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-m5k5l" event={"ID":"41a55eee-5fe3-4d79-9f25-d02d6d112b6a","Type":"ContainerStarted","Data":"3f7304a7450a8c553addee224e72c60adb082908573fcb8e6f2d40e490c4d638"}
Jul 23 11:14:07.203521 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.203487    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g" event={"ID":"e6106ffb-5dc6-469f-83de-1d5d3487f63e","Type":"ContainerStarted","Data":"5c5100b84efb8155ad54ebda308ebdac7f029ac951d726c371df014fda9738b2"}
Jul 23 11:14:07.203648 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.203548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g" event={"ID":"e6106ffb-5dc6-469f-83de-1d5d3487f63e","Type":"ContainerStarted","Data":"f72ace6bd34559fa639eccb71200d2648007b6893fc5dd0a61f40be262825a5a"}
Jul 23 11:14:07.221406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.221345    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-m5k5l" podStartSLOduration=1.221323706 podStartE2EDuration="1.221323706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:07.220462605 +0000 UTC m=+262.266559719" watchObservedRunningTime="2026-07-23 11:14:07.221323706 +0000 UTC m=+262.267420801"
Jul 23 11:14:07.246962 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.246902    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-bjd2g" podStartSLOduration=0.939722172 podStartE2EDuration="2.246880571s" totalImagesPullingTime="1.307158399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:07.245557101 +0000 UTC m=+262.291654214" watchObservedRunningTime="2026-07-23 11:14:07.246880571 +0000 UTC m=+262.292977686"
Jul 23 11:14:07.511695 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.511623    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2q4xk_ce6cec9b-d877-44dc-8e1b-1a08277d7cc0/serve-healthcheck-canary/0.log"
Jul 23 11:14:07.596062 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.596018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:07.596248 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:07.596099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:07.596248 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:07.596155    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:07.596248 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:07.596178    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:07.596248 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:07.596217    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:11.596203013 +0000 UTC m=+266.642300105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:07.596248 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:07.596230    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:11.596224805 +0000 UTC m=+266.642321897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:11.626554 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:11.626516    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:11.627053 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:11.626581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:11.627053 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:11.626701    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:11.627053 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:11.626767    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:11.627053 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:11.626816    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:19.626794592 +0000 UTC m=+274.672891683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:11.627053 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:11.626839    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm podName:3f076788-01f9-4b1e-81b2-1b916ce9a4d7 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:19.62682856 +0000 UTC m=+274.672925654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8dz5" (UID: "3f076788-01f9-4b1e-81b2-1b916ce9a4d7") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:14.452411 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:14.452373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:14:14.452807 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:14.452520    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:14.452807 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:14.452594    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls podName:cb0e899f-0f78-4288-bf6d-7ac94c73386f nodeName:}" failed. No retries permitted until 2026-07-23 11:14:30.452578959 +0000 UTC m=+285.498676051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7qr2l" (UID: "cb0e899f-0f78-4288-bf6d-7ac94c73386f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 11:14:19.699034 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:19.698991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:19.699510 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:19.699064    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:19.699551 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:19.699537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:19.701283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:19.701262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f076788-01f9-4b1e-81b2-1b916ce9a4d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8dz5\" (UID: \"3f076788-01f9-4b1e-81b2-1b916ce9a4d7\") " pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:19.788920 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:19.788880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8dz5"
Jul 23 11:14:19.926083 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:19.925976    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8dz5"]
Jul 23 11:14:19.930876 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:19.930836    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f076788_01f9_4b1e_81b2_1b916ce9a4d7.slice/crio-936e88d444c72b8512a85b28935ed46bbcb2db876639a7d6fb073ec20a95da5a WatchSource:0}: Error finding container 936e88d444c72b8512a85b28935ed46bbcb2db876639a7d6fb073ec20a95da5a: Status 404 returned error can't find the container with id 936e88d444c72b8512a85b28935ed46bbcb2db876639a7d6fb073ec20a95da5a
Jul 23 11:14:20.242596 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:20.242561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8dz5" event={"ID":"3f076788-01f9-4b1e-81b2-1b916ce9a4d7","Type":"ContainerStarted","Data":"936e88d444c72b8512a85b28935ed46bbcb2db876639a7d6fb073ec20a95da5a"}
Jul 23 11:14:26.264136 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:26.264098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8dz5" event={"ID":"3f076788-01f9-4b1e-81b2-1b916ce9a4d7","Type":"ContainerStarted","Data":"10c619300a45de25fa77e1c7a39bedb73bd22ecc37a11177aa7a014afac849e4"}
Jul 23 11:14:26.934786 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:26.934726    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ng7nf" podUID="daec44b2-0237-448c-937f-df1659664a2b"
Jul 23 11:14:26.934937 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:26.934726    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07"
Jul 23 11:14:26.934937 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:26.934832    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh" podUID="f54c2d77-7029-4781-9689-2e27591917a4"
Jul 23 11:14:27.268941 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:27.268601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:14:27.268941 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:27.268636    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:14:27.268941 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:27.268609    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:14:28.567411 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.567376    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-c5fff"]
Jul 23 11:14:28.593154 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.593119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-c5fff"]
Jul 23 11:14:28.593332 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.593247    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-c5fff"
Jul 23 11:14:28.598971 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.596820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 11:14:28.598971 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.596837    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 11:14:28.598971 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.597420    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-r6kjj\""
Jul 23 11:14:28.774086 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.774052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd9wn\" (UniqueName: \"kubernetes.io/projected/33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3-kube-api-access-zd9wn\") pod \"downloads-5bc67dcd46-c5fff\" (UID: \"33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3\") " pod="openshift-console/downloads-5bc67dcd46-c5fff"
Jul 23 11:14:28.874640 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.874524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd9wn\" (UniqueName: \"kubernetes.io/projected/33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3-kube-api-access-zd9wn\") pod \"downloads-5bc67dcd46-c5fff\" (UID: \"33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3\") " pod="openshift-console/downloads-5bc67dcd46-c5fff"
Jul 23 11:14:28.890860 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.890827    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd9wn\" (UniqueName: \"kubernetes.io/projected/33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3-kube-api-access-zd9wn\") pod \"downloads-5bc67dcd46-c5fff\" (UID: \"33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3\") " pod="openshift-console/downloads-5bc67dcd46-c5fff"
Jul 23 11:14:28.909734 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:28.909697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-c5fff"
Jul 23 11:14:29.521090 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:29.521067    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-c5fff"]
Jul 23 11:14:29.524246 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:29.524220    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e29d1b_9400_4ab0_ac0e_d64e3bde1cd3.slice/crio-4742d3e6dccce4d2abaf51a5da5a76a43fa208db4eb0e20155ca6b0263d2bb3c WatchSource:0}: Error finding container 4742d3e6dccce4d2abaf51a5da5a76a43fa208db4eb0e20155ca6b0263d2bb3c: Status 404 returned error can't find the container with id 4742d3e6dccce4d2abaf51a5da5a76a43fa208db4eb0e20155ca6b0263d2bb3c
Jul 23 11:14:30.282338 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.282251    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8dz5" event={"ID":"3f076788-01f9-4b1e-81b2-1b916ce9a4d7","Type":"ContainerStarted","Data":"a78526c8328dafedb77bd5d38a8160963a09c63891ca16fe02ea00f01858e701"}
Jul 23 11:14:30.283685 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.283647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-c5fff" event={"ID":"33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3","Type":"ContainerStarted","Data":"4742d3e6dccce4d2abaf51a5da5a76a43fa208db4eb0e20155ca6b0263d2bb3c"}
Jul 23 11:14:30.386937 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.386903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:14:30.387120 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.386954    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:14:30.387120 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.387034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:14:30.390086 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.390056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/daec44b2-0237-448c-937f-df1659664a2b-metrics-tls\") pod \"dns-default-ng7nf\" (UID: \"daec44b2-0237-448c-937f-df1659664a2b\") " pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:14:30.390263 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.390243    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"image-registry-8cc9d968f-bsq2s\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") " pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:14:30.390547 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.390528    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f54c2d77-7029-4781-9689-2e27591917a4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-m8ckh\" (UID: \"f54c2d77-7029-4781-9689-2e27591917a4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:14:30.488078 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.487978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:14:30.490946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.490916    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb0e899f-0f78-4288-bf6d-7ac94c73386f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7qr2l\" (UID: \"cb0e899f-0f78-4288-bf6d-7ac94c73386f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:14:30.507077 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.507050    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"
Jul 23 11:14:30.581012 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.580389    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j422v\""
Jul 23 11:14:30.581012 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.580626    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hxmt4\""
Jul 23 11:14:30.581012 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.580869    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2b25g\""
Jul 23 11:14:30.581533 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.581312    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:14:30.581951 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.581879    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:14:30.592145 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.591791    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"
Jul 23 11:14:30.704145 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.704072    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l"]
Jul 23 11:14:30.780731 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.780701    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ng7nf"]
Jul 23 11:14:30.784678 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:30.784643    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaec44b2_0237_448c_937f_df1659664a2b.slice/crio-22050eca6d3c668dbcff320ce907eaa568f94732f94dcc62808936b6b7040a2b WatchSource:0}: Error finding container 22050eca6d3c668dbcff320ce907eaa568f94732f94dcc62808936b6b7040a2b: Status 404 returned error can't find the container with id 22050eca6d3c668dbcff320ce907eaa568f94732f94dcc62808936b6b7040a2b
Jul 23 11:14:30.803768 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:30.803594    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cc9d968f-bsq2s"]
Jul 23 11:14:30.807154 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:30.807124    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413542c9_505a_4e44_bd4c_f6ebe21eac07.slice/crio-68942d541cf550bc6476dc6552fd8d414048296dc0a979a5f3a2744ffa00ee68 WatchSource:0}: Error finding container 68942d541cf550bc6476dc6552fd8d414048296dc0a979a5f3a2744ffa00ee68: Status 404 returned error can't find the container with id 68942d541cf550bc6476dc6552fd8d414048296dc0a979a5f3a2744ffa00ee68
Jul 23 11:14:31.008474 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.008435    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh"]
Jul 23 11:14:31.012616 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:31.012576    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54c2d77_7029_4781_9689_2e27591917a4.slice/crio-6fcd23f06fa5cfde5a1ccfa9619f5a91c3842b8a4efac2fddcc3b57847193a37 WatchSource:0}: Error finding container 6fcd23f06fa5cfde5a1ccfa9619f5a91c3842b8a4efac2fddcc3b57847193a37: Status 404 returned error can't find the container with id 6fcd23f06fa5cfde5a1ccfa9619f5a91c3842b8a4efac2fddcc3b57847193a37
Jul 23 11:14:31.289321 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.289226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh" event={"ID":"f54c2d77-7029-4781-9689-2e27591917a4","Type":"ContainerStarted","Data":"6fcd23f06fa5cfde5a1ccfa9619f5a91c3842b8a4efac2fddcc3b57847193a37"}
Jul 23 11:14:31.290592 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.290561    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l" event={"ID":"cb0e899f-0f78-4288-bf6d-7ac94c73386f","Type":"ContainerStarted","Data":"693e315a38183316a7b8cc721774e1dee4602f7841f96e968497e29975b64998"}
Jul 23 11:14:31.292671 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.292644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" event={"ID":"413542c9-505a-4e44-bd4c-f6ebe21eac07","Type":"ContainerStarted","Data":"9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc"}
Jul 23 11:14:31.292792 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.292688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" event={"ID":"413542c9-505a-4e44-bd4c-f6ebe21eac07","Type":"ContainerStarted","Data":"68942d541cf550bc6476dc6552fd8d414048296dc0a979a5f3a2744ffa00ee68"}
Jul 23 11:14:31.292792 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.292734    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:14:31.294237 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.294209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng7nf" event={"ID":"daec44b2-0237-448c-937f-df1659664a2b","Type":"ContainerStarted","Data":"22050eca6d3c668dbcff320ce907eaa568f94732f94dcc62808936b6b7040a2b"}
Jul 23 11:14:31.328132 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:31.327784    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" podStartSLOduration=286.327753505 podStartE2EDuration="4m46.327753505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:31.326022684 +0000 UTC m=+286.372119802" watchObservedRunningTime="2026-07-23 11:14:31.327753505 +0000 UTC m=+286.373850618"
Jul 23 11:14:36.320088 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.319985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh" event={"ID":"f54c2d77-7029-4781-9689-2e27591917a4","Type":"ContainerStarted","Data":"56d717fd7da10920262f0fd930f1ecf5978f8747fcf2827680618c0b43935a69"}
Jul 23 11:14:36.322086 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.322056    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l" event={"ID":"cb0e899f-0f78-4288-bf6d-7ac94c73386f","Type":"ContainerStarted","Data":"0794264d1254a6b08d956142a458375332a9931c607a813fa5d1981e3c02a7f0"}
Jul 23 11:14:36.324127 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.324097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng7nf" event={"ID":"daec44b2-0237-448c-937f-df1659664a2b","Type":"ContainerStarted","Data":"9f4d7f4f8d142204fcd35a207a945af7c71b60a06805a96463259e506a1142c3"}
Jul 23 11:14:36.324259 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.324149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng7nf" event={"ID":"daec44b2-0237-448c-937f-df1659664a2b","Type":"ContainerStarted","Data":"7da6b2bd27974f7207e8de9b7d2607fc9d2fa8f0ee1c615051c1d799c9edf697"}
Jul 23 11:14:36.324259 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.324181    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:14:36.326511 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.326487    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8dz5" event={"ID":"3f076788-01f9-4b1e-81b2-1b916ce9a4d7","Type":"ContainerStarted","Data":"ebffb2e285674e718498ef9c890620dcbb4f8428e20723b6491db75a2ead06f9"}
Jul 23 11:14:36.338157 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.338108    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-m8ckh" podStartSLOduration=276.003808542 podStartE2EDuration="4m40.338092606s" totalImagesPullingTime="4.334284064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:36.337026751 +0000 UTC m=+291.383123866" watchObservedRunningTime="2026-07-23 11:14:36.338092606 +0000 UTC m=+291.384189720"
Jul 23 11:14:36.354846 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.354798    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ng7nf" podStartSLOduration=251.787770478 podStartE2EDuration="4m16.354778514s" totalImagesPullingTime="4.567008036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:36.352824113 +0000 UTC m=+291.398921229" watchObservedRunningTime="2026-07-23 11:14:36.354778514 +0000 UTC m=+291.400875626"
Jul 23 11:14:36.371040 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.370977    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7qr2l" podStartSLOduration=33.734999764 podStartE2EDuration="38.370958691s" totalImagesPullingTime="4.635958927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:36.369891268 +0000 UTC m=+291.415988396" watchObservedRunningTime="2026-07-23 11:14:36.370958691 +0000 UTC m=+291.417055810"
Jul 23 11:14:36.388464 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:36.388411    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h8dz5" podStartSLOduration=18.112915716 podStartE2EDuration="33.388395416s" totalImagesPullingTime="15.2754797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:14:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:36.386701098 +0000 UTC m=+291.432798224" watchObservedRunningTime="2026-07-23 11:14:36.388395416 +0000 UTC m=+291.434492544"
Jul 23 11:14:41.016210 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.016171    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"]
Jul 23 11:14:41.020446 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.020423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.023636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.023539    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 11:14:41.023636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.023600    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 11:14:41.023636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.023623    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6d42f\""
Jul 23 11:14:41.023881 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.023542    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 11:14:41.029470 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.029231    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"]
Jul 23 11:14:41.076700 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.076664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/357a8498-0cd2-42f9-a253-6f6435d28391-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.076915 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.076793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qqqc\" (UniqueName: \"kubernetes.io/projected/357a8498-0cd2-42f9-a253-6f6435d28391-kube-api-access-9qqqc\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.076915 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.076834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/357a8498-0cd2-42f9-a253-6f6435d28391-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.076915 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.076871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/357a8498-0cd2-42f9-a253-6f6435d28391-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.177875 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.177832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qqqc\" (UniqueName: \"kubernetes.io/projected/357a8498-0cd2-42f9-a253-6f6435d28391-kube-api-access-9qqqc\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.177875 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.177877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/357a8498-0cd2-42f9-a253-6f6435d28391-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.178091 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.177910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/357a8498-0cd2-42f9-a253-6f6435d28391-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.178091 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.177952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/357a8498-0cd2-42f9-a253-6f6435d28391-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.178832 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.178796    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/357a8498-0cd2-42f9-a253-6f6435d28391-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.180683 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.180659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/357a8498-0cd2-42f9-a253-6f6435d28391-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.180808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.180716    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/357a8498-0cd2-42f9-a253-6f6435d28391-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.188470 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.188443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qqqc\" (UniqueName: \"kubernetes.io/projected/357a8498-0cd2-42f9-a253-6f6435d28391-kube-api-access-9qqqc\") pod \"prometheus-operator-5945b5cfd-94nn6\" (UID: \"357a8498-0cd2-42f9-a253-6f6435d28391\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.332695 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:41.332660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"
Jul 23 11:14:41.441844 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:41.441798    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kt2sk" podUID="07af3fec-8472-46a7-9bb6-3c398effb78a"
Jul 23 11:14:46.332362 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:46.332327    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ng7nf"
Jul 23 11:14:47.334265 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:47.334213    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 11:14:47.436402 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:47.436370    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-94nn6"]
Jul 23 11:14:47.541056 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:47.541024    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357a8498_0cd2_42f9_a253_6f6435d28391.slice/crio-8497bb6defb6aa392671e703ccf7d02c0cefc74e9ce08d10c502aa6c92c7b1f4 WatchSource:0}: Error finding container 8497bb6defb6aa392671e703ccf7d02c0cefc74e9ce08d10c502aa6c92c7b1f4: Status 404 returned error can't find the container with id 8497bb6defb6aa392671e703ccf7d02c0cefc74e9ce08d10c502aa6c92c7b1f4
Jul 23 11:14:47.569386 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:47.569362    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:14:48.377223 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:48.377176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-c5fff" event={"ID":"33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3","Type":"ContainerStarted","Data":"b45b8706c14de33929ca0d4b94fa453e3e24d9a48251fd4fb54609b58ffea02b"}
Jul 23 11:14:48.377841 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:48.377801    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-c5fff"
Jul 23 11:14:48.379906 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:48.379873    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6" event={"ID":"357a8498-0cd2-42f9-a253-6f6435d28391","Type":"ContainerStarted","Data":"8497bb6defb6aa392671e703ccf7d02c0cefc74e9ce08d10c502aa6c92c7b1f4"}
Jul 23 11:14:48.388814 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:48.388772    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-c5fff"
Jul 23 11:14:48.409959 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:48.409582    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-c5fff" podStartSLOduration=2.319156962 podStartE2EDuration="20.40956229s" totalImagesPullingTime="18.090405328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:48.407854108 +0000 UTC m=+303.453951223" watchObservedRunningTime="2026-07-23 11:14:48.40956229 +0000 UTC m=+303.455659406"
Jul 23 11:14:50.391547 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:50.391503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6" event={"ID":"357a8498-0cd2-42f9-a253-6f6435d28391","Type":"ContainerStarted","Data":"966d6881b3c1ad3f74777b6ba7d1ca8669f8896f679033f1284b9b3b0fc1eb45"}
Jul 23 11:14:50.392005 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:50.391574    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6" event={"ID":"357a8498-0cd2-42f9-a253-6f6435d28391","Type":"ContainerStarted","Data":"360266e7186535b87164794df1e623634555acb3547117938393bc7bd71d8d7b"}
Jul 23 11:14:50.409118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:50.409055    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-94nn6" podStartSLOduration=8.506905775 podStartE2EDuration="10.409035747s" totalImagesPullingTime="1.902129972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:50.408248124 +0000 UTC m=+305.454345244" watchObservedRunningTime="2026-07-23 11:14:50.409035747 +0000 UTC m=+305.455132862"
Jul 23 11:14:50.587482 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:50.587442    2573 patch_prober.go:28] interesting pod/image-registry-8cc9d968f-bsq2s container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 11:14:50.587669 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:50.587498    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 11:14:51.157457 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:51.157420    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8cc9d968f-bsq2s"]
Jul 23 11:14:51.162494 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:51.162453    2573 patch_prober.go:28] interesting pod/image-registry-8cc9d968f-bsq2s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 11:14:51.162676 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:51.162523    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 11:14:52.425361 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.425320    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8ncdj"]
Jul 23 11:14:52.518549 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.518514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.519261 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.518520    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:14:52.522471 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.522444    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 11:14:52.522989 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.522787    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfcwj\""
Jul 23 11:14:52.522989 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.522829    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 11:14:52.530494 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.529592    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 11:14:52.585209 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-sys\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585236    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-textfile\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-wtmp\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-root\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-tls\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585676 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585676 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-metrics-client-ca\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.585676 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.585492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9tq4\" (UniqueName: \"kubernetes.io/projected/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-kube-api-access-g9tq4\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-metrics-client-ca\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9tq4\" (UniqueName: \"kubernetes.io/projected/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-kube-api-access-g9tq4\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686437 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686141    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-sys\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686437 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-textfile\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686437 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686437 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-wtmp\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686437 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-root\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686437 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-tls\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.686437 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.686314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.687095 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.687071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-textfile\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.687193 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.687154    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-sys\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.687297 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.687273    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-wtmp\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.687426 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.687389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-root\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.687494 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:52.687464    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 11:14:52.687545 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:14:52.687538    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-tls podName:d4b5dba3-0f7f-43ad-944d-d1c37dea755f nodeName:}" failed. No retries permitted until 2026-07-23 11:14:53.18751938 +0000 UTC m=+308.233616474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-tls") pod "node-exporter-8ncdj" (UID: "d4b5dba3-0f7f-43ad-944d-d1c37dea755f") : secret "node-exporter-tls" not found
Jul 23 11:14:52.687731 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.687685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-metrics-client-ca\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.687935 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.687913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.691316 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.691274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:52.699589 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:52.699558    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9tq4\" (UniqueName: \"kubernetes.io/projected/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-kube-api-access-g9tq4\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:53.191959 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:53.191903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-tls\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:53.194779 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:53.194724    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4b5dba3-0f7f-43ad-944d-d1c37dea755f-node-exporter-tls\") pod \"node-exporter-8ncdj\" (UID: \"d4b5dba3-0f7f-43ad-944d-d1c37dea755f\") " pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:53.436016 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:53.435970    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8ncdj"
Jul 23 11:14:53.487908 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:53.487875    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b5dba3_0f7f_43ad_944d_d1c37dea755f.slice/crio-092379d9904cfb7ecdf81d9da111246cc48e581c00cf0dcdfb7ceea9eb0c1d54 WatchSource:0}: Error finding container 092379d9904cfb7ecdf81d9da111246cc48e581c00cf0dcdfb7ceea9eb0c1d54: Status 404 returned error can't find the container with id 092379d9904cfb7ecdf81d9da111246cc48e581c00cf0dcdfb7ceea9eb0c1d54
Jul 23 11:14:54.412793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.412738    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"]
Jul 23 11:14:54.443313 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.443214    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ncdj" event={"ID":"d4b5dba3-0f7f-43ad-944d-d1c37dea755f","Type":"ContainerStarted","Data":"092379d9904cfb7ecdf81d9da111246cc48e581c00cf0dcdfb7ceea9eb0c1d54"}
Jul 23 11:14:54.443313 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.443276    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"]
Jul 23 11:14:54.444041 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.443649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.447281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.446797    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pbh6z\""
Jul 23 11:14:54.447281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.447077    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 23 11:14:54.447281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.447250    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 23 11:14:54.449052 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.447622    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 23 11:14:54.449052 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.447821    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-90iao1h8tsl7e\""
Jul 23 11:14:54.449052 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.447995    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 23 11:14:54.449052 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.448164    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 23 11:14:54.504691 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.504655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.504891 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.504727    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.504891 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.504773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-grpc-tls\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.504891 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.504808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.504891 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.504869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-754tw\" (UniqueName: \"kubernetes.io/projected/dedf664a-5d8e-4105-80ae-9c034752ad69-kube-api-access-754tw\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.505082 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.504949    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-tls\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.505082 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.504991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.505082 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.505019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dedf664a-5d8e-4105-80ae-9c034752ad69-metrics-client-ca\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.606577 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-754tw\" (UniqueName: \"kubernetes.io/projected/dedf664a-5d8e-4105-80ae-9c034752ad69-kube-api-access-754tw\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.606577 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-tls\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.606577 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.606892 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dedf664a-5d8e-4105-80ae-9c034752ad69-metrics-client-ca\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.606892 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.607004 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.607004 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-grpc-tls\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.607369 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.606979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.608380 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.608340    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dedf664a-5d8e-4105-80ae-9c034752ad69-metrics-client-ca\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.612907 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.612847    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-grpc-tls\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.613435 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.613407    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.613918 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.613869    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.615101 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.615058    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-tls\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.616602 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.616581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.616700 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.616645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dedf664a-5d8e-4105-80ae-9c034752ad69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.616765 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.616703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-754tw\" (UniqueName: \"kubernetes.io/projected/dedf664a-5d8e-4105-80ae-9c034752ad69-kube-api-access-754tw\") pod \"thanos-querier-7ff9bf56c-mwxgs\" (UID: \"dedf664a-5d8e-4105-80ae-9c034752ad69\") " pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:54.756999 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:54.756907    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:14:55.022694 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:55.022608    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"]
Jul 23 11:14:55.027422 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:55.027382    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedf664a_5d8e_4105_80ae_9c034752ad69.slice/crio-eba15f872d2fdd44a516f62a3a786fa114dafe68790d46c7093ee2984db9813a WatchSource:0}: Error finding container eba15f872d2fdd44a516f62a3a786fa114dafe68790d46c7093ee2984db9813a: Status 404 returned error can't find the container with id eba15f872d2fdd44a516f62a3a786fa114dafe68790d46c7093ee2984db9813a
Jul 23 11:14:55.424232 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:55.424194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ncdj" event={"ID":"d4b5dba3-0f7f-43ad-944d-d1c37dea755f","Type":"ContainerStarted","Data":"1693a66d269e63146ba81bfe85b83bfc5a6a4caaee5105c251aebbb6983b904c"}
Jul 23 11:14:55.425704 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:55.425666    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" event={"ID":"dedf664a-5d8e-4105-80ae-9c034752ad69","Type":"ContainerStarted","Data":"eba15f872d2fdd44a516f62a3a786fa114dafe68790d46c7093ee2984db9813a"}
Jul 23 11:14:56.433051 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.433012    2573 generic.go:356] "Generic (PLEG): container finished" podID="d4b5dba3-0f7f-43ad-944d-d1c37dea755f" containerID="1693a66d269e63146ba81bfe85b83bfc5a6a4caaee5105c251aebbb6983b904c" exitCode=0
Jul 23 11:14:56.433524 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.433109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ncdj" event={"ID":"d4b5dba3-0f7f-43ad-944d-d1c37dea755f","Type":"ContainerDied","Data":"1693a66d269e63146ba81bfe85b83bfc5a6a4caaee5105c251aebbb6983b904c"}
Jul 23 11:14:56.819840 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.819796    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"]
Jul 23 11:14:56.841867 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.841825    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"]
Jul 23 11:14:56.842104 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.841959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:56.844476 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.844439    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 11:14:56.844608 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.844472    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7pvqnq2uoaqei\""
Jul 23 11:14:56.844794 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.844777    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 11:14:56.844889 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.844849    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 11:14:56.845126 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.844977    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lfk9n\""
Jul 23 11:14:56.845227 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.845157    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 11:14:56.932365 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.932322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-secret-metrics-server-client-certs\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:56.932365 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.932368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac65196e-a4cb-48aa-95ae-8abdb94579f9-metrics-server-audit-profiles\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:56.932622 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.932396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac65196e-a4cb-48aa-95ae-8abdb94579f9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:56.932622 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.932493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac65196e-a4cb-48aa-95ae-8abdb94579f9-audit-log\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:56.932622 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.932529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf5q8\" (UniqueName: \"kubernetes.io/projected/ac65196e-a4cb-48aa-95ae-8abdb94579f9-kube-api-access-qf5q8\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:56.932622 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.932613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-client-ca-bundle\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:56.932770 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:56.932663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-secret-metrics-server-tls\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.033907 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.033808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac65196e-a4cb-48aa-95ae-8abdb94579f9-audit-log\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.033907 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.033855    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf5q8\" (UniqueName: \"kubernetes.io/projected/ac65196e-a4cb-48aa-95ae-8abdb94579f9-kube-api-access-qf5q8\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.034129 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.034061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-client-ca-bundle\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.034205 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.034147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-secret-metrics-server-tls\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.034205 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.034176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-secret-metrics-server-client-certs\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.034324 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.034209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac65196e-a4cb-48aa-95ae-8abdb94579f9-metrics-server-audit-profiles\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.034324 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.034238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac65196e-a4cb-48aa-95ae-8abdb94579f9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.034426 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.034319    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac65196e-a4cb-48aa-95ae-8abdb94579f9-audit-log\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.035042 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.034989    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac65196e-a4cb-48aa-95ae-8abdb94579f9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.035503 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.035479    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac65196e-a4cb-48aa-95ae-8abdb94579f9-metrics-server-audit-profiles\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.036984 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.036933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-client-ca-bundle\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.037229 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.037205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-secret-metrics-server-client-certs\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.037342 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.037276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac65196e-a4cb-48aa-95ae-8abdb94579f9-secret-metrics-server-tls\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.042924 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.042904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf5q8\" (UniqueName: \"kubernetes.io/projected/ac65196e-a4cb-48aa-95ae-8abdb94579f9-kube-api-access-qf5q8\") pod \"metrics-server-6ffb9cc84b-vtjgk\" (UID: \"ac65196e-a4cb-48aa-95ae-8abdb94579f9\") " pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.153815 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.153733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:14:57.156527 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.156497    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"]
Jul 23 11:14:57.189084 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.189046    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"]
Jul 23 11:14:57.189197 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.189172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.191352 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.191325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-c622t\""
Jul 23 11:14:57.193518 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.193496    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 11:14:57.337552 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.337515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmh8\" (UniqueName: \"kubernetes.io/projected/dd80ade5-ea41-4734-abad-ae7925376ce2-kube-api-access-vcmh8\") pod \"monitoring-plugin-7b7b7bc8bf-v9qs9\" (UID: \"dd80ade5-ea41-4734-abad-ae7925376ce2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.337732 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.337591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd80ade5-ea41-4734-abad-ae7925376ce2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-v9qs9\" (UID: \"dd80ade5-ea41-4734-abad-ae7925376ce2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.438155 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.438118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmh8\" (UniqueName: \"kubernetes.io/projected/dd80ade5-ea41-4734-abad-ae7925376ce2-kube-api-access-vcmh8\") pod \"monitoring-plugin-7b7b7bc8bf-v9qs9\" (UID: \"dd80ade5-ea41-4734-abad-ae7925376ce2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.438639 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.438205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd80ade5-ea41-4734-abad-ae7925376ce2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-v9qs9\" (UID: \"dd80ade5-ea41-4734-abad-ae7925376ce2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.441315 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.441284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd80ade5-ea41-4734-abad-ae7925376ce2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-v9qs9\" (UID: \"dd80ade5-ea41-4734-abad-ae7925376ce2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.445528 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.445500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ncdj" event={"ID":"d4b5dba3-0f7f-43ad-944d-d1c37dea755f","Type":"ContainerStarted","Data":"49b6eb01ba699a4095f68ca2c03777671a821e4b0e1adb6df28ef96a629d38c1"}
Jul 23 11:14:57.445655 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.445573    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ncdj" event={"ID":"d4b5dba3-0f7f-43ad-944d-d1c37dea755f","Type":"ContainerStarted","Data":"41c0def317d710f8e2b6fd130bdab580f11c424b59466bba4f47d1f0890c3034"}
Jul 23 11:14:57.450550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.450525    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmh8\" (UniqueName: \"kubernetes.io/projected/dd80ade5-ea41-4734-abad-ae7925376ce2-kube-api-access-vcmh8\") pod \"monitoring-plugin-7b7b7bc8bf-v9qs9\" (UID: \"dd80ade5-ea41-4734-abad-ae7925376ce2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.500958 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.500924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:14:57.716711 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.716650    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8ncdj" podStartSLOduration=3.799987533 podStartE2EDuration="5.716630699s" totalImagesPullingTime="1.7996346s" totalInitContainerRuntime="117.008566ms" isStatefulPod=true podCreationTimestamp="2026-07-23 11:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:57.463643574 +0000 UTC m=+312.509740781" watchObservedRunningTime="2026-07-23 11:14:57.716630699 +0000 UTC m=+312.762727823"
Jul 23 11:14:57.717718 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.717695    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b7885667b-bj2nt"]
Jul 23 11:14:57.733977 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:57.733939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd80ade5_ea41_4734_abad_ae7925376ce2.slice/crio-ea8026c5f67d0653f593a9308854c5b58b5746c6e8796f103b3bc0716fe19dc5 WatchSource:0}: Error finding container ea8026c5f67d0653f593a9308854c5b58b5746c6e8796f103b3bc0716fe19dc5: Status 404 returned error can't find the container with id ea8026c5f67d0653f593a9308854c5b58b5746c6e8796f103b3bc0716fe19dc5
Jul 23 11:14:57.738630 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.738603    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"]
Jul 23 11:14:57.738777 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.738647    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b7885667b-bj2nt"]
Jul 23 11:14:57.738850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.738776    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.741142 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.741081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 11:14:57.741142 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.741109    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 11:14:57.741142 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.741080    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 11:14:57.741340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.741160    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 11:14:57.741340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.741180    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-chghk\""
Jul 23 11:14:57.741340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.741110    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 11:14:57.747105 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.747085    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 11:14:57.751242 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.751223    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"]
Jul 23 11:14:57.754307 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:57.754286    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac65196e_a4cb_48aa_95ae_8abdb94579f9.slice/crio-57ea5258a09e10205ef86a889de6ac0a69fc04a53d587ba5bdc7549ef0619eff WatchSource:0}: Error finding container 57ea5258a09e10205ef86a889de6ac0a69fc04a53d587ba5bdc7549ef0619eff: Status 404 returned error can't find the container with id 57ea5258a09e10205ef86a889de6ac0a69fc04a53d587ba5bdc7549ef0619eff
Jul 23 11:14:57.841004 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.840967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h78mc\" (UniqueName: \"kubernetes.io/projected/e9677000-e87d-4764-a2c4-5cada4ff810a-kube-api-access-h78mc\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.841004 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.841005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-serving-certs-ca-bundle\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.841177 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.841028    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.841177 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.841051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.841177 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.841104    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-metrics-client-ca\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.841177 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.841156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-telemeter-client-tls\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.841317 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.841203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-secret-telemeter-client\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.841317 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.841262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-federate-client-tls\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942068 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.941983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-serving-certs-ca-bundle\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942068 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942068 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-metrics-client-ca\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-telemeter-client-tls\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-secret-telemeter-client\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-federate-client-tls\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h78mc\" (UniqueName: \"kubernetes.io/projected/e9677000-e87d-4764-a2c4-5cada4ff810a-kube-api-access-h78mc\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942810 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942786    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-serving-certs-ca-bundle\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.942929 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.942871    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-metrics-client-ca\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.943475 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.943445    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9677000-e87d-4764-a2c4-5cada4ff810a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.944647 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.944619    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-telemeter-client-tls\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.944804 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.944785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-secret-telemeter-client\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.945117 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.945094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.945191 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.945119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e9677000-e87d-4764-a2c4-5cada4ff810a-federate-client-tls\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:57.953979 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:57.953956    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h78mc\" (UniqueName: \"kubernetes.io/projected/e9677000-e87d-4764-a2c4-5cada4ff810a-kube-api-access-h78mc\") pod \"telemeter-client-5b7885667b-bj2nt\" (UID: \"e9677000-e87d-4764-a2c4-5cada4ff810a\") " pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:58.048657 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.048634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt"
Jul 23 11:14:58.205197 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.205170    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b7885667b-bj2nt"]
Jul 23 11:14:58.208898 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:14:58.208872    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9677000_e87d_4764_a2c4_5cada4ff810a.slice/crio-41791d8be7ccec563434232bb9016f16440566565d29f5f96107044b6c1fcc41 WatchSource:0}: Error finding container 41791d8be7ccec563434232bb9016f16440566565d29f5f96107044b6c1fcc41: Status 404 returned error can't find the container with id 41791d8be7ccec563434232bb9016f16440566565d29f5f96107044b6c1fcc41
Jul 23 11:14:58.447640 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.447544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" event={"ID":"dedf664a-5d8e-4105-80ae-9c034752ad69","Type":"ContainerStarted","Data":"6eea63b6a59e81273f5de5eb6f455399dca10e93a9643fdb2e0089e2e2c5760f"}
Jul 23 11:14:58.447640 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.447623    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" event={"ID":"dedf664a-5d8e-4105-80ae-9c034752ad69","Type":"ContainerStarted","Data":"b59d4017430b6d5d36fe78b5edf62b5c6781ba5698646ef4734fa6ddde8671dd"}
Jul 23 11:14:58.448164 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.447655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" event={"ID":"dedf664a-5d8e-4105-80ae-9c034752ad69","Type":"ContainerStarted","Data":"a772d4c33072ee9bfb527335ab501e6a1f7e56b159f34ac73bf80dcf7ae67a1f"}
Jul 23 11:14:58.448982 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.448954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk" event={"ID":"ac65196e-a4cb-48aa-95ae-8abdb94579f9","Type":"ContainerStarted","Data":"57ea5258a09e10205ef86a889de6ac0a69fc04a53d587ba5bdc7549ef0619eff"}
Jul 23 11:14:58.450252 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.450218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9" event={"ID":"dd80ade5-ea41-4734-abad-ae7925376ce2","Type":"ContainerStarted","Data":"ea8026c5f67d0653f593a9308854c5b58b5746c6e8796f103b3bc0716fe19dc5"}
Jul 23 11:14:58.451605 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:14:58.451585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt" event={"ID":"e9677000-e87d-4764-a2c4-5cada4ff810a","Type":"ContainerStarted","Data":"41791d8be7ccec563434232bb9016f16440566565d29f5f96107044b6c1fcc41"}
Jul 23 11:15:01.161972 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:01.161938    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:15:02.474456 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.474371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" event={"ID":"dedf664a-5d8e-4105-80ae-9c034752ad69","Type":"ContainerStarted","Data":"cf2f10e4ea0d273eb8f502708f82244e31178d3990101f235e7aca97de584f67"}
Jul 23 11:15:02.474456 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.474454    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" event={"ID":"dedf664a-5d8e-4105-80ae-9c034752ad69","Type":"ContainerStarted","Data":"11aaef4126c00bf1c4878afa3f6a4c022bc9a7263a17b32dcc43f177b612494d"}
Jul 23 11:15:02.475161 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.474498    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" event={"ID":"dedf664a-5d8e-4105-80ae-9c034752ad69","Type":"ContainerStarted","Data":"c7bfb7674c58ac84e50722632f4433440d49082858ebe177acc7a2195bcbcfd1"}
Jul 23 11:15:02.475161 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.474538    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:15:02.477785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.476698    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk" event={"ID":"ac65196e-a4cb-48aa-95ae-8abdb94579f9","Type":"ContainerStarted","Data":"237929888f929272c2c77f6ab788b84220cf48ec802d8f9c7fd3e82dd5591e19"}
Jul 23 11:15:02.479147 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.479091    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9" event={"ID":"dd80ade5-ea41-4734-abad-ae7925376ce2","Type":"ContainerStarted","Data":"00e6ed851294e3d13ebc624667086e0ec9f9f087e751814d247107b6afabee62"}
Jul 23 11:15:02.479266 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.479240    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:15:02.480836 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.480807    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt" event={"ID":"e9677000-e87d-4764-a2c4-5cada4ff810a","Type":"ContainerStarted","Data":"6417536ea45ac928a807c613912e26696363a3ff39d957d1ae1c055bab5e82fb"}
Jul 23 11:15:02.485245 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.485212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9"
Jul 23 11:15:02.503225 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.503172    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs" podStartSLOduration=2.129926288 podStartE2EDuration="8.503110277s" totalImagesPullingTime="6.373183989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:15:02.502072315 +0000 UTC m=+317.548169439" watchObservedRunningTime="2026-07-23 11:15:02.503110277 +0000 UTC m=+317.549207393"
Jul 23 11:15:02.523951 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.523843    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-v9qs9" podStartSLOduration=1.8645984599999998 podStartE2EDuration="5.523822754s" totalImagesPullingTime="3.659224294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:15:02.522999741 +0000 UTC m=+317.569096856" watchObservedRunningTime="2026-07-23 11:15:02.523822754 +0000 UTC m=+317.569919874"
Jul 23 11:15:02.548843 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:02.548774    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk" podStartSLOduration=2.9116881709999998 podStartE2EDuration="6.548758799s" totalImagesPullingTime="3.637070628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:15:02.548615393 +0000 UTC m=+317.594712509" watchObservedRunningTime="2026-07-23 11:15:02.548758799 +0000 UTC m=+317.594855910"
Jul 23 11:15:03.486985 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:03.486885    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt" event={"ID":"e9677000-e87d-4764-a2c4-5cada4ff810a","Type":"ContainerStarted","Data":"d6a334037dcc889673e6077122bade9135f474e3810f7212da3a3c72fe72448a"}
Jul 23 11:15:03.486985 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:03.486951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt" event={"ID":"e9677000-e87d-4764-a2c4-5cada4ff810a","Type":"ContainerStarted","Data":"d2badf80dc03384f77588e4a77171cf18ed60f569fe593ccbfc838f8b1383e9d"}
Jul 23 11:15:03.493850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:03.493825    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7ff9bf56c-mwxgs"
Jul 23 11:15:03.511857 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:03.511805    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b7885667b-bj2nt" podStartSLOduration=1.7136900430000002 podStartE2EDuration="6.511790592s" totalImagesPullingTime="4.798100549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:15:03.511182549 +0000 UTC m=+318.557279663" watchObservedRunningTime="2026-07-23 11:15:03.511790592 +0000 UTC m=+318.557887705"
Jul 23 11:15:16.181359 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.181290    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07" containerName="registry" containerID="cri-o://9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc" gracePeriod=30
Jul 23 11:15:16.457046 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.456993    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:15:16.536960 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.536928    2573 generic.go:356] "Generic (PLEG): container finished" podID="413542c9-505a-4e44-bd4c-f6ebe21eac07" containerID="9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc" exitCode=0
Jul 23 11:15:16.537120 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.536972    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s"
Jul 23 11:15:16.537120 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.537019    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" event={"ID":"413542c9-505a-4e44-bd4c-f6ebe21eac07","Type":"ContainerDied","Data":"9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc"}
Jul 23 11:15:16.537120 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.537068    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cc9d968f-bsq2s" event={"ID":"413542c9-505a-4e44-bd4c-f6ebe21eac07","Type":"ContainerDied","Data":"68942d541cf550bc6476dc6552fd8d414048296dc0a979a5f3a2744ffa00ee68"}
Jul 23 11:15:16.537120 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.537089    2573 scope.go:117] "RemoveContainer" containerID="9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc"
Jul 23 11:15:16.547244 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.547221    2573 scope.go:117] "RemoveContainer" containerID="9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc"
Jul 23 11:15:16.547640 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:15:16.547619    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc\": container with ID starting with 9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc not found: ID does not exist" containerID="9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc"
Jul 23 11:15:16.547727 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.547649    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc"} err="failed to get container status \"9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc\": rpc error: code = NotFound desc = could not find container \"9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc\": container with ID starting with 9f9b3219fd9613268eb806dae8f0753dd57c5e6399707be55337f552a6b084bc not found: ID does not exist"
Jul 23 11:15:16.605973 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.605943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413542c9-505a-4e44-bd4c-f6ebe21eac07-ca-trust-extracted\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.605973 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.605975    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72dr7\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-kube-api-access-72dr7\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.606118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.605995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.606118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.606071    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-trusted-ca\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.606118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.606097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-installation-pull-secrets\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.606232 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.606137    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-bound-sa-token\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.606232 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.606166    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-certificates\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.606232 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.606192    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-image-registry-private-configuration\") pod \"413542c9-505a-4e44-bd4c-f6ebe21eac07\" (UID: \"413542c9-505a-4e44-bd4c-f6ebe21eac07\") "
Jul 23 11:15:16.606635 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.606509    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:16.606635 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.606592    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:16.608502 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.608476    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:15:16.608598 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.608548    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:15:16.608789 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.608733    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-kube-api-access-72dr7" (OuterVolumeSpecName: "kube-api-access-72dr7") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "kube-api-access-72dr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:15:16.608870 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.608822    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:15:16.608911 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.608858    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:15:16.614472 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.614451    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413542c9-505a-4e44-bd4c-f6ebe21eac07-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "413542c9-505a-4e44-bd4c-f6ebe21eac07" (UID: "413542c9-505a-4e44-bd4c-f6ebe21eac07"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:15:16.707681 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707588    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-trusted-ca\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.707681 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707631    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-installation-pull-secrets\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.707681 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707647    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-bound-sa-token\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.707681 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707659    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-certificates\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.707681 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707672    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413542c9-505a-4e44-bd4c-f6ebe21eac07-image-registry-private-configuration\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.707681 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707686    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413542c9-505a-4e44-bd4c-f6ebe21eac07-ca-trust-extracted\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.708048 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707698    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72dr7\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-kube-api-access-72dr7\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.708048 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.707709    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413542c9-505a-4e44-bd4c-f6ebe21eac07-registry-tls\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:15:16.857484 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.857451    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8cc9d968f-bsq2s"]
Jul 23 11:15:16.861109 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:16.861084    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8cc9d968f-bsq2s"]
Jul 23 11:15:17.154242 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:17.154211    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:15:17.154406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:17.154273    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:15:17.445337 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:17.445259    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07" path="/var/lib/kubelet/pods/413542c9-505a-4e44-bd4c-f6ebe21eac07/volumes"
Jul 23 11:15:28.590599 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:28.590560    2573 generic.go:356] "Generic (PLEG): container finished" podID="9de299b5-15a1-435a-948b-1aa2653e8c20" containerID="03a328242c3e7391b82e418430b8059f43a6e2174c24489521cb3a55a384fd35" exitCode=0
Jul 23 11:15:28.591139 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:28.590617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm" event={"ID":"9de299b5-15a1-435a-948b-1aa2653e8c20","Type":"ContainerDied","Data":"03a328242c3e7391b82e418430b8059f43a6e2174c24489521cb3a55a384fd35"}
Jul 23 11:15:28.591139 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:28.591026    2573 scope.go:117] "RemoveContainer" containerID="03a328242c3e7391b82e418430b8059f43a6e2174c24489521cb3a55a384fd35"
Jul 23 11:15:29.596890 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:29.596851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qjqsm" event={"ID":"9de299b5-15a1-435a-948b-1aa2653e8c20","Type":"ContainerStarted","Data":"0c86fba663d1974222de34e853c24a7d4edce90d8828dd11c2c5941c657eac0d"}
Jul 23 11:15:33.613647 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:33.613612    2573 generic.go:356] "Generic (PLEG): container finished" podID="8cdef970-2bd2-446e-86ac-fb804aee181e" containerID="442a51eb33c184db1415ec42b785dd30c9305ea4cb93a8e02846cfabfbcdf4d5" exitCode=0
Jul 23 11:15:33.614176 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:33.613687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5rb5v" event={"ID":"8cdef970-2bd2-446e-86ac-fb804aee181e","Type":"ContainerDied","Data":"442a51eb33c184db1415ec42b785dd30c9305ea4cb93a8e02846cfabfbcdf4d5"}
Jul 23 11:15:33.614176 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:33.614095    2573 scope.go:117] "RemoveContainer" containerID="442a51eb33c184db1415ec42b785dd30c9305ea4cb93a8e02846cfabfbcdf4d5"
Jul 23 11:15:33.615234 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:33.615211    2573 generic.go:356] "Generic (PLEG): container finished" podID="52293a70-c85a-4730-8dd3-6020ddca452c" containerID="fb9cb3d903bcfc5e549ee7b91cc51e55a06d46c5276c22ca735c0742ea717823" exitCode=0
Jul 23 11:15:33.615343 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:33.615286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd" event={"ID":"52293a70-c85a-4730-8dd3-6020ddca452c","Type":"ContainerDied","Data":"fb9cb3d903bcfc5e549ee7b91cc51e55a06d46c5276c22ca735c0742ea717823"}
Jul 23 11:15:33.615571 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:33.615558    2573 scope.go:117] "RemoveContainer" containerID="fb9cb3d903bcfc5e549ee7b91cc51e55a06d46c5276c22ca735c0742ea717823"
Jul 23 11:15:34.620925 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:34.620892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5rb5v" event={"ID":"8cdef970-2bd2-446e-86ac-fb804aee181e","Type":"ContainerStarted","Data":"c804cb8066a8b951adba5dd98c9e0e69f2dff7628b22a817871ef2e4f3be68c0"}
Jul 23 11:15:34.622579 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:34.622556    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-cj5dd" event={"ID":"52293a70-c85a-4730-8dd3-6020ddca452c","Type":"ContainerStarted","Data":"ccfebb8ae955a1b6d00d7d70af7cd78b2840f9689a56404c799ba01592e9d251"}
Jul 23 11:15:37.159851 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:37.159818    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:15:37.163859 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:37.163835    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6ffb9cc84b-vtjgk"
Jul 23 11:15:59.477346 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:59.477306    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:15:59.479582 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:59.479560    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07af3fec-8472-46a7-9bb6-3c398effb78a-metrics-certs\") pod \"network-metrics-daemon-kt2sk\" (UID: \"07af3fec-8472-46a7-9bb6-3c398effb78a\") " pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:15:59.722715 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:59.722686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg9k4\""
Jul 23 11:15:59.730487 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:59.730429    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kt2sk"
Jul 23 11:15:59.861688 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:15:59.861648    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kt2sk"]
Jul 23 11:15:59.864946 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:15:59.864914    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07af3fec_8472_46a7_9bb6_3c398effb78a.slice/crio-6ec6a9a85de25d64ce418d7da0b43515d46cb1122842bd9d88a0d4c3a60139ab WatchSource:0}: Error finding container 6ec6a9a85de25d64ce418d7da0b43515d46cb1122842bd9d88a0d4c3a60139ab: Status 404 returned error can't find the container with id 6ec6a9a85de25d64ce418d7da0b43515d46cb1122842bd9d88a0d4c3a60139ab
Jul 23 11:16:00.722571 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:16:00.722538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kt2sk" event={"ID":"07af3fec-8472-46a7-9bb6-3c398effb78a","Type":"ContainerStarted","Data":"6ec6a9a85de25d64ce418d7da0b43515d46cb1122842bd9d88a0d4c3a60139ab"}
Jul 23 11:16:01.727824 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:16:01.727785    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kt2sk" event={"ID":"07af3fec-8472-46a7-9bb6-3c398effb78a","Type":"ContainerStarted","Data":"00930dea981a7a0facb3c661eeb018f06ab7c8b5f2e3a4c1e277a0063127cc98"}
Jul 23 11:16:01.728217 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:16:01.727848    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kt2sk" event={"ID":"07af3fec-8472-46a7-9bb6-3c398effb78a","Type":"ContainerStarted","Data":"ada7cb1b37b56daef139ccb91069daffb517a3a21aee76ebb7c1ddc668caa8a5"}
Jul 23 11:16:01.747818 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:16:01.747762    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kt2sk" podStartSLOduration=375.814211167 podStartE2EDuration="6m16.747730337s" totalImagesPullingTime="933.51917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:16:01.746792571 +0000 UTC m=+376.792889685" watchObservedRunningTime="2026-07-23 11:16:01.747730337 +0000 UTC m=+376.793827450"
Jul 23 11:17:33.662923 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.662887    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"]
Jul 23 11:17:33.663387 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.663190    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07" containerName="registry"
Jul 23 11:17:33.663387 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.663201    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07" containerName="registry"
Jul 23 11:17:33.663387 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.663266    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="413542c9-505a-4e44-bd4c-f6ebe21eac07" containerName="registry"
Jul 23 11:17:33.665229 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.665213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.667910 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.667881    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5t9kf\""
Jul 23 11:17:33.668048 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.667940    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 11:17:33.668575 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.668555    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 11:17:33.676332 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.676299    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"]
Jul 23 11:17:33.742421 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.742386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.742421 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.742428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hffb\" (UniqueName: \"kubernetes.io/projected/19b0dd38-9bd4-40b7-8523-31711f9f94ae-kube-api-access-8hffb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.742640 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.742498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.843207 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.843160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.843207 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.843202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hffb\" (UniqueName: \"kubernetes.io/projected/19b0dd38-9bd4-40b7-8523-31711f9f94ae-kube-api-access-8hffb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.843429 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.843247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.843574 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.843552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.843629 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.843613    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.853831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.853804    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hffb\" (UniqueName: \"kubernetes.io/projected/19b0dd38-9bd4-40b7-8523-31711f9f94ae-kube-api-access-8hffb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:33.974398 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:33.974311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:34.110696 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:34.110662    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"]
Jul 23 11:17:34.114329 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:17:34.114299    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b0dd38_9bd4_40b7_8523_31711f9f94ae.slice/crio-e3c6e59dd70b39e10b9a0a4d1a6e7dd9a1c7bdac140850f7551285a5955feb80 WatchSource:0}: Error finding container e3c6e59dd70b39e10b9a0a4d1a6e7dd9a1c7bdac140850f7551285a5955feb80: Status 404 returned error can't find the container with id e3c6e59dd70b39e10b9a0a4d1a6e7dd9a1c7bdac140850f7551285a5955feb80
Jul 23 11:17:35.088916 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:35.088881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv" event={"ID":"19b0dd38-9bd4-40b7-8523-31711f9f94ae","Type":"ContainerStarted","Data":"e3c6e59dd70b39e10b9a0a4d1a6e7dd9a1c7bdac140850f7551285a5955feb80"}
Jul 23 11:17:41.116938 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:41.116844    2573 generic.go:356] "Generic (PLEG): container finished" podID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerID="b748a64feff0164eba686b45f4c056dada10c287dca3c0a79186202da5eae58e" exitCode=0
Jul 23 11:17:41.116938 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:41.116918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv" event={"ID":"19b0dd38-9bd4-40b7-8523-31711f9f94ae","Type":"ContainerDied","Data":"b748a64feff0164eba686b45f4c056dada10c287dca3c0a79186202da5eae58e"}
Jul 23 11:17:44.132057 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:44.131961    2573 generic.go:356] "Generic (PLEG): container finished" podID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerID="ab3079584b8c26c88f1f2a643d19cfd10739c2632b5547d1fd403683b225718f" exitCode=0
Jul 23 11:17:44.132473 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:44.132054    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv" event={"ID":"19b0dd38-9bd4-40b7-8523-31711f9f94ae","Type":"ContainerDied","Data":"ab3079584b8c26c88f1f2a643d19cfd10739c2632b5547d1fd403683b225718f"}
Jul 23 11:17:50.160212 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:50.160120    2573 generic.go:356] "Generic (PLEG): container finished" podID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerID="0ebef45b0b9e4ea1b2db8e15472421cc39afa0647b0f1222592dad376f601482" exitCode=0
Jul 23 11:17:50.160212 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:50.160185    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv" event={"ID":"19b0dd38-9bd4-40b7-8523-31711f9f94ae","Type":"ContainerDied","Data":"0ebef45b0b9e4ea1b2db8e15472421cc39afa0647b0f1222592dad376f601482"}
Jul 23 11:17:51.288325 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.288298    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:51.403241 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.403203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-bundle\") pod \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") "
Jul 23 11:17:51.403241 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.403247    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-util\") pod \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") "
Jul 23 11:17:51.403455 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.403300    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hffb\" (UniqueName: \"kubernetes.io/projected/19b0dd38-9bd4-40b7-8523-31711f9f94ae-kube-api-access-8hffb\") pod \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\" (UID: \"19b0dd38-9bd4-40b7-8523-31711f9f94ae\") "
Jul 23 11:17:51.404091 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.404062    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-bundle" (OuterVolumeSpecName: "bundle") pod "19b0dd38-9bd4-40b7-8523-31711f9f94ae" (UID: "19b0dd38-9bd4-40b7-8523-31711f9f94ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:17:51.405444 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.405423    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b0dd38-9bd4-40b7-8523-31711f9f94ae-kube-api-access-8hffb" (OuterVolumeSpecName: "kube-api-access-8hffb") pod "19b0dd38-9bd4-40b7-8523-31711f9f94ae" (UID: "19b0dd38-9bd4-40b7-8523-31711f9f94ae"). InnerVolumeSpecName "kube-api-access-8hffb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:17:51.407906 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.407882    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-util" (OuterVolumeSpecName: "util") pod "19b0dd38-9bd4-40b7-8523-31711f9f94ae" (UID: "19b0dd38-9bd4-40b7-8523-31711f9f94ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:17:51.504104 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.504067    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-bundle\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:17:51.504104 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.504094    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b0dd38-9bd4-40b7-8523-31711f9f94ae-util\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:17:51.504104 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:51.504103    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hffb\" (UniqueName: \"kubernetes.io/projected/19b0dd38-9bd4-40b7-8523-31711f9f94ae-kube-api-access-8hffb\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:17:52.169642 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:52.169610    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv"
Jul 23 11:17:52.169642 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:52.169628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408w2tv" event={"ID":"19b0dd38-9bd4-40b7-8523-31711f9f94ae","Type":"ContainerDied","Data":"e3c6e59dd70b39e10b9a0a4d1a6e7dd9a1c7bdac140850f7551285a5955feb80"}
Jul 23 11:17:52.169851 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:52.169672    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3c6e59dd70b39e10b9a0a4d1a6e7dd9a1c7bdac140850f7551285a5955feb80"
Jul 23 11:17:56.694501 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694466    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"]
Jul 23 11:17:56.694922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694795    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerName="extract"
Jul 23 11:17:56.694922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694806    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerName="extract"
Jul 23 11:17:56.694922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694817    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerName="pull"
Jul 23 11:17:56.694922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694822    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerName="pull"
Jul 23 11:17:56.694922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694830    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerName="util"
Jul 23 11:17:56.694922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694836    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerName="util"
Jul 23 11:17:56.694922 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.694885    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b0dd38-9bd4-40b7-8523-31711f9f94ae" containerName="extract"
Jul 23 11:17:56.697875 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.697858    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:56.699947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.699915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 23 11:17:56.699947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.699937    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:17:56.700116 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.700019    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rxr8r\""
Jul 23 11:17:56.711302 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.711281    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"]
Jul 23 11:17:56.845581 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.845542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqcks\" (UniqueName: \"kubernetes.io/projected/d1a2bd95-f738-48cd-9ac2-80d945633223-kube-api-access-zqcks\") pod \"cert-manager-operator-controller-manager-55c444bf86-4gds2\" (UID: \"d1a2bd95-f738-48cd-9ac2-80d945633223\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:56.845724 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.845600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a2bd95-f738-48cd-9ac2-80d945633223-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4gds2\" (UID: \"d1a2bd95-f738-48cd-9ac2-80d945633223\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:56.946960 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.946879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqcks\" (UniqueName: \"kubernetes.io/projected/d1a2bd95-f738-48cd-9ac2-80d945633223-kube-api-access-zqcks\") pod \"cert-manager-operator-controller-manager-55c444bf86-4gds2\" (UID: \"d1a2bd95-f738-48cd-9ac2-80d945633223\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:56.946960 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.946940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a2bd95-f738-48cd-9ac2-80d945633223-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4gds2\" (UID: \"d1a2bd95-f738-48cd-9ac2-80d945633223\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:56.947284 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.947269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a2bd95-f738-48cd-9ac2-80d945633223-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4gds2\" (UID: \"d1a2bd95-f738-48cd-9ac2-80d945633223\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:56.955668 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:56.955644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqcks\" (UniqueName: \"kubernetes.io/projected/d1a2bd95-f738-48cd-9ac2-80d945633223-kube-api-access-zqcks\") pod \"cert-manager-operator-controller-manager-55c444bf86-4gds2\" (UID: \"d1a2bd95-f738-48cd-9ac2-80d945633223\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:57.007212 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:57.007177    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"
Jul 23 11:17:57.141849 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:57.141789    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2"]
Jul 23 11:17:57.145839 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:17:57.145818    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a2bd95_f738_48cd_9ac2_80d945633223.slice/crio-95c749487d5c0f601917ca2f9304a43af544cd8a79da5e3578fe026500a88f02 WatchSource:0}: Error finding container 95c749487d5c0f601917ca2f9304a43af544cd8a79da5e3578fe026500a88f02: Status 404 returned error can't find the container with id 95c749487d5c0f601917ca2f9304a43af544cd8a79da5e3578fe026500a88f02
Jul 23 11:17:57.190417 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:57.190386    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2" event={"ID":"d1a2bd95-f738-48cd-9ac2-80d945633223","Type":"ContainerStarted","Data":"95c749487d5c0f601917ca2f9304a43af544cd8a79da5e3578fe026500a88f02"}
Jul 23 11:17:59.207902 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:59.207866    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2" event={"ID":"d1a2bd95-f738-48cd-9ac2-80d945633223","Type":"ContainerStarted","Data":"b5bde1d29daca1a4835b8314a4c66f2698e13995201564460a3848c501c534e0"}
Jul 23 11:17:59.277928 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:17:59.277791    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4gds2" podStartSLOduration=1.390404644 podStartE2EDuration="3.277771674s" totalImagesPullingTime="1.88736703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:17:59.266301402 +0000 UTC m=+494.312398516" watchObservedRunningTime="2026-07-23 11:17:59.277771674 +0000 UTC m=+494.323868789"
Jul 23 11:18:00.745411 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.745375    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"]
Jul 23 11:18:00.749059 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.749042    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.751363 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.751331    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 11:18:00.751474 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.751338    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 11:18:00.751950 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.751932    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5t9kf\""
Jul 23 11:18:00.758698 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.758676    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"]
Jul 23 11:18:00.776169 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.776144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.776270 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.776172    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.776270 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.776203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbqfx\" (UniqueName: \"kubernetes.io/projected/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-kube-api-access-gbqfx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.877274 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.877241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.877274 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.877276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.877486 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.877303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbqfx\" (UniqueName: \"kubernetes.io/projected/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-kube-api-access-gbqfx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.877643 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.877622    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.877679 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.877649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:00.885251 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:00.885222    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbqfx\" (UniqueName: \"kubernetes.io/projected/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-kube-api-access-gbqfx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:01.058245 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:01.058214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:01.188930 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:01.188898    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"]
Jul 23 11:18:01.218060 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:01.218034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84" event={"ID":"7a2a3a4c-8f14-4e94-b844-f30ac9e17990","Type":"ContainerStarted","Data":"a61ce9976aa9c581c9b964840d804f0b751573b10237836259c170277762b079"}
Jul 23 11:18:02.224392 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.224307    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerID="1e1dbaf36914eb5c0f36bb2a146034261c760938093f0225dc00b8dab3826a96" exitCode=0
Jul 23 11:18:02.224392 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.224363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84" event={"ID":"7a2a3a4c-8f14-4e94-b844-f30ac9e17990","Type":"ContainerDied","Data":"1e1dbaf36914eb5c0f36bb2a146034261c760938093f0225dc00b8dab3826a96"}
Jul 23 11:18:02.514439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.514357    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"]
Jul 23 11:18:02.517571 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.517547    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:02.520043 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.520022    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 11:18:02.520145 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.520022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-szwjr\""
Jul 23 11:18:02.520310 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.520297    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 11:18:02.527818 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.527797    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"]
Jul 23 11:18:02.590680 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.590651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m94d5\" (UniqueName: \"kubernetes.io/projected/623e53d8-008f-45c4-ba7b-f56cb792eae9-kube-api-access-m94d5\") pod \"cert-manager-cainjector-559cdd8c87-n2xbw\" (UID: \"623e53d8-008f-45c4-ba7b-f56cb792eae9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:02.590826 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.590689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/623e53d8-008f-45c4-ba7b-f56cb792eae9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n2xbw\" (UID: \"623e53d8-008f-45c4-ba7b-f56cb792eae9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:02.691391 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.691342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/623e53d8-008f-45c4-ba7b-f56cb792eae9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n2xbw\" (UID: \"623e53d8-008f-45c4-ba7b-f56cb792eae9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:02.691513 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.691443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m94d5\" (UniqueName: \"kubernetes.io/projected/623e53d8-008f-45c4-ba7b-f56cb792eae9-kube-api-access-m94d5\") pod \"cert-manager-cainjector-559cdd8c87-n2xbw\" (UID: \"623e53d8-008f-45c4-ba7b-f56cb792eae9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:02.699993 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.699964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/623e53d8-008f-45c4-ba7b-f56cb792eae9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n2xbw\" (UID: \"623e53d8-008f-45c4-ba7b-f56cb792eae9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:02.700099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.700046    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m94d5\" (UniqueName: \"kubernetes.io/projected/623e53d8-008f-45c4-ba7b-f56cb792eae9-kube-api-access-m94d5\") pod \"cert-manager-cainjector-559cdd8c87-n2xbw\" (UID: \"623e53d8-008f-45c4-ba7b-f56cb792eae9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:02.841607 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:02.841572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"
Jul 23 11:18:03.003844 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:03.003798    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw"]
Jul 23 11:18:03.006711 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:18:03.006679    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod623e53d8_008f_45c4_ba7b_f56cb792eae9.slice/crio-c324cca8f260f4e88a95ba0fa894e6c4f2104fbfb02e120427907054e70df84c WatchSource:0}: Error finding container c324cca8f260f4e88a95ba0fa894e6c4f2104fbfb02e120427907054e70df84c: Status 404 returned error can't find the container with id c324cca8f260f4e88a95ba0fa894e6c4f2104fbfb02e120427907054e70df84c
Jul 23 11:18:03.235280 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:03.235200    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw" event={"ID":"623e53d8-008f-45c4-ba7b-f56cb792eae9","Type":"ContainerStarted","Data":"c324cca8f260f4e88a95ba0fa894e6c4f2104fbfb02e120427907054e70df84c"}
Jul 23 11:18:04.241763 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:04.241709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84" event={"ID":"7a2a3a4c-8f14-4e94-b844-f30ac9e17990","Type":"ContainerStarted","Data":"425be693b133fdf99415b565c5888d95aa46ae49f5e0dbcb07ef5d6d72e78678"}
Jul 23 11:18:05.249217 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:05.249175    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerID="425be693b133fdf99415b565c5888d95aa46ae49f5e0dbcb07ef5d6d72e78678" exitCode=0
Jul 23 11:18:05.249669 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:05.249256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84" event={"ID":"7a2a3a4c-8f14-4e94-b844-f30ac9e17990","Type":"ContainerDied","Data":"425be693b133fdf99415b565c5888d95aa46ae49f5e0dbcb07ef5d6d72e78678"}
Jul 23 11:18:06.256882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:06.256843    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerID="86a549658f3b97f0cae8b55c09a5fbdbab74444ad3fa78b17f4f00267bcca78b" exitCode=0
Jul 23 11:18:06.257276 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:06.256924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84" event={"ID":"7a2a3a4c-8f14-4e94-b844-f30ac9e17990","Type":"ContainerDied","Data":"86a549658f3b97f0cae8b55c09a5fbdbab74444ad3fa78b17f4f00267bcca78b"}
Jul 23 11:18:07.263714 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.263677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw" event={"ID":"623e53d8-008f-45c4-ba7b-f56cb792eae9","Type":"ContainerStarted","Data":"f76896bc098cb432c27867c0621eea3ee8dd468fb00559c9464fb4a4cf233853"}
Jul 23 11:18:07.288114 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.287796    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n2xbw" podStartSLOduration=1.279222694 podStartE2EDuration="5.287775122s" totalImagesPullingTime="4.008552428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:18:07.286514962 +0000 UTC m=+502.332612075" watchObservedRunningTime="2026-07-23 11:18:07.287775122 +0000 UTC m=+502.333872238"
Jul 23 11:18:07.406247 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.406218    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:07.424716 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.424682    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-util\") pod \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") "
Jul 23 11:18:07.424858 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.424725    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbqfx\" (UniqueName: \"kubernetes.io/projected/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-kube-api-access-gbqfx\") pod \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") "
Jul 23 11:18:07.424858 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.424769    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-bundle\") pod \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\" (UID: \"7a2a3a4c-8f14-4e94-b844-f30ac9e17990\") "
Jul 23 11:18:07.425193 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.425168    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-bundle" (OuterVolumeSpecName: "bundle") pod "7a2a3a4c-8f14-4e94-b844-f30ac9e17990" (UID: "7a2a3a4c-8f14-4e94-b844-f30ac9e17990"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:18:07.430871 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.430808    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-kube-api-access-gbqfx" (OuterVolumeSpecName: "kube-api-access-gbqfx") pod "7a2a3a4c-8f14-4e94-b844-f30ac9e17990" (UID: "7a2a3a4c-8f14-4e94-b844-f30ac9e17990"). InnerVolumeSpecName "kube-api-access-gbqfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:18:07.432334 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.432295    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-util" (OuterVolumeSpecName: "util") pod "7a2a3a4c-8f14-4e94-b844-f30ac9e17990" (UID: "7a2a3a4c-8f14-4e94-b844-f30ac9e17990"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:18:07.526090 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.526057    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-util\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:18:07.526090 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.526088    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbqfx\" (UniqueName: \"kubernetes.io/projected/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-kube-api-access-gbqfx\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:18:07.526090 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.526098    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2a3a4c-8f14-4e94-b844-f30ac9e17990-bundle\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:18:07.909463 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.909421    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tt7wc"]
Jul 23 11:18:07.909848 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.909829    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerName="pull"
Jul 23 11:18:07.909936 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.909850    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerName="pull"
Jul 23 11:18:07.909936 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.909889    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerName="util"
Jul 23 11:18:07.909936 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.909898    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerName="util"
Jul 23 11:18:07.909936 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.909909    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerName="extract"
Jul 23 11:18:07.909936 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.909917    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerName="extract"
Jul 23 11:18:07.910175 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.910006    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a2a3a4c-8f14-4e94-b844-f30ac9e17990" containerName="extract"
Jul 23 11:18:07.913167 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.913146    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:07.915515 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.915495    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nms4n\""
Jul 23 11:18:07.923105 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.923082    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tt7wc"]
Jul 23 11:18:07.928930 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.928909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsjhp\" (UniqueName: \"kubernetes.io/projected/20908f98-2627-4466-9d6e-05646c0056c5-kube-api-access-lsjhp\") pod \"cert-manager-webhook-6486ffd997-tt7wc\" (UID: \"20908f98-2627-4466-9d6e-05646c0056c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:07.929016 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:07.928986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20908f98-2627-4466-9d6e-05646c0056c5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tt7wc\" (UID: \"20908f98-2627-4466-9d6e-05646c0056c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:08.029932 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.029900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsjhp\" (UniqueName: \"kubernetes.io/projected/20908f98-2627-4466-9d6e-05646c0056c5-kube-api-access-lsjhp\") pod \"cert-manager-webhook-6486ffd997-tt7wc\" (UID: \"20908f98-2627-4466-9d6e-05646c0056c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:08.030057 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.029975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20908f98-2627-4466-9d6e-05646c0056c5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tt7wc\" (UID: \"20908f98-2627-4466-9d6e-05646c0056c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:08.040392 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.040363    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsjhp\" (UniqueName: \"kubernetes.io/projected/20908f98-2627-4466-9d6e-05646c0056c5-kube-api-access-lsjhp\") pod \"cert-manager-webhook-6486ffd997-tt7wc\" (UID: \"20908f98-2627-4466-9d6e-05646c0056c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:08.040584 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.040568    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20908f98-2627-4466-9d6e-05646c0056c5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tt7wc\" (UID: \"20908f98-2627-4466-9d6e-05646c0056c5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:08.222565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.222476    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:08.270187 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.270161    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84"
Jul 23 11:18:08.270649 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.270186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffvp84" event={"ID":"7a2a3a4c-8f14-4e94-b844-f30ac9e17990","Type":"ContainerDied","Data":"a61ce9976aa9c581c9b964840d804f0b751573b10237836259c170277762b079"}
Jul 23 11:18:08.270649 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.270226    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a61ce9976aa9c581c9b964840d804f0b751573b10237836259c170277762b079"
Jul 23 11:18:08.356231 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:08.356195    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tt7wc"]
Jul 23 11:18:08.360728 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:18:08.360704    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20908f98_2627_4466_9d6e_05646c0056c5.slice/crio-09faf9a7707e5141896a4d4168d2353a5d86e321872c2c9a5452d2e9ada419ec WatchSource:0}: Error finding container 09faf9a7707e5141896a4d4168d2353a5d86e321872c2c9a5452d2e9ada419ec: Status 404 returned error can't find the container with id 09faf9a7707e5141896a4d4168d2353a5d86e321872c2c9a5452d2e9ada419ec
Jul 23 11:18:09.275844 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:09.275805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc" event={"ID":"20908f98-2627-4466-9d6e-05646c0056c5","Type":"ContainerStarted","Data":"2842ea6989e44d7ce19c97d6da2629faf194c37eb85c0b039c859f73ffa235fb"}
Jul 23 11:18:09.275844 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:09.275857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc" event={"ID":"20908f98-2627-4466-9d6e-05646c0056c5","Type":"ContainerStarted","Data":"09faf9a7707e5141896a4d4168d2353a5d86e321872c2c9a5452d2e9ada419ec"}
Jul 23 11:18:09.276252 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:09.275876    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:09.293998 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:09.293949    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc" podStartSLOduration=2.293935286 podStartE2EDuration="2.293935286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:18:09.293280281 +0000 UTC m=+504.339377395" watchObservedRunningTime="2026-07-23 11:18:09.293935286 +0000 UTC m=+504.340032399"
Jul 23 11:18:11.018794 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.018762    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-btq7f"]
Jul 23 11:18:11.022099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.022083    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.024113 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.024094    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tsc8d\""
Jul 23 11:18:11.032408 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.032385    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-btq7f"]
Jul 23 11:18:11.054244 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.054221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5htc6\" (UniqueName: \"kubernetes.io/projected/fe7cd316-6d7e-42f2-9530-e283ed61fc45-kube-api-access-5htc6\") pod \"cert-manager-55b4d954d5-btq7f\" (UID: \"fe7cd316-6d7e-42f2-9530-e283ed61fc45\") " pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.054343 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.054319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe7cd316-6d7e-42f2-9530-e283ed61fc45-bound-sa-token\") pod \"cert-manager-55b4d954d5-btq7f\" (UID: \"fe7cd316-6d7e-42f2-9530-e283ed61fc45\") " pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.155553 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.155514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe7cd316-6d7e-42f2-9530-e283ed61fc45-bound-sa-token\") pod \"cert-manager-55b4d954d5-btq7f\" (UID: \"fe7cd316-6d7e-42f2-9530-e283ed61fc45\") " pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.155709 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.155577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5htc6\" (UniqueName: \"kubernetes.io/projected/fe7cd316-6d7e-42f2-9530-e283ed61fc45-kube-api-access-5htc6\") pod \"cert-manager-55b4d954d5-btq7f\" (UID: \"fe7cd316-6d7e-42f2-9530-e283ed61fc45\") " pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.166103 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.166067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe7cd316-6d7e-42f2-9530-e283ed61fc45-bound-sa-token\") pod \"cert-manager-55b4d954d5-btq7f\" (UID: \"fe7cd316-6d7e-42f2-9530-e283ed61fc45\") " pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.166215 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.166108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5htc6\" (UniqueName: \"kubernetes.io/projected/fe7cd316-6d7e-42f2-9530-e283ed61fc45-kube-api-access-5htc6\") pod \"cert-manager-55b4d954d5-btq7f\" (UID: \"fe7cd316-6d7e-42f2-9530-e283ed61fc45\") " pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.331861 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.331817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-btq7f"
Jul 23 11:18:11.485404 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:11.485374    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-btq7f"]
Jul 23 11:18:11.488650 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:18:11.488625    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe7cd316_6d7e_42f2_9530_e283ed61fc45.slice/crio-06af8bbac71689bad7760486fdf03ae41d1718d9c43135598034f286f88a201c WatchSource:0}: Error finding container 06af8bbac71689bad7760486fdf03ae41d1718d9c43135598034f286f88a201c: Status 404 returned error can't find the container with id 06af8bbac71689bad7760486fdf03ae41d1718d9c43135598034f286f88a201c
Jul 23 11:18:12.290852 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:12.290813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-btq7f" event={"ID":"fe7cd316-6d7e-42f2-9530-e283ed61fc45","Type":"ContainerStarted","Data":"74295ab39a037ebd4d179fa76f02dee12d056ffd2e933251b0aa7bd207db78fa"}
Jul 23 11:18:12.291246 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:12.290861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-btq7f" event={"ID":"fe7cd316-6d7e-42f2-9530-e283ed61fc45","Type":"ContainerStarted","Data":"06af8bbac71689bad7760486fdf03ae41d1718d9c43135598034f286f88a201c"}
Jul 23 11:18:12.312904 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:12.312855    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-btq7f" podStartSLOduration=1.312838191 podStartE2EDuration="1.312838191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:18:12.310331966 +0000 UTC m=+507.356429079" watchObservedRunningTime="2026-07-23 11:18:12.312838191 +0000 UTC m=+507.358935305"
Jul 23 11:18:15.282608 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:15.282573    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tt7wc"
Jul 23 11:18:21.369688 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.369651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"]
Jul 23 11:18:21.410912 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.410831    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"]
Jul 23 11:18:21.411077 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.410930    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.413604 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.413577    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 11:18:21.414227 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.414198    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 11:18:21.414337 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.414198    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5t9kf\""
Jul 23 11:18:21.443702 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.443679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.443851 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.443718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q86fn\" (UniqueName: \"kubernetes.io/projected/76144794-e944-4cb0-baf9-8f4b644841af-kube-api-access-q86fn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.443851 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.443789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.544684 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.544652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.544899 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.544698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q86fn\" (UniqueName: \"kubernetes.io/projected/76144794-e944-4cb0-baf9-8f4b644841af-kube-api-access-q86fn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.544899 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.544795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.545122 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.545098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.545183 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.545116    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.553144 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.553117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q86fn\" (UniqueName: \"kubernetes.io/projected/76144794-e944-4cb0-baf9-8f4b644841af-kube-api-access-q86fn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.720331 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.720240    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:21.894405 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:21.894377    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"]
Jul 23 11:18:21.897146 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:18:21.897116    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76144794_e944_4cb0_baf9_8f4b644841af.slice/crio-8c31e07f04876c66d5a41e1f9504fb65ba9b917a45b1d37e1c0bf6736ca53372 WatchSource:0}: Error finding container 8c31e07f04876c66d5a41e1f9504fb65ba9b917a45b1d37e1c0bf6736ca53372: Status 404 returned error can't find the container with id 8c31e07f04876c66d5a41e1f9504fb65ba9b917a45b1d37e1c0bf6736ca53372
Jul 23 11:18:22.336928 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:22.336894    2573 generic.go:356] "Generic (PLEG): container finished" podID="76144794-e944-4cb0-baf9-8f4b644841af" containerID="89f587fc13a691b80edd83a63eda3439d9dd43944841c6458f3f883b5ca9ab2f" exitCode=0
Jul 23 11:18:22.337097 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:22.336972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l" event={"ID":"76144794-e944-4cb0-baf9-8f4b644841af","Type":"ContainerDied","Data":"89f587fc13a691b80edd83a63eda3439d9dd43944841c6458f3f883b5ca9ab2f"}
Jul 23 11:18:22.337097 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:22.337029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l" event={"ID":"76144794-e944-4cb0-baf9-8f4b644841af","Type":"ContainerStarted","Data":"8c31e07f04876c66d5a41e1f9504fb65ba9b917a45b1d37e1c0bf6736ca53372"}
Jul 23 11:18:23.343219 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:23.343184    2573 generic.go:356] "Generic (PLEG): container finished" podID="76144794-e944-4cb0-baf9-8f4b644841af" containerID="541f3690ea9f64435988e3fa7f8ede5724bc5c3ce535cbb143586e48480acdbb" exitCode=0
Jul 23 11:18:23.343612 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:23.343234    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l" event={"ID":"76144794-e944-4cb0-baf9-8f4b644841af","Type":"ContainerDied","Data":"541f3690ea9f64435988e3fa7f8ede5724bc5c3ce535cbb143586e48480acdbb"}
Jul 23 11:18:24.349431 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:24.349393    2573 generic.go:356] "Generic (PLEG): container finished" podID="76144794-e944-4cb0-baf9-8f4b644841af" containerID="ec54013af67c66cef3dbe50bff7bc8a2cde7c89c5bbc5a5031cd4fb64fb6a325" exitCode=0
Jul 23 11:18:24.349834 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:24.349440    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l" event={"ID":"76144794-e944-4cb0-baf9-8f4b644841af","Type":"ContainerDied","Data":"ec54013af67c66cef3dbe50bff7bc8a2cde7c89c5bbc5a5031cd4fb64fb6a325"}
Jul 23 11:18:25.486105 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.486080    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:25.580481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.580449    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q86fn\" (UniqueName: \"kubernetes.io/projected/76144794-e944-4cb0-baf9-8f4b644841af-kube-api-access-q86fn\") pod \"76144794-e944-4cb0-baf9-8f4b644841af\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") "
Jul 23 11:18:25.580734 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.580543    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-bundle\") pod \"76144794-e944-4cb0-baf9-8f4b644841af\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") "
Jul 23 11:18:25.580734 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.580582    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-util\") pod \"76144794-e944-4cb0-baf9-8f4b644841af\" (UID: \"76144794-e944-4cb0-baf9-8f4b644841af\") "
Jul 23 11:18:25.581292 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.581262    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-bundle" (OuterVolumeSpecName: "bundle") pod "76144794-e944-4cb0-baf9-8f4b644841af" (UID: "76144794-e944-4cb0-baf9-8f4b644841af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:18:25.582547 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.582521    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76144794-e944-4cb0-baf9-8f4b644841af-kube-api-access-q86fn" (OuterVolumeSpecName: "kube-api-access-q86fn") pod "76144794-e944-4cb0-baf9-8f4b644841af" (UID: "76144794-e944-4cb0-baf9-8f4b644841af"). InnerVolumeSpecName "kube-api-access-q86fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:18:25.586475 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.586428    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-util" (OuterVolumeSpecName: "util") pod "76144794-e944-4cb0-baf9-8f4b644841af" (UID: "76144794-e944-4cb0-baf9-8f4b644841af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:18:25.682013 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.681928    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-bundle\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:18:25.682013 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.681959    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76144794-e944-4cb0-baf9-8f4b644841af-util\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:18:25.682013 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:25.681968    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q86fn\" (UniqueName: \"kubernetes.io/projected/76144794-e944-4cb0-baf9-8f4b644841af-kube-api-access-q86fn\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:18:26.360663 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:26.360627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l" event={"ID":"76144794-e944-4cb0-baf9-8f4b644841af","Type":"ContainerDied","Data":"8c31e07f04876c66d5a41e1f9504fb65ba9b917a45b1d37e1c0bf6736ca53372"}
Jul 23 11:18:26.360846 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:26.360672    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8nv5l"
Jul 23 11:18:26.360846 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:26.360680    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c31e07f04876c66d5a41e1f9504fb65ba9b917a45b1d37e1c0bf6736ca53372"
Jul 23 11:18:38.354460 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354376    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"]
Jul 23 11:18:38.354831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354703    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76144794-e944-4cb0-baf9-8f4b644841af" containerName="util"
Jul 23 11:18:38.354831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354716    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76144794-e944-4cb0-baf9-8f4b644841af" containerName="util"
Jul 23 11:18:38.354831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354730    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76144794-e944-4cb0-baf9-8f4b644841af" containerName="pull"
Jul 23 11:18:38.354831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354736    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76144794-e944-4cb0-baf9-8f4b644841af" containerName="pull"
Jul 23 11:18:38.354831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354763    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76144794-e944-4cb0-baf9-8f4b644841af" containerName="extract"
Jul 23 11:18:38.354831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354770    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76144794-e944-4cb0-baf9-8f4b644841af" containerName="extract"
Jul 23 11:18:38.354831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.354825    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="76144794-e944-4cb0-baf9-8f4b644841af" containerName="extract"
Jul 23 11:18:38.360152 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.360131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.363423 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.363404    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 11:18:38.363964 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.363942    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mdr24\""
Jul 23 11:18:38.364033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.363945    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 11:18:38.364033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.363983    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 11:18:38.365271 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.365254    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:18:38.365343 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.365312    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 11:18:38.378470 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.378442    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"]
Jul 23 11:18:38.494374 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.494342    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/762204db-d4c8-47e5-9b06-df0b3ca59061-manager-config\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.494557 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.494469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/762204db-d4c8-47e5-9b06-df0b3ca59061-metrics-cert\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.494557 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.494502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w8bq\" (UniqueName: \"kubernetes.io/projected/762204db-d4c8-47e5-9b06-df0b3ca59061-kube-api-access-9w8bq\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.494557 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.494531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/762204db-d4c8-47e5-9b06-df0b3ca59061-cert\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.527494 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.527453    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"]
Jul 23 11:18:38.536868 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.536837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.540025 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.539996    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 11:18:38.540164 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.540052    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 11:18:38.540164 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.540160    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x6vh5\""
Jul 23 11:18:38.540281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.540227    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 11:18:38.540281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.540246    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 11:18:38.549723 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.549703    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"]
Jul 23 11:18:38.595324 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.595284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/762204db-d4c8-47e5-9b06-df0b3ca59061-metrics-cert\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.595324 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.595328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w8bq\" (UniqueName: \"kubernetes.io/projected/762204db-d4c8-47e5-9b06-df0b3ca59061-kube-api-access-9w8bq\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.595538 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.595359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/762204db-d4c8-47e5-9b06-df0b3ca59061-cert\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.595538 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.595378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/762204db-d4c8-47e5-9b06-df0b3ca59061-manager-config\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.596140 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.596115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/762204db-d4c8-47e5-9b06-df0b3ca59061-manager-config\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.597854 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.597820    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/762204db-d4c8-47e5-9b06-df0b3ca59061-cert\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.597974 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.597878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/762204db-d4c8-47e5-9b06-df0b3ca59061-metrics-cert\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.604259 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.604229    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w8bq\" (UniqueName: \"kubernetes.io/projected/762204db-d4c8-47e5-9b06-df0b3ca59061-kube-api-access-9w8bq\") pod \"lws-controller-manager-57b4b866cd-9p75g\" (UID: \"762204db-d4c8-47e5-9b06-df0b3ca59061\") " pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.669112 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.669034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:38.695999 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.695968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.696127 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.696009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-manifests\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.696127 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.696079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6xwl\" (UniqueName: \"kubernetes.io/projected/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-kube-api-access-w6xwl\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.696227 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.696142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-webhook-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.696284 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.696241    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-tmp\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.797677 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.797638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6xwl\" (UniqueName: \"kubernetes.io/projected/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-kube-api-access-w6xwl\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.797861 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.797733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-webhook-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.797861 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.797816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-tmp\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.797976 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.797866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.798028 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.797983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-manifests\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.798313 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.798291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-manifests\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.799991 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.799969    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-tmp\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.800318 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.800297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-webhook-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.800408 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.800358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.814234 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.814206    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6xwl\" (UniqueName: \"kubernetes.io/projected/deaa815d-2ee3-4c9f-b2bc-0c43a334fa32-kube-api-access-w6xwl\") pod \"opendatahub-operator-controller-manager-684564f56d-47zcv\" (UID: \"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:38.821616 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.821597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"]
Jul 23 11:18:38.823560 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:18:38.823537    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762204db_d4c8_47e5_9b06_df0b3ca59061.slice/crio-e45720bccd13553723a4a9e4564926c8ce27c6a93d45bf6421273c7c6a13ddb0 WatchSource:0}: Error finding container e45720bccd13553723a4a9e4564926c8ce27c6a93d45bf6421273c7c6a13ddb0: Status 404 returned error can't find the container with id e45720bccd13553723a4a9e4564926c8ce27c6a93d45bf6421273c7c6a13ddb0
Jul 23 11:18:38.846803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:38.846771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:39.009647 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:39.009626    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"]
Jul 23 11:18:39.011903 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:18:39.011872    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeaa815d_2ee3_4c9f_b2bc_0c43a334fa32.slice/crio-e38fe5cf706566ad6e22964f52d2747142e83e5c83734ff711ce00ba9eb97359 WatchSource:0}: Error finding container e38fe5cf706566ad6e22964f52d2747142e83e5c83734ff711ce00ba9eb97359: Status 404 returned error can't find the container with id e38fe5cf706566ad6e22964f52d2747142e83e5c83734ff711ce00ba9eb97359
Jul 23 11:18:39.421292 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:39.421256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv" event={"ID":"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32","Type":"ContainerStarted","Data":"e38fe5cf706566ad6e22964f52d2747142e83e5c83734ff711ce00ba9eb97359"}
Jul 23 11:18:39.422466 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:39.422434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g" event={"ID":"762204db-d4c8-47e5-9b06-df0b3ca59061","Type":"ContainerStarted","Data":"e45720bccd13553723a4a9e4564926c8ce27c6a93d45bf6421273c7c6a13ddb0"}
Jul 23 11:18:41.436264 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:41.436216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g" event={"ID":"762204db-d4c8-47e5-9b06-df0b3ca59061","Type":"ContainerStarted","Data":"1e841bf08d83a67a829eb7bec4879216d05eadcb968f1441c0adef28f0fcfdb6"}
Jul 23 11:18:41.436708 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:41.436319    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:41.459525 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:41.459459    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g" podStartSLOduration=1.925616179 podStartE2EDuration="3.459439799s" totalImagesPullingTime="1.53382362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:18:41.457899211 +0000 UTC m=+536.503996338" watchObservedRunningTime="2026-07-23 11:18:41.459439799 +0000 UTC m=+536.505536912"
Jul 23 11:18:43.450627 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:43.450595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv" event={"ID":"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32","Type":"ContainerStarted","Data":"ca3700d6233d880e8cefce32e8f7f6e6d3ae55bcc9f6d6f4e60b08984151a1c6"}
Jul 23 11:18:44.457360 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:44.457317    2573 generic.go:356] "Generic (PLEG): container finished" podID="deaa815d-2ee3-4c9f-b2bc-0c43a334fa32" containerID="ca3700d6233d880e8cefce32e8f7f6e6d3ae55bcc9f6d6f4e60b08984151a1c6" exitCode=0
Jul 23 11:18:44.457804 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:44.457378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv" event={"ID":"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32","Type":"ContainerDied","Data":"ca3700d6233d880e8cefce32e8f7f6e6d3ae55bcc9f6d6f4e60b08984151a1c6"}
Jul 23 11:18:45.463895 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:45.463861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv" event={"ID":"deaa815d-2ee3-4c9f-b2bc-0c43a334fa32","Type":"ContainerStarted","Data":"dfc16d85ed384a7f1ced31498cf51adea9f833eb147f16400ac03ea6b7b59c98"}
Jul 23 11:18:45.464269 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:45.463977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:45.486239 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:45.486184    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv" podStartSLOduration=2.307620214 podStartE2EDuration="7.486166892s" totalImagesPullingTime="4.090926332s" totalInitContainerRuntime="1.087620346s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:18:45.485120761 +0000 UTC m=+540.531217875" watchObservedRunningTime="2026-07-23 11:18:45.486166892 +0000 UTC m=+540.532264006"
Jul 23 11:18:52.444994 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:52.444962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57b4b866cd-9p75g"
Jul 23 11:18:56.470207 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:56.470177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-47zcv"
Jul 23 11:18:58.784689 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.784657    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"]
Jul 23 11:18:58.794749 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.794717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.797188 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.797157    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 11:18:58.797715 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.797696    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 11:18:58.797828 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.797696    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hbvxd\""
Jul 23 11:18:58.797968 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.797951    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 11:18:58.798027 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.798006    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 11:18:58.803256 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.803234    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"]
Jul 23 11:18:58.873893 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.873858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f59d2e-c77e-49ad-8e96-43d350a35268-tmp\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.874071 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.873915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12f59d2e-c77e-49ad-8e96-43d350a35268-tls-certs\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.874071 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.873942    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxn7x\" (UniqueName: \"kubernetes.io/projected/12f59d2e-c77e-49ad-8e96-43d350a35268-kube-api-access-mxn7x\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.974353 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.974320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f59d2e-c77e-49ad-8e96-43d350a35268-tmp\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.974545 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.974372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12f59d2e-c77e-49ad-8e96-43d350a35268-tls-certs\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.974545 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.974490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxn7x\" (UniqueName: \"kubernetes.io/projected/12f59d2e-c77e-49ad-8e96-43d350a35268-kube-api-access-mxn7x\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.976567 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.976542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f59d2e-c77e-49ad-8e96-43d350a35268-tmp\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.976878 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.976859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12f59d2e-c77e-49ad-8e96-43d350a35268-tls-certs\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:58.992500 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:58.992477    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxn7x\" (UniqueName: \"kubernetes.io/projected/12f59d2e-c77e-49ad-8e96-43d350a35268-kube-api-access-mxn7x\") pod \"kube-auth-proxy-5fffd658f5-shj5w\" (UID: \"12f59d2e-c77e-49ad-8e96-43d350a35268\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:59.106730 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:59.106689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"
Jul 23 11:18:59.259064 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:59.259036    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w"]
Jul 23 11:18:59.260916 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:18:59.260884    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f59d2e_c77e_49ad_8e96_43d350a35268.slice/crio-9b0584247917d81e8d2ec7e017bb059bbf7c8c647f32d29f4d8994ad46b5ce3e WatchSource:0}: Error finding container 9b0584247917d81e8d2ec7e017bb059bbf7c8c647f32d29f4d8994ad46b5ce3e: Status 404 returned error can't find the container with id 9b0584247917d81e8d2ec7e017bb059bbf7c8c647f32d29f4d8994ad46b5ce3e
Jul 23 11:18:59.529258 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:18:59.529180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w" event={"ID":"12f59d2e-c77e-49ad-8e96-43d350a35268","Type":"ContainerStarted","Data":"9b0584247917d81e8d2ec7e017bb059bbf7c8c647f32d29f4d8994ad46b5ce3e"}
Jul 23 11:19:02.544893 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:19:02.544799    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w" event={"ID":"12f59d2e-c77e-49ad-8e96-43d350a35268","Type":"ContainerStarted","Data":"3b8fc4eadeea492e8575a4f612a3feb2c243b2c9796ed0e5a85981fd75456a21"}
Jul 23 11:19:02.564507 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:19:02.564454    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-shj5w" podStartSLOduration=1.718610719 podStartE2EDuration="4.5644373s" totalImagesPullingTime="2.845826581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:19:02.562656293 +0000 UTC m=+557.608753407" watchObservedRunningTime="2026-07-23 11:19:02.5644373 +0000 UTC m=+557.610534414"
Jul 23 11:20:15.583097 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.583055    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"]
Jul 23 11:20:15.586937 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.586913    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.589066 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.589028    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 11:20:15.589208 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.589165    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 11:20:15.589282 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.589245    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-srkvm\""
Jul 23 11:20:15.595580 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.595181    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"]
Jul 23 11:20:15.727856 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.727822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.728016 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.727870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.728016 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.727895    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8f26\" (UniqueName: \"kubernetes.io/projected/32b01c9a-a9f6-4854-b665-3c462960e204-kube-api-access-b8f26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.829218 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.829159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.829218 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.829220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8f26\" (UniqueName: \"kubernetes.io/projected/32b01c9a-a9f6-4854-b665-3c462960e204-kube-api-access-b8f26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.829443 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.829302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.829584 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.829564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.829625 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.829593    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.838029 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.837978    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8f26\" (UniqueName: \"kubernetes.io/projected/32b01c9a-a9f6-4854-b665-3c462960e204-kube-api-access-b8f26\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:15.898579 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:15.898546    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:16.034304 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.034237    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"]
Jul 23 11:20:16.037122 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:20:16.037094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b01c9a_a9f6_4854_b665_3c462960e204.slice/crio-6f854391bfd9b641fdab8bb9e604e7218eb03ccbd8d416f9e474d6f95a552791 WatchSource:0}: Error finding container 6f854391bfd9b641fdab8bb9e604e7218eb03ccbd8d416f9e474d6f95a552791: Status 404 returned error can't find the container with id 6f854391bfd9b641fdab8bb9e604e7218eb03ccbd8d416f9e474d6f95a552791
Jul 23 11:20:16.381174 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.381079    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"]
Jul 23 11:20:16.386774 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.385982    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.393276 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.393249    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"]
Jul 23 11:20:16.534669 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.534628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6d88\" (UniqueName: \"kubernetes.io/projected/3dd3a9bb-6af4-4a09-9267-c02cd297c564-kube-api-access-h6d88\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.534896 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.534683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.534896 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.534838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.636290 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.636190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6d88\" (UniqueName: \"kubernetes.io/projected/3dd3a9bb-6af4-4a09-9267-c02cd297c564-kube-api-access-h6d88\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.636290 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.636245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.636788 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.636304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.636788 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.636649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.636788 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.636664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.644563 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.644540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6d88\" (UniqueName: \"kubernetes.io/projected/3dd3a9bb-6af4-4a09-9267-c02cd297c564-kube-api-access-h6d88\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.698850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.698813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:16.781340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.781303    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"]
Jul 23 11:20:16.787128 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.787103    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:16.795016 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.794948    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"]
Jul 23 11:20:16.847979 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.847942    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"]
Jul 23 11:20:16.852846 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:20:16.852615    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd3a9bb_6af4_4a09_9267_c02cd297c564.slice/crio-77a0a83ce672791be145b6f1234418903d300bd3efbf77edfaa82d85c0fef001 WatchSource:0}: Error finding container 77a0a83ce672791be145b6f1234418903d300bd3efbf77edfaa82d85c0fef001: Status 404 returned error can't find the container with id 77a0a83ce672791be145b6f1234418903d300bd3efbf77edfaa82d85c0fef001
Jul 23 11:20:16.905786 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.905753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk" event={"ID":"3dd3a9bb-6af4-4a09-9267-c02cd297c564","Type":"ContainerStarted","Data":"77a0a83ce672791be145b6f1234418903d300bd3efbf77edfaa82d85c0fef001"}
Jul 23 11:20:16.907311 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.907267    2573 generic.go:356] "Generic (PLEG): container finished" podID="32b01c9a-a9f6-4854-b665-3c462960e204" containerID="db4c126ab06776105674ba1af06c5db36d9bfe938347f1aeb792bf816905412e" exitCode=0
Jul 23 11:20:16.907428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.907336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr" event={"ID":"32b01c9a-a9f6-4854-b665-3c462960e204","Type":"ContainerDied","Data":"db4c126ab06776105674ba1af06c5db36d9bfe938347f1aeb792bf816905412e"}
Jul 23 11:20:16.907428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.907393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr" event={"ID":"32b01c9a-a9f6-4854-b665-3c462960e204","Type":"ContainerStarted","Data":"6f854391bfd9b641fdab8bb9e604e7218eb03ccbd8d416f9e474d6f95a552791"}
Jul 23 11:20:16.907884 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.907866    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:20:16.939310 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.939277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:16.939485 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.939333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:16.939485 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:16.939380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dltkp\" (UniqueName: \"kubernetes.io/projected/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-kube-api-access-dltkp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.040394 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.040353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dltkp\" (UniqueName: \"kubernetes.io/projected/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-kube-api-access-dltkp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.040557 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.040463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.040557 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.040526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.040885 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.040867    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.040939 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.040896    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.049340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.049318    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dltkp\" (UniqueName: \"kubernetes.io/projected/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-kube-api-access-dltkp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.099347 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.099305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:17.205482 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.205453    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"]
Jul 23 11:20:17.209620 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.209597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.220335 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.220309    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"]
Jul 23 11:20:17.245258 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.245227    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"]
Jul 23 11:20:17.248101 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:20:17.248074    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a20c7c_6b3e_4469_8e6e_2d087b32a994.slice/crio-b19fd9c92d3272a7cb922e1b54afa7269c622d7d9c678bb11a81ca564362d212 WatchSource:0}: Error finding container b19fd9c92d3272a7cb922e1b54afa7269c622d7d9c678bb11a81ca564362d212: Status 404 returned error can't find the container with id b19fd9c92d3272a7cb922e1b54afa7269c622d7d9c678bb11a81ca564362d212
Jul 23 11:20:17.342874 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.342846    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.342992 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.342935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqq7l\" (UniqueName: \"kubernetes.io/projected/35388e0c-7784-4c14-85e3-d92aafbb50db-kube-api-access-gqq7l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.342992 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.342985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.443656 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.443578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqq7l\" (UniqueName: \"kubernetes.io/projected/35388e0c-7784-4c14-85e3-d92aafbb50db-kube-api-access-gqq7l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.443656 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.443621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.443843 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.443679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.444043 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.444024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.444126 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.444051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.453409 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.453382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqq7l\" (UniqueName: \"kubernetes.io/projected/35388e0c-7784-4c14-85e3-d92aafbb50db-kube-api-access-gqq7l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.522123 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.522085    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:17.654682 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.654654    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"]
Jul 23 11:20:17.657242 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:20:17.657217    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35388e0c_7784_4c14_85e3_d92aafbb50db.slice/crio-004448f076f63ef8e3aa1801319d89794eb4794d02f93a97790c80675d5a25ea WatchSource:0}: Error finding container 004448f076f63ef8e3aa1801319d89794eb4794d02f93a97790c80675d5a25ea: Status 404 returned error can't find the container with id 004448f076f63ef8e3aa1801319d89794eb4794d02f93a97790c80675d5a25ea
Jul 23 11:20:17.920185 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.920155    2573 generic.go:356] "Generic (PLEG): container finished" podID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerID="7fbb79fd3233a9e9bd6f2b20738eb39f1d65724ed99f628331b465047f6361b9" exitCode=0
Jul 23 11:20:17.920388 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.920227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk" event={"ID":"3dd3a9bb-6af4-4a09-9267-c02cd297c564","Type":"ContainerDied","Data":"7fbb79fd3233a9e9bd6f2b20738eb39f1d65724ed99f628331b465047f6361b9"}
Jul 23 11:20:17.922039 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.922012    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerID="64733de9ac983b6905e0b5dfae533ce57087bceff7b883987bb50deb5be32808" exitCode=0
Jul 23 11:20:17.922139 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.922104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l" event={"ID":"e5a20c7c-6b3e-4469-8e6e-2d087b32a994","Type":"ContainerDied","Data":"64733de9ac983b6905e0b5dfae533ce57087bceff7b883987bb50deb5be32808"}
Jul 23 11:20:17.922198 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.922155    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l" event={"ID":"e5a20c7c-6b3e-4469-8e6e-2d087b32a994","Type":"ContainerStarted","Data":"b19fd9c92d3272a7cb922e1b54afa7269c622d7d9c678bb11a81ca564362d212"}
Jul 23 11:20:17.923837 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.923810    2573 generic.go:356] "Generic (PLEG): container finished" podID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerID="8646027c33f74a00ecb272138470f6eb30f70ee3a6db3bd869e19c4b9b45c818" exitCode=0
Jul 23 11:20:17.923920 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.923861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt" event={"ID":"35388e0c-7784-4c14-85e3-d92aafbb50db","Type":"ContainerDied","Data":"8646027c33f74a00ecb272138470f6eb30f70ee3a6db3bd869e19c4b9b45c818"}
Jul 23 11:20:17.923920 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:17.923899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt" event={"ID":"35388e0c-7784-4c14-85e3-d92aafbb50db","Type":"ContainerStarted","Data":"004448f076f63ef8e3aa1801319d89794eb4794d02f93a97790c80675d5a25ea"}
Jul 23 11:20:18.931825 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:18.931794    2573 generic.go:356] "Generic (PLEG): container finished" podID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerID="055053a721682ac7ca03c89de8b183c2760dbcf1cc7548aca8287dc8ea47b4f5" exitCode=0
Jul 23 11:20:18.932173 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:18.931878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk" event={"ID":"3dd3a9bb-6af4-4a09-9267-c02cd297c564","Type":"ContainerDied","Data":"055053a721682ac7ca03c89de8b183c2760dbcf1cc7548aca8287dc8ea47b4f5"}
Jul 23 11:20:18.933621 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:18.933601    2573 generic.go:356] "Generic (PLEG): container finished" podID="32b01c9a-a9f6-4854-b665-3c462960e204" containerID="f52739e117f34b7217a6fddb02727102640b0608ce33e22a71a28481ca136ae5" exitCode=0
Jul 23 11:20:18.933705 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:18.933667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr" event={"ID":"32b01c9a-a9f6-4854-b665-3c462960e204","Type":"ContainerDied","Data":"f52739e117f34b7217a6fddb02727102640b0608ce33e22a71a28481ca136ae5"}
Jul 23 11:20:19.940409 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.940376    2573 generic.go:356] "Generic (PLEG): container finished" podID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerID="e386abac1f8f63f265deffab882d67fee62cfb3cb0d93c4691545f48e2dbaa5e" exitCode=0
Jul 23 11:20:19.940854 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.940457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk" event={"ID":"3dd3a9bb-6af4-4a09-9267-c02cd297c564","Type":"ContainerDied","Data":"e386abac1f8f63f265deffab882d67fee62cfb3cb0d93c4691545f48e2dbaa5e"}
Jul 23 11:20:19.942451 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.942424    2573 generic.go:356] "Generic (PLEG): container finished" podID="32b01c9a-a9f6-4854-b665-3c462960e204" containerID="f65ce7f25e818efea6d619fe2c91bbb41dea2465bafcfd7612befc0fd57e59ba" exitCode=0
Jul 23 11:20:19.942576 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.942489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr" event={"ID":"32b01c9a-a9f6-4854-b665-3c462960e204","Type":"ContainerDied","Data":"f65ce7f25e818efea6d619fe2c91bbb41dea2465bafcfd7612befc0fd57e59ba"}
Jul 23 11:20:19.944055 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.944035    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerID="f297cf48a2d38c872f795f0640f61d7e594c88abe7e67eb1728da5a474ce1a20" exitCode=0
Jul 23 11:20:19.944151 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.944112    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l" event={"ID":"e5a20c7c-6b3e-4469-8e6e-2d087b32a994","Type":"ContainerDied","Data":"f297cf48a2d38c872f795f0640f61d7e594c88abe7e67eb1728da5a474ce1a20"}
Jul 23 11:20:19.945905 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.945884    2573 generic.go:356] "Generic (PLEG): container finished" podID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerID="c694e6718729c0836dd465d7d1306ebb864a466332d360841e162005c538951a" exitCode=0
Jul 23 11:20:19.946014 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:19.945997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt" event={"ID":"35388e0c-7784-4c14-85e3-d92aafbb50db","Type":"ContainerDied","Data":"c694e6718729c0836dd465d7d1306ebb864a466332d360841e162005c538951a"}
Jul 23 11:20:20.953793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:20.953755    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerID="f98d7a2afb802d1c8b2d963dd89d4f1e3f920197ddaf3e87e49847c7418e271a" exitCode=0
Jul 23 11:20:20.954174 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:20.953831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l" event={"ID":"e5a20c7c-6b3e-4469-8e6e-2d087b32a994","Type":"ContainerDied","Data":"f98d7a2afb802d1c8b2d963dd89d4f1e3f920197ddaf3e87e49847c7418e271a"}
Jul 23 11:20:20.955896 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:20.955867    2573 generic.go:356] "Generic (PLEG): container finished" podID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerID="398704d30fd63e0588e62c06e9d33413b6f429652900e502c73e17286a48bcde" exitCode=0
Jul 23 11:20:20.956004 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:20.955938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt" event={"ID":"35388e0c-7784-4c14-85e3-d92aafbb50db","Type":"ContainerDied","Data":"398704d30fd63e0588e62c06e9d33413b6f429652900e502c73e17286a48bcde"}
Jul 23 11:20:21.091730 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.091705    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:21.128129 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.128106    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:21.177472 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.177436    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-bundle\") pod \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") "
Jul 23 11:20:21.177655 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.177493    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6d88\" (UniqueName: \"kubernetes.io/projected/3dd3a9bb-6af4-4a09-9267-c02cd297c564-kube-api-access-h6d88\") pod \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") "
Jul 23 11:20:21.177655 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.177517    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-util\") pod \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\" (UID: \"3dd3a9bb-6af4-4a09-9267-c02cd297c564\") "
Jul 23 11:20:21.178026 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.177994    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-bundle" (OuterVolumeSpecName: "bundle") pod "3dd3a9bb-6af4-4a09-9267-c02cd297c564" (UID: "3dd3a9bb-6af4-4a09-9267-c02cd297c564"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:21.179775 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.179731    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd3a9bb-6af4-4a09-9267-c02cd297c564-kube-api-access-h6d88" (OuterVolumeSpecName: "kube-api-access-h6d88") pod "3dd3a9bb-6af4-4a09-9267-c02cd297c564" (UID: "3dd3a9bb-6af4-4a09-9267-c02cd297c564"). InnerVolumeSpecName "kube-api-access-h6d88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:20:21.183122 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.183095    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-util" (OuterVolumeSpecName: "util") pod "3dd3a9bb-6af4-4a09-9267-c02cd297c564" (UID: "3dd3a9bb-6af4-4a09-9267-c02cd297c564"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:21.278721 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.278633    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8f26\" (UniqueName: \"kubernetes.io/projected/32b01c9a-a9f6-4854-b665-3c462960e204-kube-api-access-b8f26\") pod \"32b01c9a-a9f6-4854-b665-3c462960e204\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") "
Jul 23 11:20:21.278721 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.278682    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-bundle\") pod \"32b01c9a-a9f6-4854-b665-3c462960e204\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") "
Jul 23 11:20:21.278721 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.278699    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-util\") pod \"32b01c9a-a9f6-4854-b665-3c462960e204\" (UID: \"32b01c9a-a9f6-4854-b665-3c462960e204\") "
Jul 23 11:20:21.279018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.278886    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6d88\" (UniqueName: \"kubernetes.io/projected/3dd3a9bb-6af4-4a09-9267-c02cd297c564-kube-api-access-h6d88\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:21.279018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.278896    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-util\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:21.279018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.278906    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dd3a9bb-6af4-4a09-9267-c02cd297c564-bundle\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:21.279179 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.279154    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-bundle" (OuterVolumeSpecName: "bundle") pod "32b01c9a-a9f6-4854-b665-3c462960e204" (UID: "32b01c9a-a9f6-4854-b665-3c462960e204"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:21.280755 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.280726    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b01c9a-a9f6-4854-b665-3c462960e204-kube-api-access-b8f26" (OuterVolumeSpecName: "kube-api-access-b8f26") pod "32b01c9a-a9f6-4854-b665-3c462960e204" (UID: "32b01c9a-a9f6-4854-b665-3c462960e204"). InnerVolumeSpecName "kube-api-access-b8f26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:20:21.310755 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.310710    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-util" (OuterVolumeSpecName: "util") pod "32b01c9a-a9f6-4854-b665-3c462960e204" (UID: "32b01c9a-a9f6-4854-b665-3c462960e204"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:21.379865 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.379824    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8f26\" (UniqueName: \"kubernetes.io/projected/32b01c9a-a9f6-4854-b665-3c462960e204-kube-api-access-b8f26\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:21.379865 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.379858    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-bundle\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:21.379865 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.379867    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b01c9a-a9f6-4854-b665-3c462960e204-util\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:21.962730 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.962699    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk"
Jul 23 11:20:21.963144 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.962699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk" event={"ID":"3dd3a9bb-6af4-4a09-9267-c02cd297c564","Type":"ContainerDied","Data":"77a0a83ce672791be145b6f1234418903d300bd3efbf77edfaa82d85c0fef001"}
Jul 23 11:20:21.963144 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.962787    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77a0a83ce672791be145b6f1234418903d300bd3efbf77edfaa82d85c0fef001"
Jul 23 11:20:21.964525 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.964506    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr"
Jul 23 11:20:21.964673 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.964526    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr" event={"ID":"32b01c9a-a9f6-4854-b665-3c462960e204","Type":"ContainerDied","Data":"6f854391bfd9b641fdab8bb9e604e7218eb03ccbd8d416f9e474d6f95a552791"}
Jul 23 11:20:21.964673 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:21.964568    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f854391bfd9b641fdab8bb9e604e7218eb03ccbd8d416f9e474d6f95a552791"
Jul 23 11:20:22.116345 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.116322    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:22.119482 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.119455    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:22.188424 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.188388    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqq7l\" (UniqueName: \"kubernetes.io/projected/35388e0c-7784-4c14-85e3-d92aafbb50db-kube-api-access-gqq7l\") pod \"35388e0c-7784-4c14-85e3-d92aafbb50db\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") "
Jul 23 11:20:22.188603 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.188494    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-bundle\") pod \"35388e0c-7784-4c14-85e3-d92aafbb50db\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") "
Jul 23 11:20:22.188603 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.188540    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-util\") pod \"35388e0c-7784-4c14-85e3-d92aafbb50db\" (UID: \"35388e0c-7784-4c14-85e3-d92aafbb50db\") "
Jul 23 11:20:22.189052 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.189024    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-bundle" (OuterVolumeSpecName: "bundle") pod "35388e0c-7784-4c14-85e3-d92aafbb50db" (UID: "35388e0c-7784-4c14-85e3-d92aafbb50db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:22.190536 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.190516    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35388e0c-7784-4c14-85e3-d92aafbb50db-kube-api-access-gqq7l" (OuterVolumeSpecName: "kube-api-access-gqq7l") pod "35388e0c-7784-4c14-85e3-d92aafbb50db" (UID: "35388e0c-7784-4c14-85e3-d92aafbb50db"). InnerVolumeSpecName "kube-api-access-gqq7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:20:22.193727 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.193692    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-util" (OuterVolumeSpecName: "util") pod "35388e0c-7784-4c14-85e3-d92aafbb50db" (UID: "35388e0c-7784-4c14-85e3-d92aafbb50db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:22.289301 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.289217    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-bundle\") pod \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") "
Jul 23 11:20:22.289301 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.289257    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dltkp\" (UniqueName: \"kubernetes.io/projected/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-kube-api-access-dltkp\") pod \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") "
Jul 23 11:20:22.289301 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.289286    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-util\") pod \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\" (UID: \"e5a20c7c-6b3e-4469-8e6e-2d087b32a994\") "
Jul 23 11:20:22.289574 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.289545    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-bundle\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:22.289574 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.289564    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35388e0c-7784-4c14-85e3-d92aafbb50db-util\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:22.289679 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.289577    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqq7l\" (UniqueName: \"kubernetes.io/projected/35388e0c-7784-4c14-85e3-d92aafbb50db-kube-api-access-gqq7l\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:22.289918 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.289890    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-bundle" (OuterVolumeSpecName: "bundle") pod "e5a20c7c-6b3e-4469-8e6e-2d087b32a994" (UID: "e5a20c7c-6b3e-4469-8e6e-2d087b32a994"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:22.291418 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.291376    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-kube-api-access-dltkp" (OuterVolumeSpecName: "kube-api-access-dltkp") pod "e5a20c7c-6b3e-4469-8e6e-2d087b32a994" (UID: "e5a20c7c-6b3e-4469-8e6e-2d087b32a994"). InnerVolumeSpecName "kube-api-access-dltkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:20:22.294666 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.294641    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-util" (OuterVolumeSpecName: "util") pod "e5a20c7c-6b3e-4469-8e6e-2d087b32a994" (UID: "e5a20c7c-6b3e-4469-8e6e-2d087b32a994"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:20:22.390297 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.390246    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-bundle\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:22.390297 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.390290    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dltkp\" (UniqueName: \"kubernetes.io/projected/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-kube-api-access-dltkp\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:22.390297 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.390300    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5a20c7c-6b3e-4469-8e6e-2d087b32a994-util\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:20:22.971011 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.970981    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l"
Jul 23 11:20:22.971399 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.971011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l" event={"ID":"e5a20c7c-6b3e-4469-8e6e-2d087b32a994","Type":"ContainerDied","Data":"b19fd9c92d3272a7cb922e1b54afa7269c622d7d9c678bb11a81ca564362d212"}
Jul 23 11:20:22.971399 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.971059    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b19fd9c92d3272a7cb922e1b54afa7269c622d7d9c678bb11a81ca564362d212"
Jul 23 11:20:22.972827 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.972804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt" event={"ID":"35388e0c-7784-4c14-85e3-d92aafbb50db","Type":"ContainerDied","Data":"004448f076f63ef8e3aa1801319d89794eb4794d02f93a97790c80675d5a25ea"}
Jul 23 11:20:22.972920 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.972842    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt"
Jul 23 11:20:22.972968 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:22.972846    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="004448f076f63ef8e3aa1801319d89794eb4794d02f93a97790c80675d5a25ea"
Jul 23 11:20:57.587792 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.587752    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"]
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588135    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b01c9a-a9f6-4854-b665-3c462960e204" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588147    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b01c9a-a9f6-4854-b665-3c462960e204" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588158    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588165    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588177    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588187    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588200    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588205    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588218    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588223    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588232    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588237    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588242    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerName="extract"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588250    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerName="extract"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588260    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588267    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerName="util"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588274    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b01c9a-a9f6-4854-b665-3c462960e204" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588278    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b01c9a-a9f6-4854-b665-3c462960e204" containerName="pull"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588291    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerName="extract"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588298    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerName="extract"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588305    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b01c9a-a9f6-4854-b665-3c462960e204" containerName="extract"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588310    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b01c9a-a9f6-4854-b665-3c462960e204" containerName="extract"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588315    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerName="extract"
Jul 23 11:20:57.588320 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588321    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerName="extract"
Jul 23 11:20:57.589148 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588385    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="35388e0c-7784-4c14-85e3-d92aafbb50db" containerName="extract"
Jul 23 11:20:57.589148 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588392    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b01c9a-a9f6-4854-b665-3c462960e204" containerName="extract"
Jul 23 11:20:57.589148 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588398    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd3a9bb-6af4-4a09-9267-c02cd297c564" containerName="extract"
Jul 23 11:20:57.589148 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.588404    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5a20c7c-6b3e-4469-8e6e-2d087b32a994" containerName="extract"
Jul 23 11:20:57.592802 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.592780    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:57.597296 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.597269    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5mjcr\""
Jul 23 11:20:57.597296 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.597271    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 11:20:57.606857 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.606831    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 11:20:57.646283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.646239    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"]
Jul 23 11:20:57.709934 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.709883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckt2t\" (UniqueName: \"kubernetes.io/projected/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-kube-api-access-ckt2t\") pod \"kuadrant-operator-controller-manager-86878c769f-45t2w\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:57.710139 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.710088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-45t2w\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:57.811189 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.811149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckt2t\" (UniqueName: \"kubernetes.io/projected/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-kube-api-access-ckt2t\") pod \"kuadrant-operator-controller-manager-86878c769f-45t2w\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:57.811360 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.811196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-45t2w\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:57.811619 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.811601    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-45t2w\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:57.823433 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.823404    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckt2t\" (UniqueName: \"kubernetes.io/projected/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-kube-api-access-ckt2t\") pod \"kuadrant-operator-controller-manager-86878c769f-45t2w\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:57.902352 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:57.902263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:20:58.064445 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:58.064417    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"]
Jul 23 11:20:58.065717 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:20:58.065692    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b098030_10c8_4fe4_ac7d_9a8567c3ed2b.slice/crio-ac3f45998011a20f6e7123b38e22079db3cc934644ebb4675b6e82b88eeb8b10 WatchSource:0}: Error finding container ac3f45998011a20f6e7123b38e22079db3cc934644ebb4675b6e82b88eeb8b10: Status 404 returned error can't find the container with id ac3f45998011a20f6e7123b38e22079db3cc934644ebb4675b6e82b88eeb8b10
Jul 23 11:20:58.158979 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:20:58.158891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w" event={"ID":"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b","Type":"ContainerStarted","Data":"ac3f45998011a20f6e7123b38e22079db3cc934644ebb4675b6e82b88eeb8b10"}
Jul 23 11:21:04.200204 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:04.200160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w" event={"ID":"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b","Type":"ContainerStarted","Data":"738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373"}
Jul 23 11:21:04.200589 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:04.200370    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:21:04.220412 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:04.220356    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w" podStartSLOduration=2.116632454 podStartE2EDuration="7.220333241s" totalImagesPullingTime="5.103700787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:04.218922384 +0000 UTC m=+679.265019498" watchObservedRunningTime="2026-07-23 11:21:04.220333241 +0000 UTC m=+679.266430354"
Jul 23 11:21:15.208409 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:15.208377    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:21:39.033433 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.033340    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wvfn7"]
Jul 23 11:21:39.037793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.037769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wvfn7"
Jul 23 11:21:39.039883 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.039860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f7cpt\""
Jul 23 11:21:39.043180 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.043155    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wvfn7"]
Jul 23 11:21:39.087162 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.087118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dpnj\" (UniqueName: \"kubernetes.io/projected/9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c-kube-api-access-2dpnj\") pod \"authorino-75d556bd77-wvfn7\" (UID: \"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c\") " pod="kuadrant-system/authorino-75d556bd77-wvfn7"
Jul 23 11:21:39.188481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.188441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dpnj\" (UniqueName: \"kubernetes.io/projected/9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c-kube-api-access-2dpnj\") pod \"authorino-75d556bd77-wvfn7\" (UID: \"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c\") " pod="kuadrant-system/authorino-75d556bd77-wvfn7"
Jul 23 11:21:39.196812 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.196778    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dpnj\" (UniqueName: \"kubernetes.io/projected/9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c-kube-api-access-2dpnj\") pod \"authorino-75d556bd77-wvfn7\" (UID: \"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c\") " pod="kuadrant-system/authorino-75d556bd77-wvfn7"
Jul 23 11:21:39.347726 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.347690    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wvfn7"
Jul 23 11:21:39.483509 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:39.483483    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wvfn7"]
Jul 23 11:21:39.485688 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:21:39.485660    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c351c19_ef27_4d5c_aa7b_1f1b80e4ab7c.slice/crio-72e2a8d50ac2f4be58a4c6dc6158f64e9d61f05b19a7492296d8478388eaed62 WatchSource:0}: Error finding container 72e2a8d50ac2f4be58a4c6dc6158f64e9d61f05b19a7492296d8478388eaed62: Status 404 returned error can't find the container with id 72e2a8d50ac2f4be58a4c6dc6158f64e9d61f05b19a7492296d8478388eaed62
Jul 23 11:21:40.394825 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:40.394781    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wvfn7" event={"ID":"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c","Type":"ContainerStarted","Data":"72e2a8d50ac2f4be58a4c6dc6158f64e9d61f05b19a7492296d8478388eaed62"}
Jul 23 11:21:43.415878 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:43.415838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wvfn7" event={"ID":"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c","Type":"ContainerStarted","Data":"61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e"}
Jul 23 11:21:43.433133 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:21:43.433077    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wvfn7" podStartSLOduration=1.2723613089999999 podStartE2EDuration="4.43306033s" totalImagesPullingTime="3.160699021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:43.431767868 +0000 UTC m=+718.477864984" watchObservedRunningTime="2026-07-23 11:21:43.43306033 +0000 UTC m=+718.479157444"
Jul 23 11:22:13.768471 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.768433    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x8fkc"]
Jul 23 11:22:13.772001 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.771978    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x8fkc"
Jul 23 11:22:13.779850 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.779824    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x8fkc"]
Jul 23 11:22:13.808870 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.808835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l79v4\" (UniqueName: \"kubernetes.io/projected/ea398cca-604f-4651-bd65-9560f2fe2d4c-kube-api-access-l79v4\") pod \"authorino-5d4b67c446-x8fkc\" (UID: \"ea398cca-604f-4651-bd65-9560f2fe2d4c\") " pod="kuadrant-system/authorino-5d4b67c446-x8fkc"
Jul 23 11:22:13.909880 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.909841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l79v4\" (UniqueName: \"kubernetes.io/projected/ea398cca-604f-4651-bd65-9560f2fe2d4c-kube-api-access-l79v4\") pod \"authorino-5d4b67c446-x8fkc\" (UID: \"ea398cca-604f-4651-bd65-9560f2fe2d4c\") " pod="kuadrant-system/authorino-5d4b67c446-x8fkc"
Jul 23 11:22:13.919167 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.919134    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l79v4\" (UniqueName: \"kubernetes.io/projected/ea398cca-604f-4651-bd65-9560f2fe2d4c-kube-api-access-l79v4\") pod \"authorino-5d4b67c446-x8fkc\" (UID: \"ea398cca-604f-4651-bd65-9560f2fe2d4c\") " pod="kuadrant-system/authorino-5d4b67c446-x8fkc"
Jul 23 11:22:13.989682 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.989648    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x8fkc"]
Jul 23 11:22:13.989949 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:13.989932    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x8fkc"
Jul 23 11:22:14.019861 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.019793    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-786d9454bc-k2gjs"]
Jul 23 11:22:14.023413 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.023382    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786d9454bc-k2gjs"
Jul 23 11:22:14.034234 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.034205    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786d9454bc-k2gjs"]
Jul 23 11:22:14.111618 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.111575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzffh\" (UniqueName: \"kubernetes.io/projected/ea530a53-033e-41a3-b668-c335bbdb562e-kube-api-access-gzffh\") pod \"authorino-786d9454bc-k2gjs\" (UID: \"ea530a53-033e-41a3-b668-c335bbdb562e\") " pod="kuadrant-system/authorino-786d9454bc-k2gjs"
Jul 23 11:22:14.128161 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.128135    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x8fkc"]
Jul 23 11:22:14.130107 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:22:14.130084    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea398cca_604f_4651_bd65_9560f2fe2d4c.slice/crio-cab2a71b732031227048516709b04a8331a5a5121dc546cdb1ad24c9b638e1a9 WatchSource:0}: Error finding container cab2a71b732031227048516709b04a8331a5a5121dc546cdb1ad24c9b638e1a9: Status 404 returned error can't find the container with id cab2a71b732031227048516709b04a8331a5a5121dc546cdb1ad24c9b638e1a9
Jul 23 11:22:14.163157 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.163130    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786d9454bc-k2gjs"]
Jul 23 11:22:14.163406 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:22:14.163376    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gzffh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-786d9454bc-k2gjs" podUID="ea530a53-033e-41a3-b668-c335bbdb562e"
Jul 23 11:22:14.212436 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.212399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzffh\" (UniqueName: \"kubernetes.io/projected/ea530a53-033e-41a3-b668-c335bbdb562e-kube-api-access-gzffh\") pod \"authorino-786d9454bc-k2gjs\" (UID: \"ea530a53-033e-41a3-b668-c335bbdb562e\") " pod="kuadrant-system/authorino-786d9454bc-k2gjs"
Jul 23 11:22:14.215436 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.215409    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cc7c47bd7-js8nn"]
Jul 23 11:22:14.218837 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.218820    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.224869 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.224848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzffh\" (UniqueName: \"kubernetes.io/projected/ea530a53-033e-41a3-b668-c335bbdb562e-kube-api-access-gzffh\") pod \"authorino-786d9454bc-k2gjs\" (UID: \"ea530a53-033e-41a3-b668-c335bbdb562e\") " pod="kuadrant-system/authorino-786d9454bc-k2gjs"
Jul 23 11:22:14.230040 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.230022    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 11:22:14.238553 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.238532    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cc7c47bd7-js8nn"]
Jul 23 11:22:14.312853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.312823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-tls-cert\") pod \"authorino-cc7c47bd7-js8nn\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") " pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.313010 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.312908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqb7\" (UniqueName: \"kubernetes.io/projected/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-kube-api-access-vfqb7\") pod \"authorino-cc7c47bd7-js8nn\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") " pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.414274 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.414237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqb7\" (UniqueName: \"kubernetes.io/projected/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-kube-api-access-vfqb7\") pod \"authorino-cc7c47bd7-js8nn\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") " pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.414427 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.414312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-tls-cert\") pod \"authorino-cc7c47bd7-js8nn\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") " pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.416735 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.416704    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-tls-cert\") pod \"authorino-cc7c47bd7-js8nn\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") " pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.422803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.422782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqb7\" (UniqueName: \"kubernetes.io/projected/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-kube-api-access-vfqb7\") pod \"authorino-cc7c47bd7-js8nn\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") " pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.536281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.536249    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:22:14.584518 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.584442    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786d9454bc-k2gjs"
Jul 23 11:22:14.584754 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.584485    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x8fkc" event={"ID":"ea398cca-604f-4651-bd65-9560f2fe2d4c","Type":"ContainerStarted","Data":"5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080"}
Jul 23 11:22:14.584880 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.584790    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x8fkc" event={"ID":"ea398cca-604f-4651-bd65-9560f2fe2d4c","Type":"ContainerStarted","Data":"cab2a71b732031227048516709b04a8331a5a5121dc546cdb1ad24c9b638e1a9"}
Jul 23 11:22:14.584880 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.584526    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-x8fkc" podUID="ea398cca-604f-4651-bd65-9560f2fe2d4c" containerName="authorino" containerID="cri-o://5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080" gracePeriod=30
Jul 23 11:22:14.593282 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.593257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786d9454bc-k2gjs"
Jul 23 11:22:14.602661 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.602619    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-x8fkc" podStartSLOduration=1.306294266 podStartE2EDuration="1.602601024s" totalImagesPullingTime="296.306758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:22:14.599538111 +0000 UTC m=+749.645635225" watchObservedRunningTime="2026-07-23 11:22:14.602601024 +0000 UTC m=+749.648698158"
Jul 23 11:22:14.616102 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.616078    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzffh\" (UniqueName: \"kubernetes.io/projected/ea530a53-033e-41a3-b668-c335bbdb562e-kube-api-access-gzffh\") pod \"ea530a53-033e-41a3-b668-c335bbdb562e\" (UID: \"ea530a53-033e-41a3-b668-c335bbdb562e\") "
Jul 23 11:22:14.618204 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.618179    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea530a53-033e-41a3-b668-c335bbdb562e-kube-api-access-gzffh" (OuterVolumeSpecName: "kube-api-access-gzffh") pod "ea530a53-033e-41a3-b668-c335bbdb562e" (UID: "ea530a53-033e-41a3-b668-c335bbdb562e"). InnerVolumeSpecName "kube-api-access-gzffh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:22:14.689286 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.689258    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cc7c47bd7-js8nn"]
Jul 23 11:22:14.690712 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:22:14.690677    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9430bcd4_ac34_4d1c_966a_de3b4e1d0c6d.slice/crio-bad7b28b808cebb636da0267da8bb22c02bc2109071f511f40ec3a93cdf1bf3c WatchSource:0}: Error finding container bad7b28b808cebb636da0267da8bb22c02bc2109071f511f40ec3a93cdf1bf3c: Status 404 returned error can't find the container with id bad7b28b808cebb636da0267da8bb22c02bc2109071f511f40ec3a93cdf1bf3c
Jul 23 11:22:14.716876 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.716854    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzffh\" (UniqueName: \"kubernetes.io/projected/ea530a53-033e-41a3-b668-c335bbdb562e-kube-api-access-gzffh\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:22:14.814929 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.814907    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x8fkc"
Jul 23 11:22:14.918836 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.918754    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l79v4\" (UniqueName: \"kubernetes.io/projected/ea398cca-604f-4651-bd65-9560f2fe2d4c-kube-api-access-l79v4\") pod \"ea398cca-604f-4651-bd65-9560f2fe2d4c\" (UID: \"ea398cca-604f-4651-bd65-9560f2fe2d4c\") "
Jul 23 11:22:14.920714 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:14.920691    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea398cca-604f-4651-bd65-9560f2fe2d4c-kube-api-access-l79v4" (OuterVolumeSpecName: "kube-api-access-l79v4") pod "ea398cca-604f-4651-bd65-9560f2fe2d4c" (UID: "ea398cca-604f-4651-bd65-9560f2fe2d4c"). InnerVolumeSpecName "kube-api-access-l79v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:22:15.020042 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.020009    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l79v4\" (UniqueName: \"kubernetes.io/projected/ea398cca-604f-4651-bd65-9560f2fe2d4c-kube-api-access-l79v4\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:22:15.592130 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.592086    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc7c47bd7-js8nn" event={"ID":"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d","Type":"ContainerStarted","Data":"85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee"}
Jul 23 11:22:15.592130 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.592136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc7c47bd7-js8nn" event={"ID":"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d","Type":"ContainerStarted","Data":"bad7b28b808cebb636da0267da8bb22c02bc2109071f511f40ec3a93cdf1bf3c"}
Jul 23 11:22:15.593338 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.593314    2573 generic.go:356] "Generic (PLEG): container finished" podID="ea398cca-604f-4651-bd65-9560f2fe2d4c" containerID="5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080" exitCode=0
Jul 23 11:22:15.593449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.593357    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x8fkc"
Jul 23 11:22:15.593449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.593374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786d9454bc-k2gjs"
Jul 23 11:22:15.593449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.593384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x8fkc" event={"ID":"ea398cca-604f-4651-bd65-9560f2fe2d4c","Type":"ContainerDied","Data":"5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080"}
Jul 23 11:22:15.593449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.593425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x8fkc" event={"ID":"ea398cca-604f-4651-bd65-9560f2fe2d4c","Type":"ContainerDied","Data":"cab2a71b732031227048516709b04a8331a5a5121dc546cdb1ad24c9b638e1a9"}
Jul 23 11:22:15.593602 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.593449    2573 scope.go:117] "RemoveContainer" containerID="5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080"
Jul 23 11:22:15.602053 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.602034    2573 scope.go:117] "RemoveContainer" containerID="5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080"
Jul 23 11:22:15.602310 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:22:15.602287    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080\": container with ID starting with 5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080 not found: ID does not exist" containerID="5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080"
Jul 23 11:22:15.602375 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.602317    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080"} err="failed to get container status \"5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080\": rpc error: code = NotFound desc = could not find container \"5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080\": container with ID starting with 5d7905e8003a29f5f72da2a3ea25af09f6666f79db51281aafdd6e5186a56080 not found: ID does not exist"
Jul 23 11:22:15.612210 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.612167    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cc7c47bd7-js8nn" podStartSLOduration=1.279306731 podStartE2EDuration="1.612152193s" totalImagesPullingTime="332.845462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:22:15.610089466 +0000 UTC m=+750.656186577" watchObservedRunningTime="2026-07-23 11:22:15.612152193 +0000 UTC m=+750.658249307"
Jul 23 11:22:15.626202 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.626170    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x8fkc"]
Jul 23 11:22:15.632638 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.632613    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x8fkc"]
Jul 23 11:22:15.640272 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.640246    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wvfn7"]
Jul 23 11:22:15.640439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.640412    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wvfn7" podUID="9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c" containerName="authorino" containerID="cri-o://61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e" gracePeriod=30
Jul 23 11:22:15.654462 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.654432    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786d9454bc-k2gjs"]
Jul 23 11:22:15.659296 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.659266    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-786d9454bc-k2gjs"]
Jul 23 11:22:15.897232 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.897208    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wvfn7"
Jul 23 11:22:15.928082 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.928060    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dpnj\" (UniqueName: \"kubernetes.io/projected/9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c-kube-api-access-2dpnj\") pod \"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c\" (UID: \"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c\") "
Jul 23 11:22:15.930070 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:15.930047    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c-kube-api-access-2dpnj" (OuterVolumeSpecName: "kube-api-access-2dpnj") pod "9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c" (UID: "9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c"). InnerVolumeSpecName "kube-api-access-2dpnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:22:16.029674 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.029602    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dpnj\" (UniqueName: \"kubernetes.io/projected/9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c-kube-api-access-2dpnj\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:22:16.600330 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.600294    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c" containerID="61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e" exitCode=0
Jul 23 11:22:16.600481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.600341    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wvfn7"
Jul 23 11:22:16.600481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.600384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wvfn7" event={"ID":"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c","Type":"ContainerDied","Data":"61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e"}
Jul 23 11:22:16.600481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.600431    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wvfn7" event={"ID":"9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c","Type":"ContainerDied","Data":"72e2a8d50ac2f4be58a4c6dc6158f64e9d61f05b19a7492296d8478388eaed62"}
Jul 23 11:22:16.600481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.600450    2573 scope.go:117] "RemoveContainer" containerID="61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e"
Jul 23 11:22:16.609127 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.609109    2573 scope.go:117] "RemoveContainer" containerID="61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e"
Jul 23 11:22:16.609393 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:22:16.609374    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e\": container with ID starting with 61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e not found: ID does not exist" containerID="61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e"
Jul 23 11:22:16.609446 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.609402    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e"} err="failed to get container status \"61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e\": rpc error: code = NotFound desc = could not find container \"61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e\": container with ID starting with 61a112e6d97bb841a52d5cc93d05bd2d1c5a530c7e7f1bb065853c5573c1941e not found: ID does not exist"
Jul 23 11:22:16.621116 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.621089    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wvfn7"]
Jul 23 11:22:16.627725 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:16.627705    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wvfn7"]
Jul 23 11:22:17.447565 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:17.447536    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c" path="/var/lib/kubelet/pods/9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c/volumes"
Jul 23 11:22:17.447925 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:17.447866    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea398cca-604f-4651-bd65-9560f2fe2d4c" path="/var/lib/kubelet/pods/ea398cca-604f-4651-bd65-9560f2fe2d4c/volumes"
Jul 23 11:22:17.448152 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:22:17.448139    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea530a53-033e-41a3-b668-c335bbdb562e" path="/var/lib/kubelet/pods/ea530a53-033e-41a3-b668-c335bbdb562e/volumes"
Jul 23 11:23:26.206601 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.206561    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"]
Jul 23 11:23:26.207102 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.206931    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c" containerName="authorino"
Jul 23 11:23:26.207102 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.206946    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c" containerName="authorino"
Jul 23 11:23:26.207102 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.206963    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea398cca-604f-4651-bd65-9560f2fe2d4c" containerName="authorino"
Jul 23 11:23:26.207102 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.206969    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea398cca-604f-4651-bd65-9560f2fe2d4c" containerName="authorino"
Jul 23 11:23:26.207102 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.207095    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c351c19-ef27-4d5c-aa7b-1f1b80e4ab7c" containerName="authorino"
Jul 23 11:23:26.207102 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.207105    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea398cca-604f-4651-bd65-9560f2fe2d4c" containerName="authorino"
Jul 23 11:23:26.210235 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.210219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.212550 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.212531    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 11:23:26.213222 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.213207    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 11:23:26.213295 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.213216    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9687v\""
Jul 23 11:23:26.213295 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.213208    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 11:23:26.220101 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.220076    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"]
Jul 23 11:23:26.269502 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.269458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.269502 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.269504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.269698 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.269565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.269698 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.269606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60b58d86-25d6-488a-abe5-20293ecdb4ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.270693 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.269632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpfw\" (UniqueName: \"kubernetes.io/projected/60b58d86-25d6-488a-abe5-20293ecdb4ee-kube-api-access-mmpfw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.270693 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.270140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.371466 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.371671 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.371671 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.371671 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60b58d86-25d6-488a-abe5-20293ecdb4ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.371671 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpfw\" (UniqueName: \"kubernetes.io/projected/60b58d86-25d6-488a-abe5-20293ecdb4ee-kube-api-access-mmpfw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.371955 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.371955 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.372079 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.371980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.372079 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.372047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.373799 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.373780    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60b58d86-25d6-488a-abe5-20293ecdb4ee-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.374065 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.374046    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60b58d86-25d6-488a-abe5-20293ecdb4ee-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.378882 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.378865    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpfw\" (UniqueName: \"kubernetes.io/projected/60b58d86-25d6-488a-abe5-20293ecdb4ee-kube-api-access-mmpfw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d2vz8\" (UID: \"60b58d86-25d6-488a-abe5-20293ecdb4ee\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.521465 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.521374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:26.656549 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.656524    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"]
Jul 23 11:23:26.658313 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:23:26.658288    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b58d86_25d6_488a_abe5_20293ecdb4ee.slice/crio-9d7b93408eed49924601f4063c44e02d7fd9f3ac99082f6bf3616505348f58dd WatchSource:0}: Error finding container 9d7b93408eed49924601f4063c44e02d7fd9f3ac99082f6bf3616505348f58dd: Status 404 returned error can't find the container with id 9d7b93408eed49924601f4063c44e02d7fd9f3ac99082f6bf3616505348f58dd
Jul 23 11:23:26.973464 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:26.973425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8" event={"ID":"60b58d86-25d6-488a-abe5-20293ecdb4ee","Type":"ContainerStarted","Data":"9d7b93408eed49924601f4063c44e02d7fd9f3ac99082f6bf3616505348f58dd"}
Jul 23 11:23:28.987100 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:28.987061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8" event={"ID":"60b58d86-25d6-488a-abe5-20293ecdb4ee","Type":"ContainerStarted","Data":"45f6a9ac9d09c54930c4746477bba714835e49fb7380a81894820fc8238fff51"}
Jul 23 11:23:29.007038 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:29.006982    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8" podStartSLOduration=1.73294008 podStartE2EDuration="3.006966102s" totalImagesPullingTime="1.274026022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:23:29.004274908 +0000 UTC m=+824.050372022" watchObservedRunningTime="2026-07-23 11:23:29.006966102 +0000 UTC m=+824.053063262"
Jul 23 11:23:36.522164 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:36.522121    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:36.522707 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:36.522183    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:36.534949 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:36.534918    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:23:37.044171 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:23:37.044139    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d2vz8"
Jul 23 11:24:01.698633 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.698598    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"]
Jul 23 11:24:01.702353 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.702334    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.704478 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.704458    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 11:24:01.713508 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.713481    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"]
Jul 23 11:24:01.788808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.788765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.788979 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.788855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.788979 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.788898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926nd\" (UniqueName: \"kubernetes.io/projected/1a345d43-524b-40e0-9cd5-4afb2cdf022a-kube-api-access-926nd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.788979 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.788945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a345d43-524b-40e0-9cd5-4afb2cdf022a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.789085 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.789012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.789085 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.789047    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.889603 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.889562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926nd\" (UniqueName: \"kubernetes.io/projected/1a345d43-524b-40e0-9cd5-4afb2cdf022a-kube-api-access-926nd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.889808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.889622    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a345d43-524b-40e0-9cd5-4afb2cdf022a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.889808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.889664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.889808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.889680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.889964 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.889868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.889964 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.889939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.890155 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.890131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.890223 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.890142    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.890223 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.890174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.892031 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.892012    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a345d43-524b-40e0-9cd5-4afb2cdf022a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.892202 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.892184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a345d43-524b-40e0-9cd5-4afb2cdf022a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:01.898085 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:01.898064    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-926nd\" (UniqueName: \"kubernetes.io/projected/1a345d43-524b-40e0-9cd5-4afb2cdf022a-kube-api-access-926nd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cztbf\" (UID: \"1a345d43-524b-40e0-9cd5-4afb2cdf022a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:02.011798 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:02.011683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:02.147255 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:02.147228    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"]
Jul 23 11:24:02.149451 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:24:02.149423    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a345d43_524b_40e0_9cd5_4afb2cdf022a.slice/crio-631febb0b8be8d27a645527c3914c4e8ea9033b9ca6130b97c7bb7351b0cebc8 WatchSource:0}: Error finding container 631febb0b8be8d27a645527c3914c4e8ea9033b9ca6130b97c7bb7351b0cebc8: Status 404 returned error can't find the container with id 631febb0b8be8d27a645527c3914c4e8ea9033b9ca6130b97c7bb7351b0cebc8
Jul 23 11:24:02.168923 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:02.168896    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf" event={"ID":"1a345d43-524b-40e0-9cd5-4afb2cdf022a","Type":"ContainerStarted","Data":"631febb0b8be8d27a645527c3914c4e8ea9033b9ca6130b97c7bb7351b0cebc8"}
Jul 23 11:24:03.175485 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:03.175446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf" event={"ID":"1a345d43-524b-40e0-9cd5-4afb2cdf022a","Type":"ContainerStarted","Data":"73cb5e2fd5fc3eba42c796668f988e245a1598db059bd5635455f97036a03c0b"}
Jul 23 11:24:03.193374 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:03.193318    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf" podStartSLOduration=1.9659882199999998 podStartE2EDuration="2.19330178s" totalImagesPullingTime="227.31356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:24:03.192385119 +0000 UTC m=+858.238482235" watchObservedRunningTime="2026-07-23 11:24:03.19330178 +0000 UTC m=+858.239398928"
Jul 23 11:24:12.012248 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:12.012212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:12.012763 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:12.012266    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:12.026233 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:12.026207    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:24:12.241343 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:24:12.241307    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cztbf"
Jul 23 11:25:17.756940 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.756903    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79546bd658-hwkpn"]
Jul 23 11:25:17.760352 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.760336    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:17.767629 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.767273    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79546bd658-hwkpn"]
Jul 23 11:25:17.883388 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.883339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8620dc8b-c744-4501-b8a5-cc5980645a57-tls-cert\") pod \"authorino-79546bd658-hwkpn\" (UID: \"8620dc8b-c744-4501-b8a5-cc5980645a57\") " pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:17.883560 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.883398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d26zf\" (UniqueName: \"kubernetes.io/projected/8620dc8b-c744-4501-b8a5-cc5980645a57-kube-api-access-d26zf\") pod \"authorino-79546bd658-hwkpn\" (UID: \"8620dc8b-c744-4501-b8a5-cc5980645a57\") " pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:17.984885 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.984846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8620dc8b-c744-4501-b8a5-cc5980645a57-tls-cert\") pod \"authorino-79546bd658-hwkpn\" (UID: \"8620dc8b-c744-4501-b8a5-cc5980645a57\") " pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:17.984885 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.984885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d26zf\" (UniqueName: \"kubernetes.io/projected/8620dc8b-c744-4501-b8a5-cc5980645a57-kube-api-access-d26zf\") pod \"authorino-79546bd658-hwkpn\" (UID: \"8620dc8b-c744-4501-b8a5-cc5980645a57\") " pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:17.987298 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.987268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8620dc8b-c744-4501-b8a5-cc5980645a57-tls-cert\") pod \"authorino-79546bd658-hwkpn\" (UID: \"8620dc8b-c744-4501-b8a5-cc5980645a57\") " pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:17.992096 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:17.992072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d26zf\" (UniqueName: \"kubernetes.io/projected/8620dc8b-c744-4501-b8a5-cc5980645a57-kube-api-access-d26zf\") pod \"authorino-79546bd658-hwkpn\" (UID: \"8620dc8b-c744-4501-b8a5-cc5980645a57\") " pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:18.070540 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:18.070504    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79546bd658-hwkpn"
Jul 23 11:25:18.215563 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:18.215535    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79546bd658-hwkpn"]
Jul 23 11:25:18.217452 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:25:18.217420    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8620dc8b_c744_4501_b8a5_cc5980645a57.slice/crio-bffa9553ad66c81a33632421f67d717b1544c9aff3f3839cb5727c3a3a69b3ae WatchSource:0}: Error finding container bffa9553ad66c81a33632421f67d717b1544c9aff3f3839cb5727c3a3a69b3ae: Status 404 returned error can't find the container with id bffa9553ad66c81a33632421f67d717b1544c9aff3f3839cb5727c3a3a69b3ae
Jul 23 11:25:18.218853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:18.218833    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:25:18.587538 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:18.587503    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79546bd658-hwkpn" event={"ID":"8620dc8b-c744-4501-b8a5-cc5980645a57","Type":"ContainerStarted","Data":"bffa9553ad66c81a33632421f67d717b1544c9aff3f3839cb5727c3a3a69b3ae"}
Jul 23 11:25:19.595702 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:19.595661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79546bd658-hwkpn" event={"ID":"8620dc8b-c744-4501-b8a5-cc5980645a57","Type":"ContainerStarted","Data":"94ac7e74b76c94a1857e49625916b8e965d1cbae23f360103e9c80e04693ffb5"}
Jul 23 11:25:19.622814 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:19.622735    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79546bd658-hwkpn" podStartSLOduration=2.158807685 podStartE2EDuration="2.622712861s" totalImagesPullingTime="463.905176ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:25:19.620959722 +0000 UTC m=+934.667056837" watchObservedRunningTime="2026-07-23 11:25:19.622712861 +0000 UTC m=+934.668809976"
Jul 23 11:25:19.653208 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:19.653174    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cc7c47bd7-js8nn"]
Jul 23 11:25:19.653588 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:19.653387    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-cc7c47bd7-js8nn" podUID="9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" containerName="authorino" containerID="cri-o://85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee" gracePeriod=30
Jul 23 11:25:19.912628 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:19.912588    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:25:20.004237 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.004200    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfqb7\" (UniqueName: \"kubernetes.io/projected/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-kube-api-access-vfqb7\") pod \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") "
Jul 23 11:25:20.004421 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.004289    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-tls-cert\") pod \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\" (UID: \"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d\") "
Jul 23 11:25:20.006497 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.006460    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-kube-api-access-vfqb7" (OuterVolumeSpecName: "kube-api-access-vfqb7") pod "9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" (UID: "9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d"). InnerVolumeSpecName "kube-api-access-vfqb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:25:20.016321 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.016285    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" (UID: "9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:25:20.105952 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.105915    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfqb7\" (UniqueName: \"kubernetes.io/projected/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-kube-api-access-vfqb7\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:25:20.105952 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.105945    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d-tls-cert\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:25:20.603479 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.603435    2573 generic.go:356] "Generic (PLEG): container finished" podID="9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" containerID="85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee" exitCode=0
Jul 23 11:25:20.603479 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.603471    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc7c47bd7-js8nn"
Jul 23 11:25:20.604007 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.603510    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc7c47bd7-js8nn" event={"ID":"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d","Type":"ContainerDied","Data":"85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee"}
Jul 23 11:25:20.604007 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.603553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc7c47bd7-js8nn" event={"ID":"9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d","Type":"ContainerDied","Data":"bad7b28b808cebb636da0267da8bb22c02bc2109071f511f40ec3a93cdf1bf3c"}
Jul 23 11:25:20.604007 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.603575    2573 scope.go:117] "RemoveContainer" containerID="85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee"
Jul 23 11:25:20.614402 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.614380    2573 scope.go:117] "RemoveContainer" containerID="85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee"
Jul 23 11:25:20.614725 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:25:20.614706    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee\": container with ID starting with 85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee not found: ID does not exist" containerID="85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee"
Jul 23 11:25:20.614846 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.614733    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee"} err="failed to get container status \"85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee\": rpc error: code = NotFound desc = could not find container \"85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee\": container with ID starting with 85a1c053b69ec9eed7e961e2a8d4a6aa65c8a0d31280df12f3df89a7db9808ee not found: ID does not exist"
Jul 23 11:25:20.627520 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.627490    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cc7c47bd7-js8nn"]
Jul 23 11:25:20.631135 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:20.631096    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cc7c47bd7-js8nn"]
Jul 23 11:25:21.446842 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:25:21.446798    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" path="/var/lib/kubelet/pods/9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d/volumes"
Jul 23 11:30:00.143995 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.143961    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66"]
Jul 23 11:30:00.144469 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.144357    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" containerName="authorino"
Jul 23 11:30:00.144469 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.144369    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" containerName="authorino"
Jul 23 11:30:00.144469 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.144432    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9430bcd4-ac34-4d1c-966a-de3b4e1d0c6d" containerName="authorino"
Jul 23 11:30:00.147558 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.147538    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66"
Jul 23 11:30:00.149571 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.149549    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:30:00.158313 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.158279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66"
Jul 23 11:30:00.161581 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.161555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66"]
Jul 23 11:30:00.299349 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:00.299317    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66"]
Jul 23 11:30:00.301180 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:30:00.301155    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb316b154_a039_410c_ac54_e91222ae9dfc.slice/crio-9cfefddeb8de7f0bcf53abf3fd6cfa91ab9c01fad41ae5c4463e47e349cd1b14 WatchSource:0}: Error finding container 9cfefddeb8de7f0bcf53abf3fd6cfa91ab9c01fad41ae5c4463e47e349cd1b14: Status 404 returned error can't find the container with id 9cfefddeb8de7f0bcf53abf3fd6cfa91ab9c01fad41ae5c4463e47e349cd1b14
Jul 23 11:30:01.166025 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:01.165982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66" event={"ID":"b316b154-a039-410c-ac54-e91222ae9dfc","Type":"ContainerStarted","Data":"9cfefddeb8de7f0bcf53abf3fd6cfa91ab9c01fad41ae5c4463e47e349cd1b14"}
Jul 23 11:30:04.185556 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:04.185461    2573 generic.go:356] "Generic (PLEG): container finished" podID="b316b154-a039-410c-ac54-e91222ae9dfc" containerID="6c95236ede621d052e95d9c4c06264a4fc71f7f0ee0df6567d87052b4f9ef384" exitCode=0
Jul 23 11:30:04.185936 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:04.185548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66" event={"ID":"b316b154-a039-410c-ac54-e91222ae9dfc","Type":"ContainerDied","Data":"6c95236ede621d052e95d9c4c06264a4fc71f7f0ee0df6567d87052b4f9ef384"}
Jul 23 11:30:05.329480 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:05.329448    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66"
Jul 23 11:30:06.198735 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:06.198705    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66"
Jul 23 11:30:06.198735 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:06.198717    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746770-cxs66" event={"ID":"b316b154-a039-410c-ac54-e91222ae9dfc","Type":"ContainerDied","Data":"9cfefddeb8de7f0bcf53abf3fd6cfa91ab9c01fad41ae5c4463e47e349cd1b14"}
Jul 23 11:30:06.198953 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:30:06.198780    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cfefddeb8de7f0bcf53abf3fd6cfa91ab9c01fad41ae5c4463e47e349cd1b14"
Jul 23 11:32:08.870549 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:08.870462    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"]
Jul 23 11:32:08.871099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:08.870670    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w" podUID="4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" containerName="manager" containerID="cri-o://738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373" gracePeriod=10
Jul 23 11:32:11.129414 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.129378    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:32:11.239692 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.239593    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckt2t\" (UniqueName: \"kubernetes.io/projected/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-kube-api-access-ckt2t\") pod \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") "
Jul 23 11:32:11.239692 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.239657    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-extensions-socket-volume\") pod \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\" (UID: \"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b\") "
Jul 23 11:32:11.240126 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.240097    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" (UID: "4b098030-10c8-4fe4-ac7d-9a8567c3ed2b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:32:11.241845 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.241817    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-kube-api-access-ckt2t" (OuterVolumeSpecName: "kube-api-access-ckt2t") pod "4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" (UID: "4b098030-10c8-4fe4-ac7d-9a8567c3ed2b"). InnerVolumeSpecName "kube-api-access-ckt2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:32:11.340790 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.340725    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckt2t\" (UniqueName: \"kubernetes.io/projected/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-kube-api-access-ckt2t\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:32:11.340790 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.340783    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b-extensions-socket-volume\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:32:11.928246 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.928212    2573 generic.go:356] "Generic (PLEG): container finished" podID="4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" containerID="738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373" exitCode=0
Jul 23 11:32:11.928404 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.928261    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"
Jul 23 11:32:11.928404 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.928309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w" event={"ID":"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b","Type":"ContainerDied","Data":"738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373"}
Jul 23 11:32:11.928404 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.928367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w" event={"ID":"4b098030-10c8-4fe4-ac7d-9a8567c3ed2b","Type":"ContainerDied","Data":"ac3f45998011a20f6e7123b38e22079db3cc934644ebb4675b6e82b88eeb8b10"}
Jul 23 11:32:11.928404 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.928396    2573 scope.go:117] "RemoveContainer" containerID="738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373"
Jul 23 11:32:11.938358 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.938337    2573 scope.go:117] "RemoveContainer" containerID="738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373"
Jul 23 11:32:11.938657 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:32:11.938640    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373\": container with ID starting with 738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373 not found: ID does not exist" containerID="738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373"
Jul 23 11:32:11.938720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.938663    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373"} err="failed to get container status \"738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373\": rpc error: code = NotFound desc = could not find container \"738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373\": container with ID starting with 738f4eabc5e922c38e404580c0d5536dfdb0402c1cda367303c591b29bd8a373 not found: ID does not exist"
Jul 23 11:32:11.946052 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.946021    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"]
Jul 23 11:32:11.948985 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:11.948958    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-45t2w"]
Jul 23 11:32:13.446010 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:32:13.445972    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" path="/var/lib/kubelet/pods/4b098030-10c8-4fe4-ac7d-9a8567c3ed2b/volumes"
Jul 23 11:33:09.970339 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.970296    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"]
Jul 23 11:33:09.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.970675    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" containerName="manager"
Jul 23 11:33:09.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.970686    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" containerName="manager"
Jul 23 11:33:09.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.970696    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b316b154-a039-410c-ac54-e91222ae9dfc" containerName="cleanup"
Jul 23 11:33:09.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.970702    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b316b154-a039-410c-ac54-e91222ae9dfc" containerName="cleanup"
Jul 23 11:33:09.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.970797    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b316b154-a039-410c-ac54-e91222ae9dfc" containerName="cleanup"
Jul 23 11:33:09.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.970807    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b098030-10c8-4fe4-ac7d-9a8567c3ed2b" containerName="manager"
Jul 23 11:33:09.975044 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.975024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:09.977082 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.977064    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5mjcr\""
Jul 23 11:33:09.985606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:09.985580    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"]
Jul 23 11:33:10.052463 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.052419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0914cb53-90f4-4667-a86f-86a4af6eded8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6c6kt\" (UID: \"0914cb53-90f4-4667-a86f-86a4af6eded8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:10.052632 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.052474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5mlj\" (UniqueName: \"kubernetes.io/projected/0914cb53-90f4-4667-a86f-86a4af6eded8-kube-api-access-h5mlj\") pod \"kuadrant-operator-controller-manager-86878c769f-6c6kt\" (UID: \"0914cb53-90f4-4667-a86f-86a4af6eded8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:10.153027 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.152983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0914cb53-90f4-4667-a86f-86a4af6eded8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6c6kt\" (UID: \"0914cb53-90f4-4667-a86f-86a4af6eded8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:10.153249 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.153047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5mlj\" (UniqueName: \"kubernetes.io/projected/0914cb53-90f4-4667-a86f-86a4af6eded8-kube-api-access-h5mlj\") pod \"kuadrant-operator-controller-manager-86878c769f-6c6kt\" (UID: \"0914cb53-90f4-4667-a86f-86a4af6eded8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:10.153458 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.153437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0914cb53-90f4-4667-a86f-86a4af6eded8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6c6kt\" (UID: \"0914cb53-90f4-4667-a86f-86a4af6eded8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:10.161701 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.161668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5mlj\" (UniqueName: \"kubernetes.io/projected/0914cb53-90f4-4667-a86f-86a4af6eded8-kube-api-access-h5mlj\") pod \"kuadrant-operator-controller-manager-86878c769f-6c6kt\" (UID: \"0914cb53-90f4-4667-a86f-86a4af6eded8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:10.285481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.285404    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:10.427926 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:10.427897    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"]
Jul 23 11:33:10.430181 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:33:10.430154    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0914cb53_90f4_4667_a86f_86a4af6eded8.slice/crio-92d69a6ad785e71a32cc830bea64493309f95d6d954cca1d36d71acc71869774 WatchSource:0}: Error finding container 92d69a6ad785e71a32cc830bea64493309f95d6d954cca1d36d71acc71869774: Status 404 returned error can't find the container with id 92d69a6ad785e71a32cc830bea64493309f95d6d954cca1d36d71acc71869774
Jul 23 11:33:11.266129 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:11.266097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt" event={"ID":"0914cb53-90f4-4667-a86f-86a4af6eded8","Type":"ContainerStarted","Data":"1bb757c17625ec81b0e0ca65fe3c2b6fdf54b92fcc51b6112e5895f869d27fbf"}
Jul 23 11:33:11.266551 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:11.266148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt" event={"ID":"0914cb53-90f4-4667-a86f-86a4af6eded8","Type":"ContainerStarted","Data":"92d69a6ad785e71a32cc830bea64493309f95d6d954cca1d36d71acc71869774"}
Jul 23 11:33:11.266551 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:11.266177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:33:11.286729 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:11.286682    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt" podStartSLOduration=2.286666724 podStartE2EDuration="2.286666724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:33:11.283869045 +0000 UTC m=+1406.329966160" watchObservedRunningTime="2026-07-23 11:33:11.286666724 +0000 UTC m=+1406.332763838"
Jul 23 11:33:22.274145 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:33:22.274112    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6c6kt"
Jul 23 11:36:11.094797 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.094761    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"]
Jul 23 11:36:11.098328 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.098309    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.100462 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.100440    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-544926b9-kserve-self-signed-certs\""
Jul 23 11:36:11.107191 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.107166    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"]
Jul 23 11:36:11.161657 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.161613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-home\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.161873 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.161686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-model-cache\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.161873 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.161718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tmp-dir\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.161873 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.161784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-dshm\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.162014 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.161886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c92x5\" (UniqueName: \"kubernetes.io/projected/d22d22ee-4ae0-4aca-b07b-9d823c465a32-kube-api-access-c92x5\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.162014 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.161948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tls-certs\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.262489 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.262449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c92x5\" (UniqueName: \"kubernetes.io/projected/d22d22ee-4ae0-4aca-b07b-9d823c465a32-kube-api-access-c92x5\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.262660 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.262509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tls-certs\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.262660 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.262551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-home\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.262660 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.262598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-model-cache\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.262660 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.262620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tmp-dir\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.262828 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.262658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-dshm\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.263047 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.263021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-home\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.263106 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.263089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-model-cache\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.263106 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.263097    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tmp-dir\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.264984 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.264964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-dshm\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.265130 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.265111    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tls-certs\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.272006 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.271987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c92x5\" (UniqueName: \"kubernetes.io/projected/d22d22ee-4ae0-4aca-b07b-9d823c465a32-kube-api-access-c92x5\") pod \"e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") " pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.407967 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.407877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:11.540521 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:11.540494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"]
Jul 23 11:36:11.542789 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:36:11.542755    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd22d22ee_4ae0_4aca_b07b_9d823c465a32.slice/crio-15a0fab29ac75e0e62c5352d68c4ff0fbbeed17ec084c0f67f8c285303ff6141 WatchSource:0}: Error finding container 15a0fab29ac75e0e62c5352d68c4ff0fbbeed17ec084c0f67f8c285303ff6141: Status 404 returned error can't find the container with id 15a0fab29ac75e0e62c5352d68c4ff0fbbeed17ec084c0f67f8c285303ff6141
Jul 23 11:36:12.300700 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:12.300654    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h" event={"ID":"d22d22ee-4ae0-4aca-b07b-9d823c465a32","Type":"ContainerStarted","Data":"600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8"}
Jul 23 11:36:12.300700 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:12.300702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h" event={"ID":"d22d22ee-4ae0-4aca-b07b-9d823c465a32","Type":"ContainerStarted","Data":"15a0fab29ac75e0e62c5352d68c4ff0fbbeed17ec084c0f67f8c285303ff6141"}
Jul 23 11:36:12.321819 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:12.321767    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h" podStartSLOduration=1.3217371070000001 podStartE2EDuration="1.321737107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:36:12.319054403 +0000 UTC m=+1587.365151516" watchObservedRunningTime="2026-07-23 11:36:12.321737107 +0000 UTC m=+1587.367834220"
Jul 23 11:36:21.409116 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:21.409066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:21.409578 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:21.409130    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:21.427462 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:21.427427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:22.368681 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:22.368651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:36:53.284294 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:36:53.284204    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"]
Jul 23 11:37:08.306242 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.306172    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h" podUID="d22d22ee-4ae0-4aca-b07b-9d823c465a32" containerName="main" containerID="cri-o://600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8" gracePeriod=45
Jul 23 11:37:08.557190 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.557165    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:37:08.582159 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582119    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tls-certs\") pod \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") "
Jul 23 11:37:08.582311 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582212    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tmp-dir\") pod \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") "
Jul 23 11:37:08.582311 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-dshm\") pod \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") "
Jul 23 11:37:08.582311 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582287    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-model-cache\") pod \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") "
Jul 23 11:37:08.582460 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582342    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c92x5\" (UniqueName: \"kubernetes.io/projected/d22d22ee-4ae0-4aca-b07b-9d823c465a32-kube-api-access-c92x5\") pod \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") "
Jul 23 11:37:08.582460 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-home\") pod \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\" (UID: \"d22d22ee-4ae0-4aca-b07b-9d823c465a32\") "
Jul 23 11:37:08.582803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582539    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d22d22ee-4ae0-4aca-b07b-9d823c465a32" (UID: "d22d22ee-4ae0-4aca-b07b-9d823c465a32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:08.582803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582571    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-model-cache" (OuterVolumeSpecName: "model-cache") pod "d22d22ee-4ae0-4aca-b07b-9d823c465a32" (UID: "d22d22ee-4ae0-4aca-b07b-9d823c465a32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:08.582803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582763    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:37:08.582803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582771    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-home" (OuterVolumeSpecName: "home") pod "d22d22ee-4ae0-4aca-b07b-9d823c465a32" (UID: "d22d22ee-4ae0-4aca-b07b-9d823c465a32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:08.582803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.582790    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:37:08.584559 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.584527    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-dshm" (OuterVolumeSpecName: "dshm") pod "d22d22ee-4ae0-4aca-b07b-9d823c465a32" (UID: "d22d22ee-4ae0-4aca-b07b-9d823c465a32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:08.584660 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.584591    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22d22ee-4ae0-4aca-b07b-9d823c465a32-kube-api-access-c92x5" (OuterVolumeSpecName: "kube-api-access-c92x5") pod "d22d22ee-4ae0-4aca-b07b-9d823c465a32" (UID: "d22d22ee-4ae0-4aca-b07b-9d823c465a32"). InnerVolumeSpecName "kube-api-access-c92x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:37:08.584660 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.584591    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d22d22ee-4ae0-4aca-b07b-9d823c465a32" (UID: "d22d22ee-4ae0-4aca-b07b-9d823c465a32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:37:08.618362 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.618326    2573 generic.go:356] "Generic (PLEG): container finished" podID="d22d22ee-4ae0-4aca-b07b-9d823c465a32" containerID="600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8" exitCode=0
Jul 23 11:37:08.618562 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.618377    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"
Jul 23 11:37:08.618562 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.618411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h" event={"ID":"d22d22ee-4ae0-4aca-b07b-9d823c465a32","Type":"ContainerDied","Data":"600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8"}
Jul 23 11:37:08.618562 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.618454    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h" event={"ID":"d22d22ee-4ae0-4aca-b07b-9d823c465a32","Type":"ContainerDied","Data":"15a0fab29ac75e0e62c5352d68c4ff0fbbeed17ec084c0f67f8c285303ff6141"}
Jul 23 11:37:08.618562 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.618470    2573 scope.go:117] "RemoveContainer" containerID="600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8"
Jul 23 11:37:08.631077 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.630892    2573 scope.go:117] "RemoveContainer" containerID="600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8"
Jul 23 11:37:08.631628 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:37:08.631603    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8\": container with ID starting with 600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8 not found: ID does not exist" containerID="600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8"
Jul 23 11:37:08.631721 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.631635    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8"} err="failed to get container status \"600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8\": rpc error: code = NotFound desc = could not find container \"600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8\": container with ID starting with 600e5b33af78c55c6906f266b27f0e9bcc2f1fde62d7b1cd620790ee682517c8 not found: ID does not exist"
Jul 23 11:37:08.641715 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.641682    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"]
Jul 23 11:37:08.645286 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.645257    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-544926b9-kserve-8496b569f-8mq7h"]
Jul 23 11:37:08.683635 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.683588    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22d22ee-4ae0-4aca-b07b-9d823c465a32-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:37:08.683635 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.683632    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:37:08.683635 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.683644    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c92x5\" (UniqueName: \"kubernetes.io/projected/d22d22ee-4ae0-4aca-b07b-9d823c465a32-kube-api-access-c92x5\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:37:08.683890 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:08.683653    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22d22ee-4ae0-4aca-b07b-9d823c465a32-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:37:09.446296 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:37:09.446260    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d22d22ee-4ae0-4aca-b07b-9d823c465a32" path="/var/lib/kubelet/pods/d22d22ee-4ae0-4aca-b07b-9d823c465a32/volumes"
Jul 23 11:43:20.329963 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.329929    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"]
Jul 23 11:43:20.330424 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.330278    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22d22ee-4ae0-4aca-b07b-9d823c465a32" containerName="main"
Jul 23 11:43:20.330424 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.330289    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22d22ee-4ae0-4aca-b07b-9d823c465a32" containerName="main"
Jul 23 11:43:20.330424 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.330360    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22d22ee-4ae0-4aca-b07b-9d823c465a32" containerName="main"
Jul 23 11:43:20.333368 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.333350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"
Jul 23 11:43:20.335672 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.335648    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 11:43:20.335815 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.335682    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:43:20.341600 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.341231    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"]
Jul 23 11:43:20.385841 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.385792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd4db05-c2fe-4492-a58f-3dd45f040daf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6\" (UID: \"0fd4db05-c2fe-4492-a58f-3dd45f040daf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"
Jul 23 11:43:20.487237 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.487184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd4db05-c2fe-4492-a58f-3dd45f040daf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6\" (UID: \"0fd4db05-c2fe-4492-a58f-3dd45f040daf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"
Jul 23 11:43:20.487902 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.487878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd4db05-c2fe-4492-a58f-3dd45f040daf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6\" (UID: \"0fd4db05-c2fe-4492-a58f-3dd45f040daf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"
Jul 23 11:43:20.646220 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.646126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"
Jul 23 11:43:20.785837 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:20.785799    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"]
Jul 23 11:43:20.788927 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:43:20.788893    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd4db05_c2fe_4492_a58f_3dd45f040daf.slice/crio-c65f2183ecf3203ea47e3b0669cd46bad749d5452c2af6cfb0549d9455d5523e WatchSource:0}: Error finding container c65f2183ecf3203ea47e3b0669cd46bad749d5452c2af6cfb0549d9455d5523e: Status 404 returned error can't find the container with id c65f2183ecf3203ea47e3b0669cd46bad749d5452c2af6cfb0549d9455d5523e
Jul 23 11:43:21.714898 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:21.714803    2573 generic.go:356] "Generic (PLEG): container finished" podID="0fd4db05-c2fe-4492-a58f-3dd45f040daf" containerID="a66abf5d188086620741a8b50fa0fc314091b4b84f4608f86dbb8bc09ca31196" exitCode=0
Jul 23 11:43:21.715277 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:21.714888    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6" event={"ID":"0fd4db05-c2fe-4492-a58f-3dd45f040daf","Type":"ContainerDied","Data":"a66abf5d188086620741a8b50fa0fc314091b4b84f4608f86dbb8bc09ca31196"}
Jul 23 11:43:21.715277 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:21.714943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6" event={"ID":"0fd4db05-c2fe-4492-a58f-3dd45f040daf","Type":"ContainerStarted","Data":"c65f2183ecf3203ea47e3b0669cd46bad749d5452c2af6cfb0549d9455d5523e"}
Jul 23 11:43:22.854519 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:22.854492    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"
Jul 23 11:43:22.904405 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:22.904368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd4db05-c2fe-4492-a58f-3dd45f040daf-maas-api-service-ca\") pod \"0fd4db05-c2fe-4492-a58f-3dd45f040daf\" (UID: \"0fd4db05-c2fe-4492-a58f-3dd45f040daf\") "
Jul 23 11:43:22.904726 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:22.904703    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fd4db05-c2fe-4492-a58f-3dd45f040daf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0fd4db05-c2fe-4492-a58f-3dd45f040daf" (UID: "0fd4db05-c2fe-4492-a58f-3dd45f040daf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:43:23.005777 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:23.005663    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fd4db05-c2fe-4492-a58f-3dd45f040daf-maas-api-service-ca\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:43:23.728083 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:23.728004    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"
Jul 23 11:43:23.728083 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:23.728022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6" event={"ID":"0fd4db05-c2fe-4492-a58f-3dd45f040daf","Type":"ContainerDied","Data":"c65f2183ecf3203ea47e3b0669cd46bad749d5452c2af6cfb0549d9455d5523e"}
Jul 23 11:43:23.728083 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:23.728072    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c65f2183ecf3203ea47e3b0669cd46bad749d5452c2af6cfb0549d9455d5523e"
Jul 23 11:43:35.405568 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:35.405516    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"]
Jul 23 11:43:35.407627 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:35.407600    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f70c9fb7-6msm6"]
Jul 23 11:43:35.448148 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:43:35.448111    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd4db05-c2fe-4492-a58f-3dd45f040daf" path="/var/lib/kubelet/pods/0fd4db05-c2fe-4492-a58f-3dd45f040daf/volumes"
Jul 23 11:46:23.017722 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.017681    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"]
Jul 23 11:46:23.018145 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.018059    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd4db05-c2fe-4492-a58f-3dd45f040daf" containerName="revoke-keys"
Jul 23 11:46:23.018145 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.018075    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd4db05-c2fe-4492-a58f-3dd45f040daf" containerName="revoke-keys"
Jul 23 11:46:23.018233 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.018217    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd4db05-c2fe-4492-a58f-3dd45f040daf" containerName="revoke-keys"
Jul 23 11:46:23.027683 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.027652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.032202 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.032169    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d0774c5e\"/\"kube-root-ca.crt\""
Jul 23 11:46:23.033151 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.032767    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d0774c5e\"/\"openshift-service-ca.crt\""
Jul 23 11:46:23.033151 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.032992    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d0774c5e\"/\"default-dockercfg-z8xww\""
Jul 23 11:46:23.034724 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.034701    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d0774c5e\"/\"e2e-lifecycle-model-d0774c5e-kserve-self-signed-certs\""
Jul 23 11:46:23.036605 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.036582    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"]
Jul 23 11:46:23.131244 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.131201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-home\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.131439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.131264    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-dshm\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.131439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.131326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-model-cache\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.131439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.131353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-tmp-dir\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.131439 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.131410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb73313-3944-4f24-9710-cf8d6262e52b-tls-certs\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.131597 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.131447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlhlj\" (UniqueName: \"kubernetes.io/projected/2bb73313-3944-4f24-9710-cf8d6262e52b-kube-api-access-mlhlj\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.232762 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.232696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-home\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.232959 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.232779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-dshm\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.232959 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.232824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-model-cache\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.232959 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.232844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-tmp-dir\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.232959 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.232871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb73313-3944-4f24-9710-cf8d6262e52b-tls-certs\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.232959 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.232896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlhlj\" (UniqueName: \"kubernetes.io/projected/2bb73313-3944-4f24-9710-cf8d6262e52b-kube-api-access-mlhlj\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.233218 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.233167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-home\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.233279 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.233214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-model-cache\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.233279 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.233260    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-tmp-dir\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.235099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.235074    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-dshm\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.235326 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.235309    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb73313-3944-4f24-9710-cf8d6262e52b-tls-certs\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.258085 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.258055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlhlj\" (UniqueName: \"kubernetes.io/projected/2bb73313-3944-4f24-9710-cf8d6262e52b-kube-api-access-mlhlj\") pod \"e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") " pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.338720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.338682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:23.482518 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.482491    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"]
Jul 23 11:46:23.484515 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:46:23.484491    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bb73313_3944_4f24_9710_cf8d6262e52b.slice/crio-c44577ca617b07469c8247f5f2adb13b934260e54fa4674ff3ebd5d61f0e76da WatchSource:0}: Error finding container c44577ca617b07469c8247f5f2adb13b934260e54fa4674ff3ebd5d61f0e76da: Status 404 returned error can't find the container with id c44577ca617b07469c8247f5f2adb13b934260e54fa4674ff3ebd5d61f0e76da
Jul 23 11:46:23.736053 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.735964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz" event={"ID":"2bb73313-3944-4f24-9710-cf8d6262e52b","Type":"ContainerStarted","Data":"0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233"}
Jul 23 11:46:23.736053 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.736007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz" event={"ID":"2bb73313-3944-4f24-9710-cf8d6262e52b","Type":"ContainerStarted","Data":"c44577ca617b07469c8247f5f2adb13b934260e54fa4674ff3ebd5d61f0e76da"}
Jul 23 11:46:23.759400 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:23.759336    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz" podStartSLOduration=1.75931844 podStartE2EDuration="1.75931844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:46:23.756531413 +0000 UTC m=+2198.802628549" watchObservedRunningTime="2026-07-23 11:46:23.75931844 +0000 UTC m=+2198.805415555"
Jul 23 11:46:33.339385 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:33.339337    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:33.339872 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:33.339423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:33.351889 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:33.351862    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:46:33.807448 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:46:33.807424    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:47:22.665485 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:22.665444    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"]
Jul 23 11:47:37.685981 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:37.685900    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz" podUID="2bb73313-3944-4f24-9710-cf8d6262e52b" containerName="main" containerID="cri-o://0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233" gracePeriod=45
Jul 23 11:47:37.941759 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:37.941678    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:47:38.008890 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.008857    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-dshm\") pod \"2bb73313-3944-4f24-9710-cf8d6262e52b\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") "
Jul 23 11:47:38.009062 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.008915    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-tmp-dir\") pod \"2bb73313-3944-4f24-9710-cf8d6262e52b\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") "
Jul 23 11:47:38.009062 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.008951    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-home\") pod \"2bb73313-3944-4f24-9710-cf8d6262e52b\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") "
Jul 23 11:47:38.009062 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.008975    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb73313-3944-4f24-9710-cf8d6262e52b-tls-certs\") pod \"2bb73313-3944-4f24-9710-cf8d6262e52b\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") "
Jul 23 11:47:38.009062 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.008999    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlhlj\" (UniqueName: \"kubernetes.io/projected/2bb73313-3944-4f24-9710-cf8d6262e52b-kube-api-access-mlhlj\") pod \"2bb73313-3944-4f24-9710-cf8d6262e52b\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") "
Jul 23 11:47:38.009290 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.009073    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-model-cache\") pod \"2bb73313-3944-4f24-9710-cf8d6262e52b\" (UID: \"2bb73313-3944-4f24-9710-cf8d6262e52b\") "
Jul 23 11:47:38.009290 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.009237    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2bb73313-3944-4f24-9710-cf8d6262e52b" (UID: "2bb73313-3944-4f24-9710-cf8d6262e52b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:47:38.009290 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.009267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-home" (OuterVolumeSpecName: "home") pod "2bb73313-3944-4f24-9710-cf8d6262e52b" (UID: "2bb73313-3944-4f24-9710-cf8d6262e52b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:47:38.009463 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.009446    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:47:38.009516 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.009469    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:47:38.009516 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.009447    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-model-cache" (OuterVolumeSpecName: "model-cache") pod "2bb73313-3944-4f24-9710-cf8d6262e52b" (UID: "2bb73313-3944-4f24-9710-cf8d6262e52b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:47:38.011128 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.011109    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-dshm" (OuterVolumeSpecName: "dshm") pod "2bb73313-3944-4f24-9710-cf8d6262e52b" (UID: "2bb73313-3944-4f24-9710-cf8d6262e52b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:47:38.011200 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.011156    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb73313-3944-4f24-9710-cf8d6262e52b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2bb73313-3944-4f24-9710-cf8d6262e52b" (UID: "2bb73313-3944-4f24-9710-cf8d6262e52b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:47:38.011240 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.011185    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bb73313-3944-4f24-9710-cf8d6262e52b-kube-api-access-mlhlj" (OuterVolumeSpecName: "kube-api-access-mlhlj") pod "2bb73313-3944-4f24-9710-cf8d6262e52b" (UID: "2bb73313-3944-4f24-9710-cf8d6262e52b"). InnerVolumeSpecName "kube-api-access-mlhlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:47:38.110638 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.110598    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb73313-3944-4f24-9710-cf8d6262e52b-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:47:38.110638 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.110631    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlhlj\" (UniqueName: \"kubernetes.io/projected/2bb73313-3944-4f24-9710-cf8d6262e52b-kube-api-access-mlhlj\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:47:38.110638 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.110641    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:47:38.110902 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.110650    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bb73313-3944-4f24-9710-cf8d6262e52b-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:47:38.151750 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.151704    2573 generic.go:356] "Generic (PLEG): container finished" podID="2bb73313-3944-4f24-9710-cf8d6262e52b" containerID="0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233" exitCode=0
Jul 23 11:47:38.151938 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.151765    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"
Jul 23 11:47:38.151938 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.151800    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz" event={"ID":"2bb73313-3944-4f24-9710-cf8d6262e52b","Type":"ContainerDied","Data":"0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233"}
Jul 23 11:47:38.151938 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.151853    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz" event={"ID":"2bb73313-3944-4f24-9710-cf8d6262e52b","Type":"ContainerDied","Data":"c44577ca617b07469c8247f5f2adb13b934260e54fa4674ff3ebd5d61f0e76da"}
Jul 23 11:47:38.151938 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.151877    2573 scope.go:117] "RemoveContainer" containerID="0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233"
Jul 23 11:47:38.161235 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.161219    2573 scope.go:117] "RemoveContainer" containerID="0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233"
Jul 23 11:47:38.161498 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:47:38.161473    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233\": container with ID starting with 0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233 not found: ID does not exist" containerID="0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233"
Jul 23 11:47:38.161600 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.161503    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233"} err="failed to get container status \"0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233\": rpc error: code = NotFound desc = could not find container \"0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233\": container with ID starting with 0d58789bce4bcf96eeca7a9cc612338d36bf0744c1df2bf56e8bb89f64ea7233 not found: ID does not exist"
Jul 23 11:47:38.172568 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.172543    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"]
Jul 23 11:47:38.178383 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:38.178361    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d0774c5e/e2e-lifecycle-model-d0774c5e-kserve-7f9dd6f9ff-w6pfz"]
Jul 23 11:47:39.447530 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:47:39.447494    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bb73313-3944-4f24-9710-cf8d6262e52b" path="/var/lib/kubelet/pods/2bb73313-3944-4f24-9710-cf8d6262e52b/volumes"
Jul 23 11:49:34.803672 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.803635    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"]
Jul 23 11:49:34.804231 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.804209    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb73313-3944-4f24-9710-cf8d6262e52b" containerName="main"
Jul 23 11:49:34.804305 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.804235    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb73313-3944-4f24-9710-cf8d6262e52b" containerName="main"
Jul 23 11:49:34.804381 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.804369    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bb73313-3944-4f24-9710-cf8d6262e52b" containerName="main"
Jul 23 11:49:34.807436 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.807416    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:34.810148 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.810120    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9c6be2\"/\"openshift-service-ca.crt\""
Jul 23 11:49:34.810275 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.810185    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9c6be2\"/\"default-dockercfg-jm7k4\""
Jul 23 11:49:34.810275 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.810126    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9c6be2\"/\"test-model-9c6be2-kserve-self-signed-certs\""
Jul 23 11:49:34.810275 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.810201    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9c6be2\"/\"kube-root-ca.crt\""
Jul 23 11:49:34.815701 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.815677    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"]
Jul 23 11:49:34.970552 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.970515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-tmp-dir\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:34.970552 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.970555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b586a3c2-fde6-4475-9714-cc3aea447fe2-tls-certs\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:34.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.970577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-home\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:34.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.970602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-dshm\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:34.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.970639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkfvh\" (UniqueName: \"kubernetes.io/projected/b586a3c2-fde6-4475-9714-cc3aea447fe2-kube-api-access-dkfvh\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:34.970816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:34.970693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-model-cache\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.071587 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.071553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-model-cache\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.071798 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.071609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-tmp-dir\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.071798 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.071632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b586a3c2-fde6-4475-9714-cc3aea447fe2-tls-certs\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.071798 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.071649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-home\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.071798 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.071667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-dshm\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.071798 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.071690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkfvh\" (UniqueName: \"kubernetes.io/projected/b586a3c2-fde6-4475-9714-cc3aea447fe2-kube-api-access-dkfvh\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.072079 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.072036    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-model-cache\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.072079 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.072049    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-tmp-dir\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.072180 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.072107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-home\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.073955 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.073930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-dshm\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.074242 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.074227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b586a3c2-fde6-4475-9714-cc3aea447fe2-tls-certs\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.081406 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.081383    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkfvh\" (UniqueName: \"kubernetes.io/projected/b586a3c2-fde6-4475-9714-cc3aea447fe2-kube-api-access-dkfvh\") pod \"test-model-9c6be2-kserve-667574bc4c-c7lzq\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") " pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.117991 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.117951    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:35.258237 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.258184    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"]
Jul 23 11:49:35.259856 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:49:35.259826    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb586a3c2_fde6_4475_9714_cc3aea447fe2.slice/crio-df547679fda9f3f6cfbe0d134e321acfc8397fded30a414ac890e35e19085c8f WatchSource:0}: Error finding container df547679fda9f3f6cfbe0d134e321acfc8397fded30a414ac890e35e19085c8f: Status 404 returned error can't find the container with id df547679fda9f3f6cfbe0d134e321acfc8397fded30a414ac890e35e19085c8f
Jul 23 11:49:35.804367 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.804329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq" event={"ID":"b586a3c2-fde6-4475-9714-cc3aea447fe2","Type":"ContainerStarted","Data":"79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7"}
Jul 23 11:49:35.804367 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.804377    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq" event={"ID":"b586a3c2-fde6-4475-9714-cc3aea447fe2","Type":"ContainerStarted","Data":"df547679fda9f3f6cfbe0d134e321acfc8397fded30a414ac890e35e19085c8f"}
Jul 23 11:49:35.822362 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:35.822308    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq" podStartSLOduration=1.822291492 podStartE2EDuration="1.822291492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:49:35.820992167 +0000 UTC m=+2390.867089286" watchObservedRunningTime="2026-07-23 11:49:35.822291492 +0000 UTC m=+2390.868388614"
Jul 23 11:49:45.118493 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:45.118438    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:45.118493 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:45.118500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:45.131395 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:45.131361    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:49:45.672302 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:45.672269    2573 scope.go:117] "RemoveContainer" containerID="a66abf5d188086620741a8b50fa0fc314091b4b84f4608f86dbb8bc09ca31196"
Jul 23 11:49:45.875494 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:49:45.875463    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:50:19.097679 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.097637    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"]
Jul 23 11:50:19.101384 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.101359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.103468 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.103447    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4c7f56\"/\"openshift-service-ca.crt\""
Jul 23 11:50:19.103579 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.103465    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4c7f56\"/\"kube-root-ca.crt\""
Jul 23 11:50:19.103982 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.103965    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4c7f56\"/\"default-dockercfg-bs4lc\""
Jul 23 11:50:19.104081 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.104015    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4c7f56\"/\"test-model-4c7f56-kserve-self-signed-certs\""
Jul 23 11:50:19.110566 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.110545    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"]
Jul 23 11:50:19.288802 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.288760    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-home\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.288802 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.288805    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-model-cache\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.289010 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.288825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tmp-dir\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.289010 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.288888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l55gd\" (UniqueName: \"kubernetes.io/projected/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-kube-api-access-l55gd\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.289010 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.288925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tls-certs\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.289010 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.288990    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-dshm\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.389708 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.389611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l55gd\" (UniqueName: \"kubernetes.io/projected/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-kube-api-access-l55gd\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.389708 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.389659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tls-certs\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.389951 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.389734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-dshm\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.389951 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.389823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-home\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.389951 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.389846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-model-cache\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.389951 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.389867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tmp-dir\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.390317 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.390292    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tmp-dir\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.390407 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.390349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-home\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.390407 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.390376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-model-cache\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.392054 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.392034    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-dshm\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.392238 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.392223    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tls-certs\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.398018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.397995    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l55gd\" (UniqueName: \"kubernetes.io/projected/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-kube-api-access-l55gd\") pod \"test-model-4c7f56-kserve-84cdd79c75-hhhp7\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") " pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.411863 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.411843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:19.552682 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:19.552648    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"]
Jul 23 11:50:19.553678 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:50:19.553654    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2838ce3_7d6b_483c_82aa_d0b6d4035e16.slice/crio-e4b12ace08b3195edd48baa023b3d972859bfc04c2b9582d01914e0e906630df WatchSource:0}: Error finding container e4b12ace08b3195edd48baa023b3d972859bfc04c2b9582d01914e0e906630df: Status 404 returned error can't find the container with id e4b12ace08b3195edd48baa023b3d972859bfc04c2b9582d01914e0e906630df
Jul 23 11:50:20.049104 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:20.049065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7" event={"ID":"c2838ce3-7d6b-483c-82aa-d0b6d4035e16","Type":"ContainerStarted","Data":"aee3e4fdb7f1adb3d93cb85cec7300b5e274c872bad02c18ccde3e4c5a928016"}
Jul 23 11:50:20.049282 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:20.049123    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7" event={"ID":"c2838ce3-7d6b-483c-82aa-d0b6d4035e16","Type":"ContainerStarted","Data":"e4b12ace08b3195edd48baa023b3d972859bfc04c2b9582d01914e0e906630df"}
Jul 23 11:50:20.065785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:20.065723    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7" podStartSLOduration=1.06570805 podStartE2EDuration="1.06570805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:50:20.06498319 +0000 UTC m=+2435.111080305" watchObservedRunningTime="2026-07-23 11:50:20.06570805 +0000 UTC m=+2435.111805163"
Jul 23 11:50:29.412303 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:29.412263    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:29.412702 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:29.412320    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:29.425507 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:29.425479    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:50:30.116326 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:50:30.116293    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:51:12.392085 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:12.392046    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"]
Jul 23 11:51:13.258321 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:13.258281    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"]
Jul 23 11:51:27.412793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.412732    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq" podUID="b586a3c2-fde6-4475-9714-cc3aea447fe2" containerName="main" containerID="cri-o://79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7" gracePeriod=45
Jul 23 11:51:27.660216 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.660181    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:51:27.717852 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.717727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-home\") pod \"b586a3c2-fde6-4475-9714-cc3aea447fe2\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") "
Jul 23 11:51:27.717852 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.717840    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkfvh\" (UniqueName: \"kubernetes.io/projected/b586a3c2-fde6-4475-9714-cc3aea447fe2-kube-api-access-dkfvh\") pod \"b586a3c2-fde6-4475-9714-cc3aea447fe2\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") "
Jul 23 11:51:27.718070 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.717886    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-model-cache\") pod \"b586a3c2-fde6-4475-9714-cc3aea447fe2\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") "
Jul 23 11:51:27.718070 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.717929    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-tmp-dir\") pod \"b586a3c2-fde6-4475-9714-cc3aea447fe2\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") "
Jul 23 11:51:27.718070 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.717966    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b586a3c2-fde6-4475-9714-cc3aea447fe2-tls-certs\") pod \"b586a3c2-fde6-4475-9714-cc3aea447fe2\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") "
Jul 23 11:51:27.718070 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.717998    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-dshm\") pod \"b586a3c2-fde6-4475-9714-cc3aea447fe2\" (UID: \"b586a3c2-fde6-4475-9714-cc3aea447fe2\") "
Jul 23 11:51:27.718070 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.718051    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-home" (OuterVolumeSpecName: "home") pod "b586a3c2-fde6-4475-9714-cc3aea447fe2" (UID: "b586a3c2-fde6-4475-9714-cc3aea447fe2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:27.718327 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.718225    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b586a3c2-fde6-4475-9714-cc3aea447fe2" (UID: "b586a3c2-fde6-4475-9714-cc3aea447fe2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:27.718327 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.718240    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-model-cache" (OuterVolumeSpecName: "model-cache") pod "b586a3c2-fde6-4475-9714-cc3aea447fe2" (UID: "b586a3c2-fde6-4475-9714-cc3aea447fe2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:27.718428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.718353    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:27.718428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.718372    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:27.718428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.718387    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:27.720186 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.720162    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b586a3c2-fde6-4475-9714-cc3aea447fe2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b586a3c2-fde6-4475-9714-cc3aea447fe2" (UID: "b586a3c2-fde6-4475-9714-cc3aea447fe2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:51:27.720302 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.720190    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-dshm" (OuterVolumeSpecName: "dshm") pod "b586a3c2-fde6-4475-9714-cc3aea447fe2" (UID: "b586a3c2-fde6-4475-9714-cc3aea447fe2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:27.720302 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.720208    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b586a3c2-fde6-4475-9714-cc3aea447fe2-kube-api-access-dkfvh" (OuterVolumeSpecName: "kube-api-access-dkfvh") pod "b586a3c2-fde6-4475-9714-cc3aea447fe2" (UID: "b586a3c2-fde6-4475-9714-cc3aea447fe2"). InnerVolumeSpecName "kube-api-access-dkfvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:51:27.819008 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.818968    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b586a3c2-fde6-4475-9714-cc3aea447fe2-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:27.819008 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.819001    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b586a3c2-fde6-4475-9714-cc3aea447fe2-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:27.819008 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:27.819014    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkfvh\" (UniqueName: \"kubernetes.io/projected/b586a3c2-fde6-4475-9714-cc3aea447fe2-kube-api-access-dkfvh\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:28.281723 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.281658    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7" podUID="c2838ce3-7d6b-483c-82aa-d0b6d4035e16" containerName="main" containerID="cri-o://aee3e4fdb7f1adb3d93cb85cec7300b5e274c872bad02c18ccde3e4c5a928016" gracePeriod=45
Jul 23 11:51:28.440762 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.440712    2573 generic.go:356] "Generic (PLEG): container finished" podID="b586a3c2-fde6-4475-9714-cc3aea447fe2" containerID="79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7" exitCode=0
Jul 23 11:51:28.441216 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.440784    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"
Jul 23 11:51:28.441216 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.440785    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq" event={"ID":"b586a3c2-fde6-4475-9714-cc3aea447fe2","Type":"ContainerDied","Data":"79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7"}
Jul 23 11:51:28.441216 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.440891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq" event={"ID":"b586a3c2-fde6-4475-9714-cc3aea447fe2","Type":"ContainerDied","Data":"df547679fda9f3f6cfbe0d134e321acfc8397fded30a414ac890e35e19085c8f"}
Jul 23 11:51:28.441216 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.440920    2573 scope.go:117] "RemoveContainer" containerID="79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7"
Jul 23 11:51:28.443184 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.443154    2573 generic.go:356] "Generic (PLEG): container finished" podID="c2838ce3-7d6b-483c-82aa-d0b6d4035e16" containerID="aee3e4fdb7f1adb3d93cb85cec7300b5e274c872bad02c18ccde3e4c5a928016" exitCode=0
Jul 23 11:51:28.443292 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.443233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7" event={"ID":"c2838ce3-7d6b-483c-82aa-d0b6d4035e16","Type":"ContainerDied","Data":"aee3e4fdb7f1adb3d93cb85cec7300b5e274c872bad02c18ccde3e4c5a928016"}
Jul 23 11:51:28.452568 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.452544    2573 scope.go:117] "RemoveContainer" containerID="79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7"
Jul 23 11:51:28.452848 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:51:28.452828    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7\": container with ID starting with 79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7 not found: ID does not exist" containerID="79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7"
Jul 23 11:51:28.452910 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.452857    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7"} err="failed to get container status \"79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7\": rpc error: code = NotFound desc = could not find container \"79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7\": container with ID starting with 79a0ca6dc378471d3b7ae5d90e39eb51bee4221496d432b148c7287b47a6f8a7 not found: ID does not exist"
Jul 23 11:51:28.465941 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.465907    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"]
Jul 23 11:51:28.469890 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.469866    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9c6be2/test-model-9c6be2-kserve-667574bc4c-c7lzq"]
Jul 23 11:51:28.545776 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.545709    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:51:28.626513 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626479    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-dshm\") pod \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") "
Jul 23 11:51:28.626701 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626523    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-home\") pod \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") "
Jul 23 11:51:28.626701 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626545    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l55gd\" (UniqueName: \"kubernetes.io/projected/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-kube-api-access-l55gd\") pod \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") "
Jul 23 11:51:28.626701 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626604    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-model-cache\") pod \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") "
Jul 23 11:51:28.626701 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626635    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tmp-dir\") pod \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") "
Jul 23 11:51:28.626701 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626688    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tls-certs\") pod \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\" (UID: \"c2838ce3-7d6b-483c-82aa-d0b6d4035e16\") "
Jul 23 11:51:28.627032 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626853    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-home" (OuterVolumeSpecName: "home") pod "c2838ce3-7d6b-483c-82aa-d0b6d4035e16" (UID: "c2838ce3-7d6b-483c-82aa-d0b6d4035e16"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:28.627032 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626893    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-model-cache" (OuterVolumeSpecName: "model-cache") pod "c2838ce3-7d6b-483c-82aa-d0b6d4035e16" (UID: "c2838ce3-7d6b-483c-82aa-d0b6d4035e16"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:28.627032 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.626983    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c2838ce3-7d6b-483c-82aa-d0b6d4035e16" (UID: "c2838ce3-7d6b-483c-82aa-d0b6d4035e16"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:28.627032 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.627002    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:28.627032 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.627020    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:28.628806 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.628783    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-dshm" (OuterVolumeSpecName: "dshm") pod "c2838ce3-7d6b-483c-82aa-d0b6d4035e16" (UID: "c2838ce3-7d6b-483c-82aa-d0b6d4035e16"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:51:28.628929 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.628839    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c2838ce3-7d6b-483c-82aa-d0b6d4035e16" (UID: "c2838ce3-7d6b-483c-82aa-d0b6d4035e16"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:51:28.628998 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.628932    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-kube-api-access-l55gd" (OuterVolumeSpecName: "kube-api-access-l55gd") pod "c2838ce3-7d6b-483c-82aa-d0b6d4035e16" (UID: "c2838ce3-7d6b-483c-82aa-d0b6d4035e16"). InnerVolumeSpecName "kube-api-access-l55gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:51:28.727808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.727737    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:28.727808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.727800    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:28.727808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.727812    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l55gd\" (UniqueName: \"kubernetes.io/projected/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-kube-api-access-l55gd\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:28.728109 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:28.727824    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2838ce3-7d6b-483c-82aa-d0b6d4035e16-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:51:29.447477 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:29.447439    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b586a3c2-fde6-4475-9714-cc3aea447fe2" path="/var/lib/kubelet/pods/b586a3c2-fde6-4475-9714-cc3aea447fe2/volumes"
Jul 23 11:51:29.450867 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:29.450844    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"
Jul 23 11:51:29.450867 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:29.450859    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7" event={"ID":"c2838ce3-7d6b-483c-82aa-d0b6d4035e16","Type":"ContainerDied","Data":"e4b12ace08b3195edd48baa023b3d972859bfc04c2b9582d01914e0e906630df"}
Jul 23 11:51:29.451072 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:29.450902    2573 scope.go:117] "RemoveContainer" containerID="aee3e4fdb7f1adb3d93cb85cec7300b5e274c872bad02c18ccde3e4c5a928016"
Jul 23 11:51:29.472601 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:29.472576    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"]
Jul 23 11:51:29.476394 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:29.476372    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4c7f56/test-model-4c7f56-kserve-84cdd79c75-hhhp7"]
Jul 23 11:51:31.446912 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:51:31.446876    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2838ce3-7d6b-483c-82aa-d0b6d4035e16" path="/var/lib/kubelet/pods/c2838ce3-7d6b-483c-82aa-d0b6d4035e16/volumes"
Jul 23 11:52:21.129971 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.129934    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"]
Jul 23 11:52:21.131947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.130293    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b586a3c2-fde6-4475-9714-cc3aea447fe2" containerName="main"
Jul 23 11:52:21.131947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.130304    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b586a3c2-fde6-4475-9714-cc3aea447fe2" containerName="main"
Jul 23 11:52:21.131947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.130325    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2838ce3-7d6b-483c-82aa-d0b6d4035e16" containerName="main"
Jul 23 11:52:21.131947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.130330    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2838ce3-7d6b-483c-82aa-d0b6d4035e16" containerName="main"
Jul 23 11:52:21.131947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.130392    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b586a3c2-fde6-4475-9714-cc3aea447fe2" containerName="main"
Jul 23 11:52:21.131947 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.130405    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2838ce3-7d6b-483c-82aa-d0b6d4035e16" containerName="main"
Jul 23 11:52:21.133295 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.133279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"
Jul 23 11:52:21.135429 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.135397    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 11:52:21.135429 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.135416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:52:21.140924 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.140893    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"]
Jul 23 11:52:21.207542 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.207501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c51eda-e686-43f6-9f04-f38cc61ea8e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk\" (UID: \"d1c51eda-e686-43f6-9f04-f38cc61ea8e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"
Jul 23 11:52:21.308136 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.308086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c51eda-e686-43f6-9f04-f38cc61ea8e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk\" (UID: \"d1c51eda-e686-43f6-9f04-f38cc61ea8e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"
Jul 23 11:52:21.308726 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.308705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c51eda-e686-43f6-9f04-f38cc61ea8e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk\" (UID: \"d1c51eda-e686-43f6-9f04-f38cc61ea8e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"
Jul 23 11:52:21.445801 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.445700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"
Jul 23 11:52:21.581249 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.581216    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"]
Jul 23 11:52:21.584588 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:52:21.584561    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c51eda_e686_43f6_9f04_f38cc61ea8e9.slice/crio-fe27559d910977619350289c73cc5e123bb1187d7ac81f4a678a032a21a5b69b WatchSource:0}: Error finding container fe27559d910977619350289c73cc5e123bb1187d7ac81f4a678a032a21a5b69b: Status 404 returned error can't find the container with id fe27559d910977619350289c73cc5e123bb1187d7ac81f4a678a032a21a5b69b
Jul 23 11:52:21.739088 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:21.738977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk" event={"ID":"d1c51eda-e686-43f6-9f04-f38cc61ea8e9","Type":"ContainerStarted","Data":"fe27559d910977619350289c73cc5e123bb1187d7ac81f4a678a032a21a5b69b"}
Jul 23 11:52:22.746043 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:22.745955    2573 generic.go:356] "Generic (PLEG): container finished" podID="d1c51eda-e686-43f6-9f04-f38cc61ea8e9" containerID="eef818912b55b141d136dd31bc62523e8161816d0d4dc5cef34f8dc15ec696c8" exitCode=0
Jul 23 11:52:22.746389 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:22.746045    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk" event={"ID":"d1c51eda-e686-43f6-9f04-f38cc61ea8e9","Type":"ContainerDied","Data":"eef818912b55b141d136dd31bc62523e8161816d0d4dc5cef34f8dc15ec696c8"}
Jul 23 11:52:23.886070 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:23.886045    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"
Jul 23 11:52:24.034261 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:24.034170    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c51eda-e686-43f6-9f04-f38cc61ea8e9-maas-api-service-ca\") pod \"d1c51eda-e686-43f6-9f04-f38cc61ea8e9\" (UID: \"d1c51eda-e686-43f6-9f04-f38cc61ea8e9\") "
Jul 23 11:52:24.034544 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:24.034520    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c51eda-e686-43f6-9f04-f38cc61ea8e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1c51eda-e686-43f6-9f04-f38cc61ea8e9" (UID: "d1c51eda-e686-43f6-9f04-f38cc61ea8e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:52:24.135381 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:24.135330    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c51eda-e686-43f6-9f04-f38cc61ea8e9-maas-api-service-ca\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:52:24.758838 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:24.758808    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"
Jul 23 11:52:24.758838 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:24.758822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk" event={"ID":"d1c51eda-e686-43f6-9f04-f38cc61ea8e9","Type":"ContainerDied","Data":"fe27559d910977619350289c73cc5e123bb1187d7ac81f4a678a032a21a5b69b"}
Jul 23 11:52:24.759052 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:24.758865    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe27559d910977619350289c73cc5e123bb1187d7ac81f4a678a032a21a5b69b"
Jul 23 11:52:41.233675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:41.233633    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"]
Jul 23 11:52:41.239666 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:41.239640    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02a4cf-p9qkk"]
Jul 23 11:52:41.446881 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:52:41.446850    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1c51eda-e686-43f6-9f04-f38cc61ea8e9" path="/var/lib/kubelet/pods/d1c51eda-e686-43f6-9f04-f38cc61ea8e9/volumes"
Jul 23 11:53:56.707636 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.707595    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"]
Jul 23 11:53:56.708132 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.708011    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c51eda-e686-43f6-9f04-f38cc61ea8e9" containerName="revoke-keys"
Jul 23 11:53:56.708132 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.708023    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c51eda-e686-43f6-9f04-f38cc61ea8e9" containerName="revoke-keys"
Jul 23 11:53:56.708132 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.708107    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1c51eda-e686-43f6-9f04-f38cc61ea8e9" containerName="revoke-keys"
Jul 23 11:53:56.711107 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.711089    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.713434 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.713409    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"auth-test-model-839b3c-kserve-self-signed-certs\""
Jul 23 11:53:56.713561 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.713451    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"openshift-service-ca.crt\""
Jul 23 11:53:56.713561 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.713410    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"kube-root-ca.crt\""
Jul 23 11:53:56.713561 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.713528    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"default-dockercfg-x8tgz\""
Jul 23 11:53:56.719983 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.719954    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"]
Jul 23 11:53:56.776096 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.776064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77kl\" (UniqueName: \"kubernetes.io/projected/4b5da6bc-3475-4801-9a04-9ed06c681d7b-kube-api-access-v77kl\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.776309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.776103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tls-certs\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.776309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.776128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tmp-dir\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.776309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.776196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-home\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.776309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.776234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-dshm\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.776309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.776259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-model-cache\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.876903 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.876858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-home\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.876903 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.876907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-dshm\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.877149 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.876932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-model-cache\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.877149 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.877011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77kl\" (UniqueName: \"kubernetes.io/projected/4b5da6bc-3475-4801-9a04-9ed06c681d7b-kube-api-access-v77kl\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.877149 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.877034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tls-certs\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.877149 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.877056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tmp-dir\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.877390 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.877363    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-home\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.877462 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.877412    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tmp-dir\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.877462 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.877447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-model-cache\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.879370 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.879339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-dshm\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.879607 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.879591    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tls-certs\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:56.890689 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:56.890663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77kl\" (UniqueName: \"kubernetes.io/projected/4b5da6bc-3475-4801-9a04-9ed06c681d7b-kube-api-access-v77kl\") pod \"auth-test-model-839b3c-kserve-844d68459-b9qqs\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") " pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:57.021033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:57.020940    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:53:57.163602 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:57.163574    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"]
Jul 23 11:53:57.165853 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:53:57.165810    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b5da6bc_3475_4801_9a04_9ed06c681d7b.slice/crio-76f38aa6904f9797fe3fae0ba7d2e07e20267a0596ecdae896fa6fd9a18b05b8 WatchSource:0}: Error finding container 76f38aa6904f9797fe3fae0ba7d2e07e20267a0596ecdae896fa6fd9a18b05b8: Status 404 returned error can't find the container with id 76f38aa6904f9797fe3fae0ba7d2e07e20267a0596ecdae896fa6fd9a18b05b8
Jul 23 11:53:57.269103 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:57.269055    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs" event={"ID":"4b5da6bc-3475-4801-9a04-9ed06c681d7b","Type":"ContainerStarted","Data":"985a24fa5005b9d6048173b3a2cc6b5353a37308782ce68d335f831d64659646"}
Jul 23 11:53:57.269272 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:57.269114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs" event={"ID":"4b5da6bc-3475-4801-9a04-9ed06c681d7b","Type":"ContainerStarted","Data":"76f38aa6904f9797fe3fae0ba7d2e07e20267a0596ecdae896fa6fd9a18b05b8"}
Jul 23 11:53:57.285139 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:53:57.284983    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs" podStartSLOduration=1.28496612 podStartE2EDuration="1.28496612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:53:57.283669001 +0000 UTC m=+2652.329766150" watchObservedRunningTime="2026-07-23 11:53:57.28496612 +0000 UTC m=+2652.331063280"
Jul 23 11:54:07.021245 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:07.021208    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:54:07.021857 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:07.021261    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:54:07.035880 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:07.035847    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:54:07.342840 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:07.342811    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:54:22.527536 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.527494    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"]
Jul 23 11:54:22.531092 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.531072    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.533351 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.533329    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"auth-test-model-c713d8-kserve-self-signed-certs\""
Jul 23 11:54:22.534058 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.534039    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"openshift-service-ca.crt\""
Jul 23 11:54:22.534143 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.534097    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"kube-root-ca.crt\""
Jul 23 11:54:22.534143 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.534125    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"default-dockercfg-vff5v\""
Jul 23 11:54:22.546195 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.546169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"]
Jul 23 11:54:22.626846 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.626812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-tmp-dir\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.626846 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.626850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-model-cache\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.627135 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.626884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-dshm\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.627135 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.627005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-home\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.627135 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.627044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2phbn\" (UniqueName: \"kubernetes.io/projected/c760615f-2890-46c7-9b5a-4bfc24ee561d-kube-api-access-2phbn\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.627135 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.627114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c760615f-2890-46c7-9b5a-4bfc24ee561d-tls-certs\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728113 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-dshm\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728314 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-home\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728314 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2phbn\" (UniqueName: \"kubernetes.io/projected/c760615f-2890-46c7-9b5a-4bfc24ee561d-kube-api-access-2phbn\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728314 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c760615f-2890-46c7-9b5a-4bfc24ee561d-tls-certs\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728499 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-tmp-dir\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728499 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-model-cache\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728655 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-home\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728786 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728726    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-tmp-dir\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.728786 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.728782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-model-cache\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.730470 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.730447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-dshm\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.730697 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.730678    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c760615f-2890-46c7-9b5a-4bfc24ee561d-tls-certs\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.737177 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.737156    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2phbn\" (UniqueName: \"kubernetes.io/projected/c760615f-2890-46c7-9b5a-4bfc24ee561d-kube-api-access-2phbn\") pod \"auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") " pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.841256 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.841216    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:22.986625 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:22.986593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"]
Jul 23 11:54:22.990095 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:54:22.990068    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc760615f_2890_46c7_9b5a_4bfc24ee561d.slice/crio-bf83a94c9b0f318ab0d4b74ea328e97eced1151910be2582c5d29bf85a389a51 WatchSource:0}: Error finding container bf83a94c9b0f318ab0d4b74ea328e97eced1151910be2582c5d29bf85a389a51: Status 404 returned error can't find the container with id bf83a94c9b0f318ab0d4b74ea328e97eced1151910be2582c5d29bf85a389a51
Jul 23 11:54:23.418004 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:23.417972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl" event={"ID":"c760615f-2890-46c7-9b5a-4bfc24ee561d","Type":"ContainerStarted","Data":"f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028"}
Jul 23 11:54:23.418190 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:23.418014    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl" event={"ID":"c760615f-2890-46c7-9b5a-4bfc24ee561d","Type":"ContainerStarted","Data":"bf83a94c9b0f318ab0d4b74ea328e97eced1151910be2582c5d29bf85a389a51"}
Jul 23 11:54:23.447622 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:23.447572    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl" podStartSLOduration=1.447556984 podStartE2EDuration="1.447556984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:54:23.446968544 +0000 UTC m=+2678.493065659" watchObservedRunningTime="2026-07-23 11:54:23.447556984 +0000 UTC m=+2678.493654099"
Jul 23 11:54:32.842183 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:32.842127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:32.842183 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:32.842195    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:32.854817 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:32.854789    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:54:33.486067 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:54:33.486030    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:56:24.029511 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:24.029471    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"]
Jul 23 11:56:24.819412 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:24.819373    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"]
Jul 23 11:56:36.465897 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.465859    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"]
Jul 23 11:56:36.469285 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.469267    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.474803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.474779    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"sub-test-model-839b3c-kserve-self-signed-certs\""
Jul 23 11:56:36.502214 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.502184    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"]
Jul 23 11:56:36.574158 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.574123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-dshm\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.574338 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.574176    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bd19097-741d-4349-9e56-d78c32211b57-tls-certs\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.574338 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.574283    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-model-cache\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.574486 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.574336    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-tmp-dir\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.574486 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.574404    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-home\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.574486 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.574428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9s2z\" (UniqueName: \"kubernetes.io/projected/6bd19097-741d-4349-9e56-d78c32211b57-kube-api-access-b9s2z\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675429 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675384    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-tmp-dir\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675608 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-home\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675608 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9s2z\" (UniqueName: \"kubernetes.io/projected/6bd19097-741d-4349-9e56-d78c32211b57-kube-api-access-b9s2z\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-dshm\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bd19097-741d-4349-9e56-d78c32211b57-tls-certs\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-model-cache\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675900 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675821    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-tmp-dir\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.675980 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.675957    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-home\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.676054 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.676036    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-model-cache\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.677962 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.677935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-dshm\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.678193 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.678174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bd19097-741d-4349-9e56-d78c32211b57-tls-certs\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.686944 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.686923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9s2z\" (UniqueName: \"kubernetes.io/projected/6bd19097-741d-4349-9e56-d78c32211b57-kube-api-access-b9s2z\") pod \"sub-test-model-839b3c-kserve-585d69647-nfblz\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") " pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.778312 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.778237    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:36.929686 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:36.929582    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"]
Jul 23 11:56:36.932188 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:56:36.932158    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bd19097_741d_4349_9e56_d78c32211b57.slice/crio-c65bd46dfa0ee910156f04d3d81f83ec4742491fb25a46a44ff20e0cef4b728a WatchSource:0}: Error finding container c65bd46dfa0ee910156f04d3d81f83ec4742491fb25a46a44ff20e0cef4b728a: Status 404 returned error can't find the container with id c65bd46dfa0ee910156f04d3d81f83ec4742491fb25a46a44ff20e0cef4b728a
Jul 23 11:56:37.161214 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:37.161175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz" event={"ID":"6bd19097-741d-4349-9e56-d78c32211b57","Type":"ContainerStarted","Data":"275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c"}
Jul 23 11:56:37.161421 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:37.161227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz" event={"ID":"6bd19097-741d-4349-9e56-d78c32211b57","Type":"ContainerStarted","Data":"c65bd46dfa0ee910156f04d3d81f83ec4742491fb25a46a44ff20e0cef4b728a"}
Jul 23 11:56:37.184948 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:37.184891    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz" podStartSLOduration=1.184876058 podStartE2EDuration="1.184876058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:56:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:56:37.181786751 +0000 UTC m=+2812.227883862" watchObservedRunningTime="2026-07-23 11:56:37.184876058 +0000 UTC m=+2812.230973171"
Jul 23 11:56:39.049479 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.049410    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs" podUID="4b5da6bc-3475-4801-9a04-9ed06c681d7b" containerName="main" containerID="cri-o://985a24fa5005b9d6048173b3a2cc6b5353a37308782ce68d335f831d64659646" gracePeriod=45
Jul 23 11:56:39.174481 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.174452    2573 generic.go:356] "Generic (PLEG): container finished" podID="4b5da6bc-3475-4801-9a04-9ed06c681d7b" containerID="985a24fa5005b9d6048173b3a2cc6b5353a37308782ce68d335f831d64659646" exitCode=0
Jul 23 11:56:39.174595 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.174528    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs" event={"ID":"4b5da6bc-3475-4801-9a04-9ed06c681d7b","Type":"ContainerDied","Data":"985a24fa5005b9d6048173b3a2cc6b5353a37308782ce68d335f831d64659646"}
Jul 23 11:56:39.304938 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.304918    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:56:39.402429 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402393    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-dshm\") pod \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") "
Jul 23 11:56:39.402587 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402462    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tls-certs\") pod \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") "
Jul 23 11:56:39.402587 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v77kl\" (UniqueName: \"kubernetes.io/projected/4b5da6bc-3475-4801-9a04-9ed06c681d7b-kube-api-access-v77kl\") pod \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") "
Jul 23 11:56:39.402666 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402635    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tmp-dir\") pod \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") "
Jul 23 11:56:39.402706 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402691    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-model-cache\") pod \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") "
Jul 23 11:56:39.402775 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-home\") pod \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\" (UID: \"4b5da6bc-3475-4801-9a04-9ed06c681d7b\") "
Jul 23 11:56:39.402968 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402938    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b5da6bc-3475-4801-9a04-9ed06c681d7b" (UID: "4b5da6bc-3475-4801-9a04-9ed06c681d7b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:39.402968 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.402945    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b5da6bc-3475-4801-9a04-9ed06c681d7b" (UID: "4b5da6bc-3475-4801-9a04-9ed06c681d7b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:39.403159 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.403085    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-home" (OuterVolumeSpecName: "home") pod "4b5da6bc-3475-4801-9a04-9ed06c681d7b" (UID: "4b5da6bc-3475-4801-9a04-9ed06c681d7b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:39.403159 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.403130    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:39.403159 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.403150    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:39.404808 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.404785    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-dshm" (OuterVolumeSpecName: "dshm") pod "4b5da6bc-3475-4801-9a04-9ed06c681d7b" (UID: "4b5da6bc-3475-4801-9a04-9ed06c681d7b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:39.404905 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.404843    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b5da6bc-3475-4801-9a04-9ed06c681d7b" (UID: "4b5da6bc-3475-4801-9a04-9ed06c681d7b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:56:39.404905 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.404862    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5da6bc-3475-4801-9a04-9ed06c681d7b-kube-api-access-v77kl" (OuterVolumeSpecName: "kube-api-access-v77kl") pod "4b5da6bc-3475-4801-9a04-9ed06c681d7b" (UID: "4b5da6bc-3475-4801-9a04-9ed06c681d7b"). InnerVolumeSpecName "kube-api-access-v77kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:56:39.503904 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.503865    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v77kl\" (UniqueName: \"kubernetes.io/projected/4b5da6bc-3475-4801-9a04-9ed06c681d7b-kube-api-access-v77kl\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:39.503904 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.503898    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:39.503904 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.503913    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5da6bc-3475-4801-9a04-9ed06c681d7b-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:39.504170 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.503925    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5da6bc-3475-4801-9a04-9ed06c681d7b-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:39.839232 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:39.839177    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl" podUID="c760615f-2890-46c7-9b5a-4bfc24ee561d" containerName="main" containerID="cri-o://f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028" gracePeriod=45
Jul 23 11:56:40.078957 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.078935    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:56:40.181449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.181375    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"
Jul 23 11:56:40.181449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.181387    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs" event={"ID":"4b5da6bc-3475-4801-9a04-9ed06c681d7b","Type":"ContainerDied","Data":"76f38aa6904f9797fe3fae0ba7d2e07e20267a0596ecdae896fa6fd9a18b05b8"}
Jul 23 11:56:40.181449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.181440    2573 scope.go:117] "RemoveContainer" containerID="985a24fa5005b9d6048173b3a2cc6b5353a37308782ce68d335f831d64659646"
Jul 23 11:56:40.182861 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.182839    2573 generic.go:356] "Generic (PLEG): container finished" podID="c760615f-2890-46c7-9b5a-4bfc24ee561d" containerID="f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028" exitCode=0
Jul 23 11:56:40.182984 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.182882    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"
Jul 23 11:56:40.182984 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.182963    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl" event={"ID":"c760615f-2890-46c7-9b5a-4bfc24ee561d","Type":"ContainerDied","Data":"f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028"}
Jul 23 11:56:40.183060 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.182999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl" event={"ID":"c760615f-2890-46c7-9b5a-4bfc24ee561d","Type":"ContainerDied","Data":"bf83a94c9b0f318ab0d4b74ea328e97eced1151910be2582c5d29bf85a389a51"}
Jul 23 11:56:40.190331 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.190315    2573 scope.go:117] "RemoveContainer" containerID="f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028"
Jul 23 11:56:40.198379 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.198361    2573 scope.go:117] "RemoveContainer" containerID="f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028"
Jul 23 11:56:40.198625 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:56:40.198605    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028\": container with ID starting with f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028 not found: ID does not exist" containerID="f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028"
Jul 23 11:56:40.198675 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.198632    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028"} err="failed to get container status \"f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028\": rpc error: code = NotFound desc = could not find container \"f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028\": container with ID starting with f3070a1113b623a85e2965c5264af2444f8fda94b02ab62de990cb6a4bec1028 not found: ID does not exist"
Jul 23 11:56:40.202369 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.202349    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"]
Jul 23 11:56:40.207716 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.207693    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/auth-test-model-839b3c-kserve-844d68459-b9qqs"]
Jul 23 11:56:40.210587 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210567    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-dshm\") pod \"c760615f-2890-46c7-9b5a-4bfc24ee561d\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") "
Jul 23 11:56:40.210662 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210594    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-home\") pod \"c760615f-2890-46c7-9b5a-4bfc24ee561d\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") "
Jul 23 11:56:40.210710 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210663    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-model-cache\") pod \"c760615f-2890-46c7-9b5a-4bfc24ee561d\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") "
Jul 23 11:56:40.210710 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2phbn\" (UniqueName: \"kubernetes.io/projected/c760615f-2890-46c7-9b5a-4bfc24ee561d-kube-api-access-2phbn\") pod \"c760615f-2890-46c7-9b5a-4bfc24ee561d\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") "
Jul 23 11:56:40.210966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c760615f-2890-46c7-9b5a-4bfc24ee561d-tls-certs\") pod \"c760615f-2890-46c7-9b5a-4bfc24ee561d\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") "
Jul 23 11:56:40.210966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210803    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-tmp-dir\") pod \"c760615f-2890-46c7-9b5a-4bfc24ee561d\" (UID: \"c760615f-2890-46c7-9b5a-4bfc24ee561d\") "
Jul 23 11:56:40.210966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210920    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-home" (OuterVolumeSpecName: "home") pod "c760615f-2890-46c7-9b5a-4bfc24ee561d" (UID: "c760615f-2890-46c7-9b5a-4bfc24ee561d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:40.210966 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.210956    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-model-cache" (OuterVolumeSpecName: "model-cache") pod "c760615f-2890-46c7-9b5a-4bfc24ee561d" (UID: "c760615f-2890-46c7-9b5a-4bfc24ee561d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:40.211163 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.211056    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:40.211163 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.211074    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:40.211163 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.211091    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c760615f-2890-46c7-9b5a-4bfc24ee561d" (UID: "c760615f-2890-46c7-9b5a-4bfc24ee561d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:40.212803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.212775    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-dshm" (OuterVolumeSpecName: "dshm") pod "c760615f-2890-46c7-9b5a-4bfc24ee561d" (UID: "c760615f-2890-46c7-9b5a-4bfc24ee561d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:56:40.212803 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.212792    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c760615f-2890-46c7-9b5a-4bfc24ee561d-kube-api-access-2phbn" (OuterVolumeSpecName: "kube-api-access-2phbn") pod "c760615f-2890-46c7-9b5a-4bfc24ee561d" (UID: "c760615f-2890-46c7-9b5a-4bfc24ee561d"). InnerVolumeSpecName "kube-api-access-2phbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:56:40.212917 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.212833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c760615f-2890-46c7-9b5a-4bfc24ee561d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c760615f-2890-46c7-9b5a-4bfc24ee561d" (UID: "c760615f-2890-46c7-9b5a-4bfc24ee561d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:56:40.311822 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.311786    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2phbn\" (UniqueName: \"kubernetes.io/projected/c760615f-2890-46c7-9b5a-4bfc24ee561d-kube-api-access-2phbn\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:40.311822 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.311814    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c760615f-2890-46c7-9b5a-4bfc24ee561d-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:40.311822 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.311824    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:40.311822 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.311831    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c760615f-2890-46c7-9b5a-4bfc24ee561d-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:56:40.505656 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.505625    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"]
Jul 23 11:56:40.509647 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:40.509622    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/auth-test-model-c713d8-kserve-7f9bd97d7f-qfwbl"]
Jul 23 11:56:41.445785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:41.445730    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b5da6bc-3475-4801-9a04-9ed06c681d7b" path="/var/lib/kubelet/pods/4b5da6bc-3475-4801-9a04-9ed06c681d7b/volumes"
Jul 23 11:56:41.446182 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:41.446167    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c760615f-2890-46c7-9b5a-4bfc24ee561d" path="/var/lib/kubelet/pods/c760615f-2890-46c7-9b5a-4bfc24ee561d/volumes"
Jul 23 11:56:46.778853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:46.778817    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:46.778853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:46.778863    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:46.791238 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:46.791212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:56:47.234975 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:56:47.234942    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:57:02.355730 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.355695    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"]
Jul 23 11:57:02.356194 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.356072    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c760615f-2890-46c7-9b5a-4bfc24ee561d" containerName="main"
Jul 23 11:57:02.356194 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.356085    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c760615f-2890-46c7-9b5a-4bfc24ee561d" containerName="main"
Jul 23 11:57:02.356194 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.356111    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5da6bc-3475-4801-9a04-9ed06c681d7b" containerName="main"
Jul 23 11:57:02.356194 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.356117    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5da6bc-3475-4801-9a04-9ed06c681d7b" containerName="main"
Jul 23 11:57:02.356194 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.356172    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b5da6bc-3475-4801-9a04-9ed06c681d7b" containerName="main"
Jul 23 11:57:02.356194 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.356181    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c760615f-2890-46c7-9b5a-4bfc24ee561d" containerName="main"
Jul 23 11:57:02.359333 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.359315    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.366371 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.365868    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"sub-test-model-c713d8-kserve-self-signed-certs\""
Jul 23 11:57:02.366371 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.366087    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"kube-root-ca.crt\""
Jul 23 11:57:02.367094 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.367055    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"default-dockercfg-vff5v\""
Jul 23 11:57:02.367094 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.367084    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"openshift-service-ca.crt\""
Jul 23 11:57:02.383918 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.383884    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"]
Jul 23 11:57:02.403906 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.403879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-model-cache\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.404045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.403910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s75m\" (UniqueName: \"kubernetes.io/projected/8371f965-0544-4756-8caf-74ef2a54a4ed-kube-api-access-8s75m\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.404045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.403936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-home\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.404045 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.404010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-dshm\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.404146 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.404053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-tmp-dir\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.404146 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.404090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8371f965-0544-4756-8caf-74ef2a54a4ed-tls-certs\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505200 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-home\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505402 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-dshm\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505402 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-tmp-dir\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505402 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8371f965-0544-4756-8caf-74ef2a54a4ed-tls-certs\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505402 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-model-cache\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505402 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s75m\" (UniqueName: \"kubernetes.io/projected/8371f965-0544-4756-8caf-74ef2a54a4ed-kube-api-access-8s75m\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505690 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-tmp-dir\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505778 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505720    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-home\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.505824 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.505777    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-model-cache\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.507598 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.507577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-dshm\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.507900 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.507881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8371f965-0544-4756-8caf-74ef2a54a4ed-tls-certs\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.521350 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.521318    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s75m\" (UniqueName: \"kubernetes.io/projected/8371f965-0544-4756-8caf-74ef2a54a4ed-kube-api-access-8s75m\") pod \"sub-test-model-c713d8-kserve-87df777d7-shw25\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") " pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.669405 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.669311    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:02.814987 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:02.814953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"]
Jul 23 11:57:02.818070 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:57:02.818043    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8371f965_0544_4756_8caf_74ef2a54a4ed.slice/crio-0462429498d18f3d677bab3df577180af7e7fbe93848f3c8008f653345bf7094 WatchSource:0}: Error finding container 0462429498d18f3d677bab3df577180af7e7fbe93848f3c8008f653345bf7094: Status 404 returned error can't find the container with id 0462429498d18f3d677bab3df577180af7e7fbe93848f3c8008f653345bf7094
Jul 23 11:57:03.311178 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:03.311138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25" event={"ID":"8371f965-0544-4756-8caf-74ef2a54a4ed","Type":"ContainerStarted","Data":"d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88"}
Jul 23 11:57:03.311357 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:03.311184    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25" event={"ID":"8371f965-0544-4756-8caf-74ef2a54a4ed","Type":"ContainerStarted","Data":"0462429498d18f3d677bab3df577180af7e7fbe93848f3c8008f653345bf7094"}
Jul 23 11:57:03.343455 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:03.343389    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25" podStartSLOduration=1.3433734720000001 podStartE2EDuration="1.343373472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:57:03.343373167 +0000 UTC m=+2838.389470281" watchObservedRunningTime="2026-07-23 11:57:03.343373472 +0000 UTC m=+2838.389470585"
Jul 23 11:57:12.670441 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:12.670406    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:12.670865 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:12.670477    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:12.682590 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:12.682565    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:13.382638 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:13.382606    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:38.078343 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:38.078253    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"]
Jul 23 11:57:39.009569 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:39.009527    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"]
Jul 23 11:57:53.098529 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.098483    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz" podUID="6bd19097-741d-4349-9e56-d78c32211b57" containerName="main" containerID="cri-o://275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c" gracePeriod=45
Jul 23 11:57:53.349062 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.348999    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:57:53.375579 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.375546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-model-cache\") pod \"6bd19097-741d-4349-9e56-d78c32211b57\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") "
Jul 23 11:57:53.375785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.375591    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-dshm\") pod \"6bd19097-741d-4349-9e56-d78c32211b57\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") "
Jul 23 11:57:53.375785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.375626    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-home\") pod \"6bd19097-741d-4349-9e56-d78c32211b57\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") "
Jul 23 11:57:53.375785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.375694    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bd19097-741d-4349-9e56-d78c32211b57-tls-certs\") pod \"6bd19097-741d-4349-9e56-d78c32211b57\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") "
Jul 23 11:57:53.375785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.375711    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-tmp-dir\") pod \"6bd19097-741d-4349-9e56-d78c32211b57\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") "
Jul 23 11:57:53.375785 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.375738    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9s2z\" (UniqueName: \"kubernetes.io/projected/6bd19097-741d-4349-9e56-d78c32211b57-kube-api-access-b9s2z\") pod \"6bd19097-741d-4349-9e56-d78c32211b57\" (UID: \"6bd19097-741d-4349-9e56-d78c32211b57\") "
Jul 23 11:57:53.376092 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.375986    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-home" (OuterVolumeSpecName: "home") pod "6bd19097-741d-4349-9e56-d78c32211b57" (UID: "6bd19097-741d-4349-9e56-d78c32211b57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:53.376092 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.376000    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6bd19097-741d-4349-9e56-d78c32211b57" (UID: "6bd19097-741d-4349-9e56-d78c32211b57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:53.376092 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.376062    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:53.376092 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.376066    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-model-cache" (OuterVolumeSpecName: "model-cache") pod "6bd19097-741d-4349-9e56-d78c32211b57" (UID: "6bd19097-741d-4349-9e56-d78c32211b57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:53.377955 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.377924    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bd19097-741d-4349-9e56-d78c32211b57-kube-api-access-b9s2z" (OuterVolumeSpecName: "kube-api-access-b9s2z") pod "6bd19097-741d-4349-9e56-d78c32211b57" (UID: "6bd19097-741d-4349-9e56-d78c32211b57"). InnerVolumeSpecName "kube-api-access-b9s2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:57:53.378073 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.378008    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bd19097-741d-4349-9e56-d78c32211b57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6bd19097-741d-4349-9e56-d78c32211b57" (UID: "6bd19097-741d-4349-9e56-d78c32211b57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:57:53.378073 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.378027    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-dshm" (OuterVolumeSpecName: "dshm") pod "6bd19097-741d-4349-9e56-d78c32211b57" (UID: "6bd19097-741d-4349-9e56-d78c32211b57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:53.476631 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.476597    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bd19097-741d-4349-9e56-d78c32211b57-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:53.476631 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.476625    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:53.476631 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.476634    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9s2z\" (UniqueName: \"kubernetes.io/projected/6bd19097-741d-4349-9e56-d78c32211b57-kube-api-access-b9s2z\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:53.476854 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.476643    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:53.476854 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.476652    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bd19097-741d-4349-9e56-d78c32211b57-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:53.590118 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.590081    2573 generic.go:356] "Generic (PLEG): container finished" podID="6bd19097-741d-4349-9e56-d78c32211b57" containerID="275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c" exitCode=0
Jul 23 11:57:53.590308 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.590127    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"
Jul 23 11:57:53.590308 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.590166    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz" event={"ID":"6bd19097-741d-4349-9e56-d78c32211b57","Type":"ContainerDied","Data":"275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c"}
Jul 23 11:57:53.590308 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.590213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz" event={"ID":"6bd19097-741d-4349-9e56-d78c32211b57","Type":"ContainerDied","Data":"c65bd46dfa0ee910156f04d3d81f83ec4742491fb25a46a44ff20e0cef4b728a"}
Jul 23 11:57:53.590308 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.590231    2573 scope.go:117] "RemoveContainer" containerID="275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c"
Jul 23 11:57:53.599484 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.599470    2573 scope.go:117] "RemoveContainer" containerID="275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c"
Jul 23 11:57:53.599732 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:57:53.599714    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c\": container with ID starting with 275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c not found: ID does not exist" containerID="275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c"
Jul 23 11:57:53.599800 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.599754    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c"} err="failed to get container status \"275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c\": rpc error: code = NotFound desc = could not find container \"275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c\": container with ID starting with 275b6b7b61f60f4b00d2ba789949fd8d265b4085aa04fc804c4d9ea8c9033c1c not found: ID does not exist"
Jul 23 11:57:53.608676 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.608651    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"]
Jul 23 11:57:53.615673 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:53.615649    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/sub-test-model-839b3c-kserve-585d69647-nfblz"]
Jul 23 11:57:54.031058 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.030967    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25" podUID="8371f965-0544-4756-8caf-74ef2a54a4ed" containerName="main" containerID="cri-o://d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88" gracePeriod=45
Jul 23 11:57:54.286081 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.286023    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:54.386213 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386179    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-model-cache\") pod \"8371f965-0544-4756-8caf-74ef2a54a4ed\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") "
Jul 23 11:57:54.386384 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386229    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-dshm\") pod \"8371f965-0544-4756-8caf-74ef2a54a4ed\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") "
Jul 23 11:57:54.386384 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386264    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-tmp-dir\") pod \"8371f965-0544-4756-8caf-74ef2a54a4ed\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") "
Jul 23 11:57:54.386384 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386308    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-home\") pod \"8371f965-0544-4756-8caf-74ef2a54a4ed\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") "
Jul 23 11:57:54.386384 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386371    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s75m\" (UniqueName: \"kubernetes.io/projected/8371f965-0544-4756-8caf-74ef2a54a4ed-kube-api-access-8s75m\") pod \"8371f965-0544-4756-8caf-74ef2a54a4ed\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") "
Jul 23 11:57:54.386597 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386461    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8371f965-0544-4756-8caf-74ef2a54a4ed-tls-certs\") pod \"8371f965-0544-4756-8caf-74ef2a54a4ed\" (UID: \"8371f965-0544-4756-8caf-74ef2a54a4ed\") "
Jul 23 11:57:54.386597 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386512    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-model-cache" (OuterVolumeSpecName: "model-cache") pod "8371f965-0544-4756-8caf-74ef2a54a4ed" (UID: "8371f965-0544-4756-8caf-74ef2a54a4ed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:54.386705 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386597    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8371f965-0544-4756-8caf-74ef2a54a4ed" (UID: "8371f965-0544-4756-8caf-74ef2a54a4ed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:54.386705 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386681    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-home" (OuterVolumeSpecName: "home") pod "8371f965-0544-4756-8caf-74ef2a54a4ed" (UID: "8371f965-0544-4756-8caf-74ef2a54a4ed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:54.386853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386790    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:54.386853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386803    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:54.386853 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.386812    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:54.388438 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.388409    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-dshm" (OuterVolumeSpecName: "dshm") pod "8371f965-0544-4756-8caf-74ef2a54a4ed" (UID: "8371f965-0544-4756-8caf-74ef2a54a4ed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:57:54.388572 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.388520    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8371f965-0544-4756-8caf-74ef2a54a4ed-kube-api-access-8s75m" (OuterVolumeSpecName: "kube-api-access-8s75m") pod "8371f965-0544-4756-8caf-74ef2a54a4ed" (UID: "8371f965-0544-4756-8caf-74ef2a54a4ed"). InnerVolumeSpecName "kube-api-access-8s75m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:57:54.388572 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.388558    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8371f965-0544-4756-8caf-74ef2a54a4ed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8371f965-0544-4756-8caf-74ef2a54a4ed" (UID: "8371f965-0544-4756-8caf-74ef2a54a4ed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:57:54.487245 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.487207    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8371f965-0544-4756-8caf-74ef2a54a4ed-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:54.487245 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.487238    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s75m\" (UniqueName: \"kubernetes.io/projected/8371f965-0544-4756-8caf-74ef2a54a4ed-kube-api-access-8s75m\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:54.487245 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.487248    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8371f965-0544-4756-8caf-74ef2a54a4ed-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:57:54.597867 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.597835    2573 generic.go:356] "Generic (PLEG): container finished" podID="8371f965-0544-4756-8caf-74ef2a54a4ed" containerID="d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88" exitCode=0
Jul 23 11:57:54.598018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.597880    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"
Jul 23 11:57:54.598018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.597899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25" event={"ID":"8371f965-0544-4756-8caf-74ef2a54a4ed","Type":"ContainerDied","Data":"d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88"}
Jul 23 11:57:54.598018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.597929    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25" event={"ID":"8371f965-0544-4756-8caf-74ef2a54a4ed","Type":"ContainerDied","Data":"0462429498d18f3d677bab3df577180af7e7fbe93848f3c8008f653345bf7094"}
Jul 23 11:57:54.598018 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.597945    2573 scope.go:117] "RemoveContainer" containerID="d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88"
Jul 23 11:57:54.607708 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.607688    2573 scope.go:117] "RemoveContainer" containerID="d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88"
Jul 23 11:57:54.608060 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:57:54.608036    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88\": container with ID starting with d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88 not found: ID does not exist" containerID="d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88"
Jul 23 11:57:54.608134 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.608072    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88"} err="failed to get container status \"d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88\": rpc error: code = NotFound desc = could not find container \"d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88\": container with ID starting with d0933a6321d77fc862ccb04d3ddcda678607ac7819873fc5cf0098dded568d88 not found: ID does not exist"
Jul 23 11:57:54.621136 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.621114    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"]
Jul 23 11:57:54.632906 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:54.632877    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/sub-test-model-c713d8-kserve-87df777d7-shw25"]
Jul 23 11:57:55.448345 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.448313    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bd19097-741d-4349-9e56-d78c32211b57" path="/var/lib/kubelet/pods/6bd19097-741d-4349-9e56-d78c32211b57/volumes"
Jul 23 11:57:55.448720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.448697    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8371f965-0544-4756-8caf-74ef2a54a4ed" path="/var/lib/kubelet/pods/8371f965-0544-4756-8caf-74ef2a54a4ed/volumes"
Jul 23 11:57:55.810190 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.810156    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"]
Jul 23 11:57:55.810524 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.810511    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bd19097-741d-4349-9e56-d78c32211b57" containerName="main"
Jul 23 11:57:55.810575 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.810524    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bd19097-741d-4349-9e56-d78c32211b57" containerName="main"
Jul 23 11:57:55.810575 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.810539    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8371f965-0544-4756-8caf-74ef2a54a4ed" containerName="main"
Jul 23 11:57:55.810575 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.810544    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8371f965-0544-4756-8caf-74ef2a54a4ed" containerName="main"
Jul 23 11:57:55.810682 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.810594    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bd19097-741d-4349-9e56-d78c32211b57" containerName="main"
Jul 23 11:57:55.810682 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.810604    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8371f965-0544-4756-8caf-74ef2a54a4ed" containerName="main"
Jul 23 11:57:55.813832 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.813813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:55.816430 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.816406    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"openshift-service-ca.crt\""
Jul 23 11:57:55.816524 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.816406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"rate-test-model-839b3c-kserve-self-signed-certs\""
Jul 23 11:57:55.816606 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.816550    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"default-dockercfg-x8tgz\""
Jul 23 11:57:55.816666 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.816616    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-839b3c\"/\"kube-root-ca.crt\""
Jul 23 11:57:55.824033 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.824012    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"]
Jul 23 11:57:55.899217 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.899182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-dshm\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:55.899386 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.899222    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-model-cache\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:55.899386 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.899278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-tmp-dir\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:55.899386 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.899309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f19810-0c1b-46dd-9e69-60184921aa3f-tls-certs\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:55.899386 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.899360    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6jtt\" (UniqueName: \"kubernetes.io/projected/81f19810-0c1b-46dd-9e69-60184921aa3f-kube-api-access-c6jtt\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:55.899545 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:55.899404    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-home\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000455 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-dshm\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000637 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-model-cache\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000637 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-tmp-dir\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000637 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f19810-0c1b-46dd-9e69-60184921aa3f-tls-certs\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000637 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6jtt\" (UniqueName: \"kubernetes.io/projected/81f19810-0c1b-46dd-9e69-60184921aa3f-kube-api-access-c6jtt\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000637 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-home\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000965 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-tmp-dir\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.000965 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.000945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-model-cache\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.001080 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.001060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-home\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.002791 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.002769    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-dshm\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.003024 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.003006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f19810-0c1b-46dd-9e69-60184921aa3f-tls-certs\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.008700 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.008676    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6jtt\" (UniqueName: \"kubernetes.io/projected/81f19810-0c1b-46dd-9e69-60184921aa3f-kube-api-access-c6jtt\") pod \"rate-test-model-839b3c-kserve-7479788975-54qzf\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") " pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.123873 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.123807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:57:56.263284 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.263038    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"]
Jul 23 11:57:56.264682 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:57:56.264652    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81f19810_0c1b_46dd_9e69_60184921aa3f.slice/crio-5ddf56e2122c48062a1c1a45b3793cd98c376bbc7b76510bacb97050ed8110f5 WatchSource:0}: Error finding container 5ddf56e2122c48062a1c1a45b3793cd98c376bbc7b76510bacb97050ed8110f5: Status 404 returned error can't find the container with id 5ddf56e2122c48062a1c1a45b3793cd98c376bbc7b76510bacb97050ed8110f5
Jul 23 11:57:56.611187 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.611151    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf" event={"ID":"81f19810-0c1b-46dd-9e69-60184921aa3f","Type":"ContainerStarted","Data":"e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8"}
Jul 23 11:57:56.611187 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.611192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf" event={"ID":"81f19810-0c1b-46dd-9e69-60184921aa3f","Type":"ContainerStarted","Data":"5ddf56e2122c48062a1c1a45b3793cd98c376bbc7b76510bacb97050ed8110f5"}
Jul 23 11:57:56.630989 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:57:56.630938    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf" podStartSLOduration=1.630921343 podStartE2EDuration="1.630921343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:57:56.628448911 +0000 UTC m=+2891.674546028" watchObservedRunningTime="2026-07-23 11:57:56.630921343 +0000 UTC m=+2891.677018457"
Jul 23 11:58:06.124902 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:06.124857    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:58:06.125478 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:06.124921    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:58:06.137382 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:06.137360    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:58:06.685801 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:06.685774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:58:29.088998 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.088961    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"]
Jul 23 11:58:29.092303 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.092286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.095127 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.095102    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"rate-test-model-c713d8-kserve-self-signed-certs\""
Jul 23 11:58:29.095253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.095102    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"kube-root-ca.crt\""
Jul 23 11:58:29.095253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.095148    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"openshift-service-ca.crt\""
Jul 23 11:58:29.095253 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.095109    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c713d8\"/\"default-dockercfg-vff5v\""
Jul 23 11:58:29.102403 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.102382    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"]
Jul 23 11:58:29.199592 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.199553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-tmp-dir\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.199592 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.199593    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-dshm\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.199832 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.199612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-model-cache\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.199832 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.199688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1adde614-9caf-470b-a218-0344b3dacef0-tls-certs\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.199832 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.199769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-home\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.199832 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.199802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t425t\" (UniqueName: \"kubernetes.io/projected/1adde614-9caf-470b-a218-0344b3dacef0-kube-api-access-t425t\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301066 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-home\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301236 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t425t\" (UniqueName: \"kubernetes.io/projected/1adde614-9caf-470b-a218-0344b3dacef0-kube-api-access-t425t\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301236 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-tmp-dir\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301236 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-dshm\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301236 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-model-cache\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301389 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1adde614-9caf-470b-a218-0344b3dacef0-tls-certs\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301533 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301512    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-home\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301578 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-tmp-dir\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.301618 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.301598    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-model-cache\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.303477 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.303451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-dshm\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.303798 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.303782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1adde614-9caf-470b-a218-0344b3dacef0-tls-certs\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.310132 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.310103    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t425t\" (UniqueName: \"kubernetes.io/projected/1adde614-9caf-470b-a218-0344b3dacef0-kube-api-access-t425t\") pod \"rate-test-model-c713d8-kserve-6df7f6479f-qp7s6\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") " pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.402235 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.402147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:29.542776 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.542737    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"]
Jul 23 11:58:29.545266 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:58:29.545238    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1adde614_9caf_470b_a218_0344b3dacef0.slice/crio-53a8c55e4cc9d3de029b0f434911b4db31ff0ca043fd6c62f1b2c21858c71d57 WatchSource:0}: Error finding container 53a8c55e4cc9d3de029b0f434911b4db31ff0ca043fd6c62f1b2c21858c71d57: Status 404 returned error can't find the container with id 53a8c55e4cc9d3de029b0f434911b4db31ff0ca043fd6c62f1b2c21858c71d57
Jul 23 11:58:29.801177 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.801086    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6" event={"ID":"1adde614-9caf-470b-a218-0344b3dacef0","Type":"ContainerStarted","Data":"29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b"}
Jul 23 11:58:29.801177 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.801138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6" event={"ID":"1adde614-9caf-470b-a218-0344b3dacef0","Type":"ContainerStarted","Data":"53a8c55e4cc9d3de029b0f434911b4db31ff0ca043fd6c62f1b2c21858c71d57"}
Jul 23 11:58:29.821359 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:29.821306    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6" podStartSLOduration=0.821290212 podStartE2EDuration="821.290212ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:58:29.818585002 +0000 UTC m=+2924.864682117" watchObservedRunningTime="2026-07-23 11:58:29.821290212 +0000 UTC m=+2924.867387327"
Jul 23 11:58:39.402931 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:39.402897    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:39.403428 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:39.402946    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:39.415513 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:39.415486    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:39.867281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:39.867250    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:58:45.777148 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:58:45.777116    2573 scope.go:117] "RemoveContainer" containerID="eef818912b55b141d136dd31bc62523e8161816d0d4dc5cef34f8dc15ec696c8"
Jul 23 11:59:12.280897 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:12.280822    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"]
Jul 23 11:59:13.250394 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:13.250350    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"]
Jul 23 11:59:14.144545 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.144509    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140657969404848"]
Jul 23 11:59:14.148167 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.148151    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969404848"
Jul 23 11:59:14.150465 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.150443    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sdt2h\""
Jul 23 11:59:14.154895 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.154872    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969404848"]
Jul 23 11:59:14.308646 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.308615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72pg\" (UniqueName: \"kubernetes.io/projected/9defd037-a31e-44a1-8173-0a21f3b368e0-kube-api-access-s72pg\") pod \"test-curl-7447-140657969404848\" (UID: \"9defd037-a31e-44a1-8173-0a21f3b368e0\") " pod="opendatahub/test-curl-7447-140657969404848"
Jul 23 11:59:14.409869 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.409788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s72pg\" (UniqueName: \"kubernetes.io/projected/9defd037-a31e-44a1-8173-0a21f3b368e0-kube-api-access-s72pg\") pod \"test-curl-7447-140657969404848\" (UID: \"9defd037-a31e-44a1-8173-0a21f3b368e0\") " pod="opendatahub/test-curl-7447-140657969404848"
Jul 23 11:59:14.418136 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.418115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72pg\" (UniqueName: \"kubernetes.io/projected/9defd037-a31e-44a1-8173-0a21f3b368e0-kube-api-access-s72pg\") pod \"test-curl-7447-140657969404848\" (UID: \"9defd037-a31e-44a1-8173-0a21f3b368e0\") " pod="opendatahub/test-curl-7447-140657969404848"
Jul 23 11:59:14.458843 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.458817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969404848"
Jul 23 11:59:14.797683 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.797600    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969404848"]
Jul 23 11:59:14.800602 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:59:14.800576    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9defd037_a31e_44a1_8173_0a21f3b368e0.slice/crio-c1f29b32682c3516101aaf84f6e67be916db34916be88faaeee115ea5fa34fcc WatchSource:0}: Error finding container c1f29b32682c3516101aaf84f6e67be916db34916be88faaeee115ea5fa34fcc: Status 404 returned error can't find the container with id c1f29b32682c3516101aaf84f6e67be916db34916be88faaeee115ea5fa34fcc
Jul 23 11:59:14.802027 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:14.802006    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:59:15.051142 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:15.051057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969404848" event={"ID":"9defd037-a31e-44a1-8173-0a21f3b368e0","Type":"ContainerStarted","Data":"c1f29b32682c3516101aaf84f6e67be916db34916be88faaeee115ea5fa34fcc"}
Jul 23 11:59:16.059149 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:16.059117    2573 generic.go:356] "Generic (PLEG): container finished" podID="9defd037-a31e-44a1-8173-0a21f3b368e0" containerID="97c8bf97fac19a4d9634e92c1be6b2457ae491ef3093e28a544fed5297a67ead" exitCode=0
Jul 23 11:59:16.059541 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:16.059202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969404848" event={"ID":"9defd037-a31e-44a1-8173-0a21f3b368e0","Type":"ContainerDied","Data":"97c8bf97fac19a4d9634e92c1be6b2457ae491ef3093e28a544fed5297a67ead"}
Jul 23 11:59:17.200146 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.200116    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969404848"
Jul 23 11:59:17.235630 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.235604    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140657969404848_9defd037-a31e-44a1-8173-0a21f3b368e0/test-curl-7447-140657969404848/0.log"
Jul 23 11:59:17.256126 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.256090    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140657969404848"]
Jul 23 11:59:17.259523 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.259495    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140657969404848"]
Jul 23 11:59:17.332544 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.332461    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s72pg\" (UniqueName: \"kubernetes.io/projected/9defd037-a31e-44a1-8173-0a21f3b368e0-kube-api-access-s72pg\") pod \"9defd037-a31e-44a1-8173-0a21f3b368e0\" (UID: \"9defd037-a31e-44a1-8173-0a21f3b368e0\") "
Jul 23 11:59:17.334720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.334693    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9defd037-a31e-44a1-8173-0a21f3b368e0-kube-api-access-s72pg" (OuterVolumeSpecName: "kube-api-access-s72pg") pod "9defd037-a31e-44a1-8173-0a21f3b368e0" (UID: "9defd037-a31e-44a1-8173-0a21f3b368e0"). InnerVolumeSpecName "kube-api-access-s72pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:17.434111 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.434068    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s72pg\" (UniqueName: \"kubernetes.io/projected/9defd037-a31e-44a1-8173-0a21f3b368e0-kube-api-access-s72pg\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:17.447427 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:17.447396    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9defd037-a31e-44a1-8173-0a21f3b368e0" path="/var/lib/kubelet/pods/9defd037-a31e-44a1-8173-0a21f3b368e0/volumes"
Jul 23 11:59:18.071422 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:18.071391    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969404848"
Jul 23 11:59:18.071422 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:18.071380    2573 scope.go:117] "RemoveContainer" containerID="97c8bf97fac19a4d9634e92c1be6b2457ae491ef3093e28a544fed5297a67ead"
Jul 23 11:59:20.614771 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.613359    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:20.614771 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.614195    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9defd037-a31e-44a1-8173-0a21f3b368e0" containerName="test-curl-7447-140657969404848"
Jul 23 11:59:20.614771 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.614217    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9defd037-a31e-44a1-8173-0a21f3b368e0" containerName="test-curl-7447-140657969404848"
Jul 23 11:59:20.614771 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.614428    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9defd037-a31e-44a1-8173-0a21f3b368e0" containerName="test-curl-7447-140657969404848"
Jul 23 11:59:20.619985 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.619953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:20.621162 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.621048    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:20.622334 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.622221    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sdt2h\""
Jul 23 11:59:20.762561 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.762518    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmmhd\" (UniqueName: \"kubernetes.io/projected/12e7d36d-d26f-4b5c-91c9-a7298c1e3310-kube-api-access-vmmhd\") pod \"test-curl-7447-140657969345568\" (UID: \"12e7d36d-d26f-4b5c-91c9-a7298c1e3310\") " pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:20.863340 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.863296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmmhd\" (UniqueName: \"kubernetes.io/projected/12e7d36d-d26f-4b5c-91c9-a7298c1e3310-kube-api-access-vmmhd\") pod \"test-curl-7447-140657969345568\" (UID: \"12e7d36d-d26f-4b5c-91c9-a7298c1e3310\") " pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:20.871202 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.871149    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmmhd\" (UniqueName: \"kubernetes.io/projected/12e7d36d-d26f-4b5c-91c9-a7298c1e3310-kube-api-access-vmmhd\") pod \"test-curl-7447-140657969345568\" (UID: \"12e7d36d-d26f-4b5c-91c9-a7298c1e3310\") " pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:20.931194 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:20.931157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:21.064772 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:21.064726    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:21.066879 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:59:21.066856    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12e7d36d_d26f_4b5c_91c9_a7298c1e3310.slice/crio-0742aa9405f0f68656c089c972df9d93040b1168cbdceaa103126efce08cc68f WatchSource:0}: Error finding container 0742aa9405f0f68656c089c972df9d93040b1168cbdceaa103126efce08cc68f: Status 404 returned error can't find the container with id 0742aa9405f0f68656c089c972df9d93040b1168cbdceaa103126efce08cc68f
Jul 23 11:59:21.089933 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:21.089903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969345568" event={"ID":"12e7d36d-d26f-4b5c-91c9-a7298c1e3310","Type":"ContainerStarted","Data":"0742aa9405f0f68656c089c972df9d93040b1168cbdceaa103126efce08cc68f"}
Jul 23 11:59:22.096329 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:22.096291    2573 generic.go:356] "Generic (PLEG): container finished" podID="12e7d36d-d26f-4b5c-91c9-a7298c1e3310" containerID="2bb02138653fca102514e9fe81dc41e803c2b1bfd5b3fbb3dd7f4dbf0aadd055" exitCode=0
Jul 23 11:59:22.096704 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:22.096379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969345568" event={"ID":"12e7d36d-d26f-4b5c-91c9-a7298c1e3310","Type":"ContainerDied","Data":"2bb02138653fca102514e9fe81dc41e803c2b1bfd5b3fbb3dd7f4dbf0aadd055"}
Jul 23 11:59:23.244720 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.244689    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:23.267168 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.267142    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140657969345568_12e7d36d-d26f-4b5c-91c9-a7298c1e3310/test-curl-7447-140657969345568/0.log"
Jul 23 11:59:23.290974 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.290939    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:23.294500 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.294475    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:23.387104 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.387005    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmmhd\" (UniqueName: \"kubernetes.io/projected/12e7d36d-d26f-4b5c-91c9-a7298c1e3310-kube-api-access-vmmhd\") pod \"12e7d36d-d26f-4b5c-91c9-a7298c1e3310\" (UID: \"12e7d36d-d26f-4b5c-91c9-a7298c1e3310\") "
Jul 23 11:59:23.389134 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.389110    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e7d36d-d26f-4b5c-91c9-a7298c1e3310-kube-api-access-vmmhd" (OuterVolumeSpecName: "kube-api-access-vmmhd") pod "12e7d36d-d26f-4b5c-91c9-a7298c1e3310" (UID: "12e7d36d-d26f-4b5c-91c9-a7298c1e3310"). InnerVolumeSpecName "kube-api-access-vmmhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:23.417430 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.417397    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:23.417820 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.417805    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e7d36d-d26f-4b5c-91c9-a7298c1e3310" containerName="test-curl-7447-140657969345568"
Jul 23 11:59:23.417874 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.417822    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e7d36d-d26f-4b5c-91c9-a7298c1e3310" containerName="test-curl-7447-140657969345568"
Jul 23 11:59:23.417909 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.417884    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e7d36d-d26f-4b5c-91c9-a7298c1e3310" containerName="test-curl-7447-140657969345568"
Jul 23 11:59:23.420877 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.420856    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:23.428169 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.428135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:23.446946 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.446910    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e7d36d-d26f-4b5c-91c9-a7298c1e3310" path="/var/lib/kubelet/pods/12e7d36d-d26f-4b5c-91c9-a7298c1e3310/volumes"
Jul 23 11:59:23.488309 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.488273    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmmhd\" (UniqueName: \"kubernetes.io/projected/12e7d36d-d26f-4b5c-91c9-a7298c1e3310-kube-api-access-vmmhd\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:23.589398 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.589356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5sdf\" (UniqueName: \"kubernetes.io/projected/3cd23e29-c14f-445b-81e0-d0fe49df9979-kube-api-access-t5sdf\") pod \"test-curl-7447-140657969345568\" (UID: \"3cd23e29-c14f-445b-81e0-d0fe49df9979\") " pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:23.690852 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.690736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5sdf\" (UniqueName: \"kubernetes.io/projected/3cd23e29-c14f-445b-81e0-d0fe49df9979-kube-api-access-t5sdf\") pod \"test-curl-7447-140657969345568\" (UID: \"3cd23e29-c14f-445b-81e0-d0fe49df9979\") " pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:23.699207 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.699172    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5sdf\" (UniqueName: \"kubernetes.io/projected/3cd23e29-c14f-445b-81e0-d0fe49df9979-kube-api-access-t5sdf\") pod \"test-curl-7447-140657969345568\" (UID: \"3cd23e29-c14f-445b-81e0-d0fe49df9979\") " pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:23.732137 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.732098    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:23.868387 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:23.868356    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:23.870257 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:59:23.870224    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cd23e29_c14f_445b_81e0_d0fe49df9979.slice/crio-6d28f1cb3f361e2e1e1af2b0bc98a513e51a7057403a5d57f32e1a604727d035 WatchSource:0}: Error finding container 6d28f1cb3f361e2e1e1af2b0bc98a513e51a7057403a5d57f32e1a604727d035: Status 404 returned error can't find the container with id 6d28f1cb3f361e2e1e1af2b0bc98a513e51a7057403a5d57f32e1a604727d035
Jul 23 11:59:24.108999 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:24.108964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969345568" event={"ID":"3cd23e29-c14f-445b-81e0-d0fe49df9979","Type":"ContainerStarted","Data":"6d28f1cb3f361e2e1e1af2b0bc98a513e51a7057403a5d57f32e1a604727d035"}
Jul 23 11:59:24.110238 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:24.110215    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:24.110366 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:24.110231    2573 scope.go:117] "RemoveContainer" containerID="2bb02138653fca102514e9fe81dc41e803c2b1bfd5b3fbb3dd7f4dbf0aadd055"
Jul 23 11:59:25.118576 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:25.118540    2573 generic.go:356] "Generic (PLEG): container finished" podID="3cd23e29-c14f-445b-81e0-d0fe49df9979" containerID="dbc8ea60b8723d0e9c196d40d404ca7f5b0d83c8f38ffe0a9dd40cadb987f975" exitCode=0
Jul 23 11:59:25.118999 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:25.118613    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969345568" event={"ID":"3cd23e29-c14f-445b-81e0-d0fe49df9979","Type":"ContainerDied","Data":"dbc8ea60b8723d0e9c196d40d404ca7f5b0d83c8f38ffe0a9dd40cadb987f975"}
Jul 23 11:59:26.262092 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.262066    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:26.282413 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.282383    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140657969345568_3cd23e29-c14f-445b-81e0-d0fe49df9979/test-curl-7447-140657969345568/0.log"
Jul 23 11:59:26.303847 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.303808    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:26.307545 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.307515    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140657969345568"]
Jul 23 11:59:26.312315 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.312291    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5sdf\" (UniqueName: \"kubernetes.io/projected/3cd23e29-c14f-445b-81e0-d0fe49df9979-kube-api-access-t5sdf\") pod \"3cd23e29-c14f-445b-81e0-d0fe49df9979\" (UID: \"3cd23e29-c14f-445b-81e0-d0fe49df9979\") "
Jul 23 11:59:26.314316 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.314290    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd23e29-c14f-445b-81e0-d0fe49df9979-kube-api-access-t5sdf" (OuterVolumeSpecName: "kube-api-access-t5sdf") pod "3cd23e29-c14f-445b-81e0-d0fe49df9979" (UID: "3cd23e29-c14f-445b-81e0-d0fe49df9979"). InnerVolumeSpecName "kube-api-access-t5sdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:26.413831 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.413731    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5sdf\" (UniqueName: \"kubernetes.io/projected/3cd23e29-c14f-445b-81e0-d0fe49df9979-kube-api-access-t5sdf\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:26.432605 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.432560    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:26.433060 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.433040    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd23e29-c14f-445b-81e0-d0fe49df9979" containerName="test-curl-7447-140657969345568"
Jul 23 11:59:26.433145 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.433061    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd23e29-c14f-445b-81e0-d0fe49df9979" containerName="test-curl-7447-140657969345568"
Jul 23 11:59:26.433219 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.433175    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd23e29-c14f-445b-81e0-d0fe49df9979" containerName="test-curl-7447-140657969345568"
Jul 23 11:59:26.436331 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.436305    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:26.443646 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.443622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:26.514767 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.514707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wh6j\" (UniqueName: \"kubernetes.io/projected/be02be80-5d46-409e-bbd0-773cca376a67-kube-api-access-4wh6j\") pod \"test-curl-7447-140657969346576\" (UID: \"be02be80-5d46-409e-bbd0-773cca376a67\") " pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:26.615839 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.615798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wh6j\" (UniqueName: \"kubernetes.io/projected/be02be80-5d46-409e-bbd0-773cca376a67-kube-api-access-4wh6j\") pod \"test-curl-7447-140657969346576\" (UID: \"be02be80-5d46-409e-bbd0-773cca376a67\") " pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:26.623996 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.623962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wh6j\" (UniqueName: \"kubernetes.io/projected/be02be80-5d46-409e-bbd0-773cca376a67-kube-api-access-4wh6j\") pod \"test-curl-7447-140657969346576\" (UID: \"be02be80-5d46-409e-bbd0-773cca376a67\") " pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:26.747031 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.746926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:26.882418 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:26.882389    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:26.884248 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:59:26.884217    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe02be80_5d46_409e_bbd0_773cca376a67.slice/crio-972db3a46c38889d5ad80d03572f580477c8d549f4be2eee9ba93fabf35d64aa WatchSource:0}: Error finding container 972db3a46c38889d5ad80d03572f580477c8d549f4be2eee9ba93fabf35d64aa: Status 404 returned error can't find the container with id 972db3a46c38889d5ad80d03572f580477c8d549f4be2eee9ba93fabf35d64aa
Jul 23 11:59:27.132537 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.132506    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:27.132723 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.132545    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d28f1cb3f361e2e1e1af2b0bc98a513e51a7057403a5d57f32e1a604727d035"
Jul 23 11:59:27.133819 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.133788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969346576" event={"ID":"be02be80-5d46-409e-bbd0-773cca376a67","Type":"ContainerStarted","Data":"972db3a46c38889d5ad80d03572f580477c8d549f4be2eee9ba93fabf35d64aa"}
Jul 23 11:59:27.143157 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:59:27.143126    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140657969345568\" is forbidden: User \"system:node:ip-10-0-132-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-77.ec2.internal' and this object" podUID="3cd23e29-c14f-445b-81e0-d0fe49df9979" pod="opendatahub/test-curl-7447-140657969345568"
Jul 23 11:59:27.300820 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.300774    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf" podUID="81f19810-0c1b-46dd-9e69-60184921aa3f" containerName="main" containerID="cri-o://e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8" gracePeriod=45
Jul 23 11:59:27.447728 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.447695    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cd23e29-c14f-445b-81e0-d0fe49df9979" path="/var/lib/kubelet/pods/3cd23e29-c14f-445b-81e0-d0fe49df9979/volumes"
Jul 23 11:59:27.565924 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.565897    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:59:27.622756 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.622693    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-dshm\") pod \"81f19810-0c1b-46dd-9e69-60184921aa3f\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") "
Jul 23 11:59:27.622956 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.622792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-tmp-dir\") pod \"81f19810-0c1b-46dd-9e69-60184921aa3f\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") "
Jul 23 11:59:27.622956 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.622816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-home\") pod \"81f19810-0c1b-46dd-9e69-60184921aa3f\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") "
Jul 23 11:59:27.622956 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.622837    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6jtt\" (UniqueName: \"kubernetes.io/projected/81f19810-0c1b-46dd-9e69-60184921aa3f-kube-api-access-c6jtt\") pod \"81f19810-0c1b-46dd-9e69-60184921aa3f\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") "
Jul 23 11:59:27.622956 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.622888    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f19810-0c1b-46dd-9e69-60184921aa3f-tls-certs\") pod \"81f19810-0c1b-46dd-9e69-60184921aa3f\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") "
Jul 23 11:59:27.623169 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.622988    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-model-cache\") pod \"81f19810-0c1b-46dd-9e69-60184921aa3f\" (UID: \"81f19810-0c1b-46dd-9e69-60184921aa3f\") "
Jul 23 11:59:27.623169 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.623061    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-home" (OuterVolumeSpecName: "home") pod "81f19810-0c1b-46dd-9e69-60184921aa3f" (UID: "81f19810-0c1b-46dd-9e69-60184921aa3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:27.623169 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.623084    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "81f19810-0c1b-46dd-9e69-60184921aa3f" (UID: "81f19810-0c1b-46dd-9e69-60184921aa3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:27.623329 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.623224    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "81f19810-0c1b-46dd-9e69-60184921aa3f" (UID: "81f19810-0c1b-46dd-9e69-60184921aa3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:27.623393 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.623315    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:27.623393 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.623382    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:27.623499 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.623395    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:27.625036 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.625007    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81f19810-0c1b-46dd-9e69-60184921aa3f-kube-api-access-c6jtt" (OuterVolumeSpecName: "kube-api-access-c6jtt") pod "81f19810-0c1b-46dd-9e69-60184921aa3f" (UID: "81f19810-0c1b-46dd-9e69-60184921aa3f"). InnerVolumeSpecName "kube-api-access-c6jtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:27.625172 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.625044    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-dshm" (OuterVolumeSpecName: "dshm") pod "81f19810-0c1b-46dd-9e69-60184921aa3f" (UID: "81f19810-0c1b-46dd-9e69-60184921aa3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:27.625172 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.625049    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81f19810-0c1b-46dd-9e69-60184921aa3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "81f19810-0c1b-46dd-9e69-60184921aa3f" (UID: "81f19810-0c1b-46dd-9e69-60184921aa3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:59:27.724022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.723925    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f19810-0c1b-46dd-9e69-60184921aa3f-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:27.724022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.723956    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6jtt\" (UniqueName: \"kubernetes.io/projected/81f19810-0c1b-46dd-9e69-60184921aa3f-kube-api-access-c6jtt\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:27.724022 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:27.723967    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f19810-0c1b-46dd-9e69-60184921aa3f-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:28.140035 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.139993    2573 generic.go:356] "Generic (PLEG): container finished" podID="be02be80-5d46-409e-bbd0-773cca376a67" containerID="265e164361de56686ad580880e45c1cc720c48a0b180283c0866510984677d4e" exitCode=0
Jul 23 11:59:28.140220 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.140043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969346576" event={"ID":"be02be80-5d46-409e-bbd0-773cca376a67","Type":"ContainerDied","Data":"265e164361de56686ad580880e45c1cc720c48a0b180283c0866510984677d4e"}
Jul 23 11:59:28.141367 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.141342    2573 generic.go:356] "Generic (PLEG): container finished" podID="81f19810-0c1b-46dd-9e69-60184921aa3f" containerID="e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8" exitCode=0
Jul 23 11:59:28.141480 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.141375    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"
Jul 23 11:59:28.141480 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.141421    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf" event={"ID":"81f19810-0c1b-46dd-9e69-60184921aa3f","Type":"ContainerDied","Data":"e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8"}
Jul 23 11:59:28.141480 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.141457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf" event={"ID":"81f19810-0c1b-46dd-9e69-60184921aa3f","Type":"ContainerDied","Data":"5ddf56e2122c48062a1c1a45b3793cd98c376bbc7b76510bacb97050ed8110f5"}
Jul 23 11:59:28.141480 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.141475    2573 scope.go:117] "RemoveContainer" containerID="e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8"
Jul 23 11:59:28.153926 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.153902    2573 scope.go:117] "RemoveContainer" containerID="e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8"
Jul 23 11:59:28.154244 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:59:28.154220    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8\": container with ID starting with e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8 not found: ID does not exist" containerID="e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8"
Jul 23 11:59:28.154310 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.154256    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8"} err="failed to get container status \"e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8\": rpc error: code = NotFound desc = could not find container \"e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8\": container with ID starting with e3e57a0e8dbe256b0fb4158dd73594ea0a028c7719606aecc0926d2c028ec5d8 not found: ID does not exist"
Jul 23 11:59:28.169903 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.169879    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"]
Jul 23 11:59:28.174174 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.174150    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-839b3c/rate-test-model-839b3c-kserve-7479788975-54qzf"]
Jul 23 11:59:28.270872 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.270807    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6" podUID="1adde614-9caf-470b-a218-0344b3dacef0" containerName="main" containerID="cri-o://29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b" gracePeriod=45
Jul 23 11:59:28.518251 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.518225    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:59:28.530598 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.530570    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t425t\" (UniqueName: \"kubernetes.io/projected/1adde614-9caf-470b-a218-0344b3dacef0-kube-api-access-t425t\") pod \"1adde614-9caf-470b-a218-0344b3dacef0\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") "
Jul 23 11:59:28.530793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.530606    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-home\") pod \"1adde614-9caf-470b-a218-0344b3dacef0\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") "
Jul 23 11:59:28.530793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.530660    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-model-cache\") pod \"1adde614-9caf-470b-a218-0344b3dacef0\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") "
Jul 23 11:59:28.530793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.530690    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-tmp-dir\") pod \"1adde614-9caf-470b-a218-0344b3dacef0\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") "
Jul 23 11:59:28.530793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.530712    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-dshm\") pod \"1adde614-9caf-470b-a218-0344b3dacef0\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") "
Jul 23 11:59:28.530793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.530737    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1adde614-9caf-470b-a218-0344b3dacef0-tls-certs\") pod \"1adde614-9caf-470b-a218-0344b3dacef0\" (UID: \"1adde614-9caf-470b-a218-0344b3dacef0\") "
Jul 23 11:59:28.531089 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.531013    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1adde614-9caf-470b-a218-0344b3dacef0" (UID: "1adde614-9caf-470b-a218-0344b3dacef0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:28.531089 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.530999    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-model-cache" (OuterVolumeSpecName: "model-cache") pod "1adde614-9caf-470b-a218-0344b3dacef0" (UID: "1adde614-9caf-470b-a218-0344b3dacef0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:28.531089 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.531051    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-home" (OuterVolumeSpecName: "home") pod "1adde614-9caf-470b-a218-0344b3dacef0" (UID: "1adde614-9caf-470b-a218-0344b3dacef0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:28.533036 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.533009    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1adde614-9caf-470b-a218-0344b3dacef0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1adde614-9caf-470b-a218-0344b3dacef0" (UID: "1adde614-9caf-470b-a218-0344b3dacef0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:59:28.533263 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.533240    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-dshm" (OuterVolumeSpecName: "dshm") pod "1adde614-9caf-470b-a218-0344b3dacef0" (UID: "1adde614-9caf-470b-a218-0344b3dacef0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:59:28.533349 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.533246    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1adde614-9caf-470b-a218-0344b3dacef0-kube-api-access-t425t" (OuterVolumeSpecName: "kube-api-access-t425t") pod "1adde614-9caf-470b-a218-0344b3dacef0" (UID: "1adde614-9caf-470b-a218-0344b3dacef0"). InnerVolumeSpecName "kube-api-access-t425t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:28.631595 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.631559    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t425t\" (UniqueName: \"kubernetes.io/projected/1adde614-9caf-470b-a218-0344b3dacef0-kube-api-access-t425t\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:28.631595 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.631590    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-home\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:28.631595 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.631600    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-model-cache\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:28.631847 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.631610    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-tmp-dir\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:28.631847 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.631618    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1adde614-9caf-470b-a218-0344b3dacef0-dshm\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:28.631847 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:28.631625    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1adde614-9caf-470b-a218-0344b3dacef0-tls-certs\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:29.148569 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.148533    2573 generic.go:356] "Generic (PLEG): container finished" podID="1adde614-9caf-470b-a218-0344b3dacef0" containerID="29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b" exitCode=0
Jul 23 11:59:29.148717 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.148574    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"
Jul 23 11:59:29.148717 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.148613    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6" event={"ID":"1adde614-9caf-470b-a218-0344b3dacef0","Type":"ContainerDied","Data":"29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b"}
Jul 23 11:59:29.148717 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.148652    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6" event={"ID":"1adde614-9caf-470b-a218-0344b3dacef0","Type":"ContainerDied","Data":"53a8c55e4cc9d3de029b0f434911b4db31ff0ca043fd6c62f1b2c21858c71d57"}
Jul 23 11:59:29.148717 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.148669    2573 scope.go:117] "RemoveContainer" containerID="29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b"
Jul 23 11:59:29.158229 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.158208    2573 scope.go:117] "RemoveContainer" containerID="29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b"
Jul 23 11:59:29.158499 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:59:29.158480    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b\": container with ID starting with 29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b not found: ID does not exist" containerID="29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b"
Jul 23 11:59:29.158560 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.158505    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b"} err="failed to get container status \"29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b\": rpc error: code = NotFound desc = could not find container \"29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b\": container with ID starting with 29ace383bb2593d0a5fda421cfa10d784ff44a2b04492e44c88d9d3c4101837b not found: ID does not exist"
Jul 23 11:59:29.170245 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.170213    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"]
Jul 23 11:59:29.172405 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.172380    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c713d8/rate-test-model-c713d8-kserve-6df7f6479f-qp7s6"]
Jul 23 11:59:29.286187 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.286164    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:29.306312 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.306286    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140657969346576_be02be80-5d46-409e-bbd0-773cca376a67/test-curl-7447-140657969346576/0.log"
Jul 23 11:59:29.329281 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.329253    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:29.336214 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.336184    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:29.338733 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.338715    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wh6j\" (UniqueName: \"kubernetes.io/projected/be02be80-5d46-409e-bbd0-773cca376a67-kube-api-access-4wh6j\") pod \"be02be80-5d46-409e-bbd0-773cca376a67\" (UID: \"be02be80-5d46-409e-bbd0-773cca376a67\") "
Jul 23 11:59:29.340689 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.340665    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be02be80-5d46-409e-bbd0-773cca376a67-kube-api-access-4wh6j" (OuterVolumeSpecName: "kube-api-access-4wh6j") pod "be02be80-5d46-409e-bbd0-773cca376a67" (UID: "be02be80-5d46-409e-bbd0-773cca376a67"). InnerVolumeSpecName "kube-api-access-4wh6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:29.440173 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.440077    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wh6j\" (UniqueName: \"kubernetes.io/projected/be02be80-5d46-409e-bbd0-773cca376a67-kube-api-access-4wh6j\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:29.449433 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.449403    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1adde614-9caf-470b-a218-0344b3dacef0" path="/var/lib/kubelet/pods/1adde614-9caf-470b-a218-0344b3dacef0/volumes"
Jul 23 11:59:29.449816 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.449803    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81f19810-0c1b-46dd-9e69-60184921aa3f" path="/var/lib/kubelet/pods/81f19810-0c1b-46dd-9e69-60184921aa3f/volumes"
Jul 23 11:59:29.450110 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.450098    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be02be80-5d46-409e-bbd0-773cca376a67" path="/var/lib/kubelet/pods/be02be80-5d46-409e-bbd0-773cca376a67/volumes"
Jul 23 11:59:29.453133 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453109    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:29.453457 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453436    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be02be80-5d46-409e-bbd0-773cca376a67" containerName="test-curl-7447-140657969346576"
Jul 23 11:59:29.453457 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453450    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="be02be80-5d46-409e-bbd0-773cca376a67" containerName="test-curl-7447-140657969346576"
Jul 23 11:59:29.453543 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453464    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81f19810-0c1b-46dd-9e69-60184921aa3f" containerName="main"
Jul 23 11:59:29.453543 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453470    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="81f19810-0c1b-46dd-9e69-60184921aa3f" containerName="main"
Jul 23 11:59:29.453543 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453488    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1adde614-9caf-470b-a218-0344b3dacef0" containerName="main"
Jul 23 11:59:29.453543 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453493    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1adde614-9caf-470b-a218-0344b3dacef0" containerName="main"
Jul 23 11:59:29.453687 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453548    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="be02be80-5d46-409e-bbd0-773cca376a67" containerName="test-curl-7447-140657969346576"
Jul 23 11:59:29.453687 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453558    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1adde614-9caf-470b-a218-0344b3dacef0" containerName="main"
Jul 23 11:59:29.453687 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.453566    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="81f19810-0c1b-46dd-9e69-60184921aa3f" containerName="main"
Jul 23 11:59:29.456919 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.456905    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:29.460680 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.460659    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:29.540517 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.540477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pxrd\" (UniqueName: \"kubernetes.io/projected/e8c02797-e83e-40ef-b323-acc6583e27d7-kube-api-access-6pxrd\") pod \"test-curl-7447-140657969346576\" (UID: \"e8c02797-e83e-40ef-b323-acc6583e27d7\") " pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:29.641738 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.641701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pxrd\" (UniqueName: \"kubernetes.io/projected/e8c02797-e83e-40ef-b323-acc6583e27d7-kube-api-access-6pxrd\") pod \"test-curl-7447-140657969346576\" (UID: \"e8c02797-e83e-40ef-b323-acc6583e27d7\") " pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:29.649186 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.649153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pxrd\" (UniqueName: \"kubernetes.io/projected/e8c02797-e83e-40ef-b323-acc6583e27d7-kube-api-access-6pxrd\") pod \"test-curl-7447-140657969346576\" (UID: \"e8c02797-e83e-40ef-b323-acc6583e27d7\") " pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:29.768089 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.768000    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:29.901348 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:29.901288    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:29.903424 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:59:29.903396    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8c02797_e83e_40ef_b323_acc6583e27d7.slice/crio-09b3869cf7f26e1b250b3ae069ff45df77fe0e752bf342ad6b16787b4c2eab59 WatchSource:0}: Error finding container 09b3869cf7f26e1b250b3ae069ff45df77fe0e752bf342ad6b16787b4c2eab59: Status 404 returned error can't find the container with id 09b3869cf7f26e1b250b3ae069ff45df77fe0e752bf342ad6b16787b4c2eab59
Jul 23 11:59:30.155375 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:30.155338    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:30.155572 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:30.155395    2573 scope.go:117] "RemoveContainer" containerID="265e164361de56686ad580880e45c1cc720c48a0b180283c0866510984677d4e"
Jul 23 11:59:30.157929 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:30.157897    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969346576" event={"ID":"e8c02797-e83e-40ef-b323-acc6583e27d7","Type":"ContainerStarted","Data":"09b3869cf7f26e1b250b3ae069ff45df77fe0e752bf342ad6b16787b4c2eab59"}
Jul 23 11:59:31.165449 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:31.165416    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8c02797-e83e-40ef-b323-acc6583e27d7" containerID="2bb44020e2ae94e415d1e8b556aff1fc437a7b70ec65d45ff93d775426888ebf" exitCode=0
Jul 23 11:59:31.165925 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:31.165501    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969346576" event={"ID":"e8c02797-e83e-40ef-b323-acc6583e27d7","Type":"ContainerDied","Data":"2bb44020e2ae94e415d1e8b556aff1fc437a7b70ec65d45ff93d775426888ebf"}
Jul 23 11:59:32.309434 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:32.309406    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:32.331298 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:32.331276    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140657969346576_e8c02797-e83e-40ef-b323-acc6583e27d7/test-curl-7447-140657969346576/0.log"
Jul 23 11:59:32.355724 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:32.355687    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:32.361504 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:32.361475    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140657969346576"]
Jul 23 11:59:32.365359 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:32.365338    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pxrd\" (UniqueName: \"kubernetes.io/projected/e8c02797-e83e-40ef-b323-acc6583e27d7-kube-api-access-6pxrd\") pod \"e8c02797-e83e-40ef-b323-acc6583e27d7\" (UID: \"e8c02797-e83e-40ef-b323-acc6583e27d7\") "
Jul 23 11:59:32.367375 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:32.367347    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c02797-e83e-40ef-b323-acc6583e27d7-kube-api-access-6pxrd" (OuterVolumeSpecName: "kube-api-access-6pxrd") pod "e8c02797-e83e-40ef-b323-acc6583e27d7" (UID: "e8c02797-e83e-40ef-b323-acc6583e27d7"). InnerVolumeSpecName "kube-api-access-6pxrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:32.467032 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:32.466927    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pxrd\" (UniqueName: \"kubernetes.io/projected/e8c02797-e83e-40ef-b323-acc6583e27d7-kube-api-access-6pxrd\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:33.179527 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:33.179496    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:33.179683 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:33.179542    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09b3869cf7f26e1b250b3ae069ff45df77fe0e752bf342ad6b16787b4c2eab59"
Jul 23 11:59:33.188851 ip-10-0-132-77 kubenswrapper[2573]: E0723 11:59:33.188818    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140657969346576\" is forbidden: User \"system:node:ip-10-0-132-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-77.ec2.internal' and this object" podUID="e8c02797-e83e-40ef-b323-acc6583e27d7" pod="opendatahub/test-curl-7447-140657969346576"
Jul 23 11:59:33.452473 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:33.452395    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c02797-e83e-40ef-b323-acc6583e27d7" path="/var/lib/kubelet/pods/e8c02797-e83e-40ef-b323-acc6583e27d7/volumes"
Jul 23 11:59:54.965873 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.965834    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"]
Jul 23 11:59:54.966283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.966188    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c02797-e83e-40ef-b323-acc6583e27d7" containerName="test-curl-7447-140657969346576"
Jul 23 11:59:54.966283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.966199    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c02797-e83e-40ef-b323-acc6583e27d7" containerName="test-curl-7447-140657969346576"
Jul 23 11:59:54.966283 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.966279    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c02797-e83e-40ef-b323-acc6583e27d7" containerName="test-curl-7447-140657969346576"
Jul 23 11:59:54.971524 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.971506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"
Jul 23 11:59:54.974502 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.974473    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 11:59:54.975243 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.975220    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:59:54.978399 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:54.978377    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"]
Jul 23 11:59:55.080929 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:55.080894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d5380f-55ad-4933-a8ca-5f757cc05799-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc\" (UID: \"d9d5380f-55ad-4933-a8ca-5f757cc05799\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"
Jul 23 11:59:55.182099 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:55.182061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d5380f-55ad-4933-a8ca-5f757cc05799-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc\" (UID: \"d9d5380f-55ad-4933-a8ca-5f757cc05799\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"
Jul 23 11:59:55.182662 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:55.182642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d5380f-55ad-4933-a8ca-5f757cc05799-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc\" (UID: \"d9d5380f-55ad-4933-a8ca-5f757cc05799\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"
Jul 23 11:59:55.283512 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:55.283432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"
Jul 23 11:59:55.459840 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:55.459816    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"]
Jul 23 11:59:55.461544 ip-10-0-132-77 kubenswrapper[2573]: W0723 11:59:55.461514    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d5380f_55ad_4933_a8ca_5f757cc05799.slice/crio-8be9052b77e0d83114ef9d36b35d12ae00178a77bd8a2ea92e143c01b511fe94 WatchSource:0}: Error finding container 8be9052b77e0d83114ef9d36b35d12ae00178a77bd8a2ea92e143c01b511fe94: Status 404 returned error can't find the container with id 8be9052b77e0d83114ef9d36b35d12ae00178a77bd8a2ea92e143c01b511fe94
Jul 23 11:59:56.312897 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:56.312862    2573 generic.go:356] "Generic (PLEG): container finished" podID="d9d5380f-55ad-4933-a8ca-5f757cc05799" containerID="cdb4b20ba6613507a978e652d98afe81464e3393fdc25d80b2122cc1d5954268" exitCode=0
Jul 23 11:59:56.313260 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:56.312912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc" event={"ID":"d9d5380f-55ad-4933-a8ca-5f757cc05799","Type":"ContainerDied","Data":"cdb4b20ba6613507a978e652d98afe81464e3393fdc25d80b2122cc1d5954268"}
Jul 23 11:59:56.313260 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:56.312954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc" event={"ID":"d9d5380f-55ad-4933-a8ca-5f757cc05799","Type":"ContainerStarted","Data":"8be9052b77e0d83114ef9d36b35d12ae00178a77bd8a2ea92e143c01b511fe94"}
Jul 23 11:59:57.454793 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:57.454767    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"
Jul 23 11:59:57.602704 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:57.602617    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d5380f-55ad-4933-a8ca-5f757cc05799-maas-api-service-ca\") pod \"d9d5380f-55ad-4933-a8ca-5f757cc05799\" (UID: \"d9d5380f-55ad-4933-a8ca-5f757cc05799\") "
Jul 23 11:59:57.603056 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:57.603015    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d5380f-55ad-4933-a8ca-5f757cc05799-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d9d5380f-55ad-4933-a8ca-5f757cc05799" (UID: "d9d5380f-55ad-4933-a8ca-5f757cc05799"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:59:57.704071 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:57.704032    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d5380f-55ad-4933-a8ca-5f757cc05799-maas-api-service-ca\") on node \"ip-10-0-132-77.ec2.internal\" DevicePath \"\""
Jul 23 11:59:58.326303 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:58.326274    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"
Jul 23 11:59:58.326483 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:58.326318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc" event={"ID":"d9d5380f-55ad-4933-a8ca-5f757cc05799","Type":"ContainerDied","Data":"8be9052b77e0d83114ef9d36b35d12ae00178a77bd8a2ea92e143c01b511fe94"}
Jul 23 11:59:58.326483 ip-10-0-132-77 kubenswrapper[2573]: I0723 11:59:58.326366    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8be9052b77e0d83114ef9d36b35d12ae00178a77bd8a2ea92e143c01b511fe94"
Jul 23 12:00:10.036348 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:10.036305    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"]
Jul 23 12:00:10.039446 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:10.039423    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c713d8-jhfrc"]
Jul 23 12:00:11.446187 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:11.446149    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d5380f-55ad-4933-a8ca-5f757cc05799" path="/var/lib/kubelet/pods/d9d5380f-55ad-4933-a8ca-5f757cc05799/volumes"
Jul 23 12:00:17.600727 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:17.600691    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79546bd658-hwkpn_8620dc8b-c744-4501-b8a5-cc5980645a57/authorino/0.log"
Jul 23 12:00:23.647028 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:23.646999    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-47zcv_deaa815d-2ee3-4c9f-b2bc-0c43a334fa32/copy-manifests/0.log"
Jul 23 12:00:23.656381 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:23.656353    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-47zcv_deaa815d-2ee3-4c9f-b2bc-0c43a334fa32/manager/0.log"
Jul 23 12:00:24.378191 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:24.378152    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746770-cxs66_b316b154-a039-410c-ac54-e91222ae9dfc/cleanup/0.log"
Jul 23 12:00:25.509827 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.509788    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk_3dd3a9bb-6af4-4a09-9267-c02cd297c564/extract/0.log"
Jul 23 12:00:25.516410 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.516381    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk_3dd3a9bb-6af4-4a09-9267-c02cd297c564/util/0.log"
Jul 23 12:00:25.523219 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.523198    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk_3dd3a9bb-6af4-4a09-9267-c02cd297c564/pull/0.log"
Jul 23 12:00:25.629345 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.629312    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr_32b01c9a-a9f6-4854-b665-3c462960e204/util/0.log"
Jul 23 12:00:25.636598 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.636574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr_32b01c9a-a9f6-4854-b665-3c462960e204/pull/0.log"
Jul 23 12:00:25.641536 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.641513    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr_32b01c9a-a9f6-4854-b665-3c462960e204/extract/0.log"
Jul 23 12:00:25.747500 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.747470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l_e5a20c7c-6b3e-4469-8e6e-2d087b32a994/util/0.log"
Jul 23 12:00:25.753172 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.753149    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l_e5a20c7c-6b3e-4469-8e6e-2d087b32a994/pull/0.log"
Jul 23 12:00:25.758804 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.758784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l_e5a20c7c-6b3e-4469-8e6e-2d087b32a994/extract/0.log"
Jul 23 12:00:25.889520 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.889484    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt_35388e0c-7784-4c14-85e3-d92aafbb50db/extract/0.log"
Jul 23 12:00:25.895183 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.895160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt_35388e0c-7784-4c14-85e3-d92aafbb50db/util/0.log"
Jul 23 12:00:25.900789 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:25.900766    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt_35388e0c-7784-4c14-85e3-d92aafbb50db/pull/0.log"
Jul 23 12:00:26.018525 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:26.018496    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79546bd658-hwkpn_8620dc8b-c744-4501-b8a5-cc5980645a57/authorino/0.log"
Jul 23 12:00:26.618170 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:26.618137    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6c6kt_0914cb53-90f4-4667-a86f-86a4af6eded8/manager/0.log"
Jul 23 12:00:27.586439 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:27.586407    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-shj5w_12f59d2e-c77e-49ad-8e96-43d350a35268/kube-auth-proxy/0.log"
Jul 23 12:00:28.502404 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:28.502373    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-d2vz8_60b58d86-25d6-488a-abe5-20293ecdb4ee/main/0.log"
Jul 23 12:00:28.947044 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:28.947014    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-cztbf_1a345d43-524b-40e0-9cd5-4afb2cdf022a/main/0.log"
Jul 23 12:00:34.095932 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.095895    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j8hbw/must-gather-2lf6c"]
Jul 23 12:00:34.096296 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.096255    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d5380f-55ad-4933-a8ca-5f757cc05799" containerName="revoke-keys"
Jul 23 12:00:34.096296 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.096266    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d5380f-55ad-4933-a8ca-5f757cc05799" containerName="revoke-keys"
Jul 23 12:00:34.096366 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.096329    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d5380f-55ad-4933-a8ca-5f757cc05799" containerName="revoke-keys"
Jul 23 12:00:34.099133 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.099117    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.101864 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.101835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8hbw\"/\"openshift-service-ca.crt\""
Jul 23 12:00:34.102368 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.102347    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j8hbw\"/\"default-dockercfg-5ql9l\""
Jul 23 12:00:34.108329 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.108308    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8hbw\"/\"kube-root-ca.crt\""
Jul 23 12:00:34.127085 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.127061    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8hbw/must-gather-2lf6c"]
Jul 23 12:00:34.216477 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.216442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/94536639-35ad-4908-91bb-59bb1d183c13-must-gather-output\") pod \"must-gather-2lf6c\" (UID: \"94536639-35ad-4908-91bb-59bb1d183c13\") " pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.216672 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.216494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r25pk\" (UniqueName: \"kubernetes.io/projected/94536639-35ad-4908-91bb-59bb1d183c13-kube-api-access-r25pk\") pod \"must-gather-2lf6c\" (UID: \"94536639-35ad-4908-91bb-59bb1d183c13\") " pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.317932 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.317900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/94536639-35ad-4908-91bb-59bb1d183c13-must-gather-output\") pod \"must-gather-2lf6c\" (UID: \"94536639-35ad-4908-91bb-59bb1d183c13\") " pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.318113 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.317951    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r25pk\" (UniqueName: \"kubernetes.io/projected/94536639-35ad-4908-91bb-59bb1d183c13-kube-api-access-r25pk\") pod \"must-gather-2lf6c\" (UID: \"94536639-35ad-4908-91bb-59bb1d183c13\") " pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.318310 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.318285    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/94536639-35ad-4908-91bb-59bb1d183c13-must-gather-output\") pod \"must-gather-2lf6c\" (UID: \"94536639-35ad-4908-91bb-59bb1d183c13\") " pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.331726 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.331701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r25pk\" (UniqueName: \"kubernetes.io/projected/94536639-35ad-4908-91bb-59bb1d183c13-kube-api-access-r25pk\") pod \"must-gather-2lf6c\" (UID: \"94536639-35ad-4908-91bb-59bb1d183c13\") " pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.409077 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.409040    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8hbw/must-gather-2lf6c"
Jul 23 12:00:34.549623 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:34.549592    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8hbw/must-gather-2lf6c"]
Jul 23 12:00:34.551981 ip-10-0-132-77 kubenswrapper[2573]: W0723 12:00:34.551952    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94536639_35ad_4908_91bb_59bb1d183c13.slice/crio-43d1a3adb94582293579fad997dd45caaf0b34b798d41da175ca8ac7fa87aef3 WatchSource:0}: Error finding container 43d1a3adb94582293579fad997dd45caaf0b34b798d41da175ca8ac7fa87aef3: Status 404 returned error can't find the container with id 43d1a3adb94582293579fad997dd45caaf0b34b798d41da175ca8ac7fa87aef3
Jul 23 12:00:35.534514 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:35.534477    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8hbw/must-gather-2lf6c" event={"ID":"94536639-35ad-4908-91bb-59bb1d183c13","Type":"ContainerStarted","Data":"43d1a3adb94582293579fad997dd45caaf0b34b798d41da175ca8ac7fa87aef3"}
Jul 23 12:00:36.542667 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:36.542615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8hbw/must-gather-2lf6c" event={"ID":"94536639-35ad-4908-91bb-59bb1d183c13","Type":"ContainerStarted","Data":"81287098484c45243fec0ba85b0e1290dc68345e34eef4854d1be542cedee2a4"}
Jul 23 12:00:36.543266 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:36.543238    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8hbw/must-gather-2lf6c" event={"ID":"94536639-35ad-4908-91bb-59bb1d183c13","Type":"ContainerStarted","Data":"b372b57610b1a6f03c6e14b67d4e223fea1c5111e19bdb2d84f97d0a59f7c871"}
Jul 23 12:00:36.563296 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:36.562570    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j8hbw/must-gather-2lf6c" podStartSLOduration=1.585052642 podStartE2EDuration="2.562550369s" totalImagesPullingTime="977.497727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:00:36.560988345 +0000 UTC m=+3051.607085463" watchObservedRunningTime="2026-07-23 12:00:36.562550369 +0000 UTC m=+3051.608647483"
Jul 23 12:00:37.213085 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:37.213056    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2wpkx_42b0290a-0169-43a6-bc50-7ef9f3a83307/global-pull-secret-syncer/0.log"
Jul 23 12:00:37.378583 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:37.378551    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6swv4_6ae831ed-40dd-4963-a986-39bd625bc6b2/konnectivity-agent/0.log"
Jul 23 12:00:37.483759 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:37.483647    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-77.ec2.internal_4b32f8d5cefe9b5ce058a0460b5a27a5/haproxy/0.log"
Jul 23 12:00:41.719936 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.719893    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk_3dd3a9bb-6af4-4a09-9267-c02cd297c564/extract/0.log"
Jul 23 12:00:41.744149 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.744123    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk_3dd3a9bb-6af4-4a09-9267-c02cd297c564/util/0.log"
Jul 23 12:00:41.773166 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.773079    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tk6pk_3dd3a9bb-6af4-4a09-9267-c02cd297c564/pull/0.log"
Jul 23 12:00:41.802584 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.802525    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr_32b01c9a-a9f6-4854-b665-3c462960e204/extract/0.log"
Jul 23 12:00:41.828355 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.828320    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr_32b01c9a-a9f6-4854-b665-3c462960e204/util/0.log"
Jul 23 12:00:41.852135 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.852016    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mqwsr_32b01c9a-a9f6-4854-b665-3c462960e204/pull/0.log"
Jul 23 12:00:41.879959 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.879931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l_e5a20c7c-6b3e-4469-8e6e-2d087b32a994/extract/0.log"
Jul 23 12:00:41.904661 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.904632    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l_e5a20c7c-6b3e-4469-8e6e-2d087b32a994/util/0.log"
Jul 23 12:00:41.930044 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.929971    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wqp5l_e5a20c7c-6b3e-4469-8e6e-2d087b32a994/pull/0.log"
Jul 23 12:00:41.963326 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.963243    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt_35388e0c-7784-4c14-85e3-d92aafbb50db/extract/0.log"
Jul 23 12:00:41.989973 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:41.989872    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt_35388e0c-7784-4c14-85e3-d92aafbb50db/util/0.log"
Jul 23 12:00:42.015939 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:42.015912    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zkrvt_35388e0c-7784-4c14-85e3-d92aafbb50db/pull/0.log"
Jul 23 12:00:42.518768 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:42.518067    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79546bd658-hwkpn_8620dc8b-c744-4501-b8a5-cc5980645a57/authorino/0.log"
Jul 23 12:00:42.889052 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:42.889013    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6c6kt_0914cb53-90f4-4667-a86f-86a4af6eded8/manager/0.log"
Jul 23 12:00:45.000213 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.000124    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-7qr2l_cb0e899f-0f78-4288-bf6d-7ac94c73386f/cluster-monitoring-operator/0.log"
Jul 23 12:00:45.120190 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.120156    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6ffb9cc84b-vtjgk_ac65196e-a4cb-48aa-95ae-8abdb94579f9/metrics-server/0.log"
Jul 23 12:00:45.149000 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.148950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-v9qs9_dd80ade5-ea41-4734-abad-ae7925376ce2/monitoring-plugin/0.log"
Jul 23 12:00:45.267863 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.267791    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ncdj_d4b5dba3-0f7f-43ad-944d-d1c37dea755f/node-exporter/0.log"
Jul 23 12:00:45.290157 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.290126    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ncdj_d4b5dba3-0f7f-43ad-944d-d1c37dea755f/kube-rbac-proxy/0.log"
Jul 23 12:00:45.311253 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.311219    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ncdj_d4b5dba3-0f7f-43ad-944d-d1c37dea755f/init-textfile/0.log"
Jul 23 12:00:45.690200 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.690168    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-94nn6_357a8498-0cd2-42f9-a253-6f6435d28391/prometheus-operator/0.log"
Jul 23 12:00:45.714925 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.714881    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-94nn6_357a8498-0cd2-42f9-a253-6f6435d28391/kube-rbac-proxy/0.log"
Jul 23 12:00:45.803764 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.802931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7885667b-bj2nt_e9677000-e87d-4764-a2c4-5cada4ff810a/telemeter-client/0.log"
Jul 23 12:00:45.824509 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.824481    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7885667b-bj2nt_e9677000-e87d-4764-a2c4-5cada4ff810a/reload/0.log"
Jul 23 12:00:45.847684 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.847650    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7885667b-bj2nt_e9677000-e87d-4764-a2c4-5cada4ff810a/kube-rbac-proxy/0.log"
Jul 23 12:00:45.878915 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.878867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff9bf56c-mwxgs_dedf664a-5d8e-4105-80ae-9c034752ad69/thanos-query/0.log"
Jul 23 12:00:45.902222 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.902187    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff9bf56c-mwxgs_dedf664a-5d8e-4105-80ae-9c034752ad69/kube-rbac-proxy-web/0.log"
Jul 23 12:00:45.925197 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.925142    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff9bf56c-mwxgs_dedf664a-5d8e-4105-80ae-9c034752ad69/kube-rbac-proxy/0.log"
Jul 23 12:00:45.946031 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.945942    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff9bf56c-mwxgs_dedf664a-5d8e-4105-80ae-9c034752ad69/prom-label-proxy/0.log"
Jul 23 12:00:45.968324 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.968292    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff9bf56c-mwxgs_dedf664a-5d8e-4105-80ae-9c034752ad69/kube-rbac-proxy-rules/0.log"
Jul 23 12:00:45.993498 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:45.993470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff9bf56c-mwxgs_dedf664a-5d8e-4105-80ae-9c034752ad69/kube-rbac-proxy-metrics/0.log"
Jul 23 12:00:47.217011 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:47.216975    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-m8ckh_f54c2d77-7029-4781-9689-2e27591917a4/networking-console-plugin/0.log"
Jul 23 12:00:47.943524 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:47.943489    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"]
Jul 23 12:00:47.947018 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:47.946989    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:47.969022 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:47.968983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"]
Jul 23 12:00:48.090331 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.090295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-sys\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.090503 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.090336    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-proc\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.090503 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.090371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcct5\" (UniqueName: \"kubernetes.io/projected/615b44c0-31c9-4445-b155-fd9a67e77c2b-kube-api-access-jcct5\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.090503 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.090460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-podres\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.090689 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.090510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-lib-modules\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191316 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-podres\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191494 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-lib-modules\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191494 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-sys\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191494 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-proc\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191494 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcct5\" (UniqueName: \"kubernetes.io/projected/615b44c0-31c9-4445-b155-fd9a67e77c2b-kube-api-access-jcct5\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191494 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-podres\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191674 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191471    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-sys\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191674 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191496    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-proc\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.191674 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.191527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/615b44c0-31c9-4445-b155-fd9a67e77c2b-lib-modules\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.200794 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.200695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcct5\" (UniqueName: \"kubernetes.io/projected/615b44c0-31c9-4445-b155-fd9a67e77c2b-kube-api-access-jcct5\") pod \"perf-node-gather-daemonset-g6k6s\" (UID: \"615b44c0-31c9-4445-b155-fd9a67e77c2b\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.261768 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.261697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.444609 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.444581    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"]
Jul 23 12:00:48.512234 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.512201    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-c5fff_33e29d1b-9400-4ab0-ac0e-d64e3bde1cd3/download-server/0.log"
Jul 23 12:00:48.650125 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.650082    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s" event={"ID":"615b44c0-31c9-4445-b155-fd9a67e77c2b","Type":"ContainerStarted","Data":"2d525d57f79094f1d7959acedae900495458eac5de9e5be786e1d8f8dd549800"}
Jul 23 12:00:48.650331 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.650269    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:48.650331 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.650320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s" event={"ID":"615b44c0-31c9-4445-b155-fd9a67e77c2b","Type":"ContainerStarted","Data":"c954fbb84cd303c618ac401b116740405cbc88da2667cc0ded76dfe6646ed349"}
Jul 23 12:00:48.671242 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:48.671163    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s" podStartSLOduration=1.671140632 podStartE2EDuration="1.671140632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:00:48.668555631 +0000 UTC m=+3063.714652745" watchObservedRunningTime="2026-07-23 12:00:48.671140632 +0000 UTC m=+3063.717237747"
Jul 23 12:00:50.214194 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:50.214161    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ng7nf_daec44b2-0237-448c-937f-df1659664a2b/dns/0.log"
Jul 23 12:00:50.236294 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:50.236237    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ng7nf_daec44b2-0237-448c-937f-df1659664a2b/kube-rbac-proxy/0.log"
Jul 23 12:00:50.306601 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:50.306574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4ksk_aab107ec-362a-46b6-8bf0-cd3bebfcc169/dns-node-resolver/0.log"
Jul 23 12:00:50.858253 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:50.858224    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bc655_27c2e954-39ee-42f6-91f5-29b5a62ae5ed/node-ca/0.log"
Jul 23 12:00:52.074270 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:52.074238    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-shj5w_12f59d2e-c77e-49ad-8e96-43d350a35268/kube-auth-proxy/0.log"
Jul 23 12:00:52.940876 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:52.940844    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2q4xk_ce6cec9b-d877-44dc-8e1b-1a08277d7cc0/serve-healthcheck-canary/0.log"
Jul 23 12:00:53.498223 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:53.498184    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5rb5v_8cdef970-2bd2-446e-86ac-fb804aee181e/insights-operator/0.log"
Jul 23 12:00:53.498732 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:53.498550    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5rb5v_8cdef970-2bd2-446e-86ac-fb804aee181e/insights-operator/1.log"
Jul 23 12:00:53.523712 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:53.523683    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8dz5_3f076788-01f9-4b1e-81b2-1b916ce9a4d7/kube-rbac-proxy/0.log"
Jul 23 12:00:53.546691 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:53.546666    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8dz5_3f076788-01f9-4b1e-81b2-1b916ce9a4d7/exporter/0.log"
Jul 23 12:00:53.574068 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:53.574035    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8dz5_3f076788-01f9-4b1e-81b2-1b916ce9a4d7/extractor/0.log"
Jul 23 12:00:54.667623 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:54.667593    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-g6k6s"
Jul 23 12:00:56.401388 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:56.401353    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-47zcv_deaa815d-2ee3-4c9f-b2bc-0c43a334fa32/manager/0.log"
Jul 23 12:00:56.424345 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:56.424321    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-47zcv_deaa815d-2ee3-4c9f-b2bc-0c43a334fa32/copy-manifests/0.log"
Jul 23 12:00:57.977898 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:57.977860    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57b4b866cd-9p75g_762204db-d4c8-47e5-9b06-df0b3ca59061/manager/0.log"
Jul 23 12:00:58.346777 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:58.346725    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-shj5w_12f59d2e-c77e-49ad-8e96-43d350a35268/kube-auth-proxy/0.log"
Jul 23 12:00:59.860948 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:00:59.860864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-shj5w_12f59d2e-c77e-49ad-8e96-43d350a35268/kube-auth-proxy/0.log"
Jul 23 12:01:03.113391 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:03.113358    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-bjd2g_e6106ffb-5dc6-469f-83de-1d5d3487f63e/migrator/0.log"
Jul 23 12:01:03.154304 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:03.154271    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-bjd2g_e6106ffb-5dc6-469f-83de-1d5d3487f63e/graceful-termination/0.log"
Jul 23 12:01:03.643593 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:03.643562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-qjqsm_9de299b5-15a1-435a-948b-1aa2653e8c20/kube-storage-version-migrator-operator/1.log"
Jul 23 12:01:03.644776 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:03.644736    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-qjqsm_9de299b5-15a1-435a-948b-1aa2653e8c20/kube-storage-version-migrator-operator/0.log"
Jul 23 12:01:04.880033 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:04.880001    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6x45g_5590e4e5-e701-4509-bea1-6b76bc99f091/kube-multus-additional-cni-plugins/0.log"
Jul 23 12:01:04.908018 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:04.907989    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6x45g_5590e4e5-e701-4509-bea1-6b76bc99f091/egress-router-binary-copy/0.log"
Jul 23 12:01:04.928082 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:04.928055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6x45g_5590e4e5-e701-4509-bea1-6b76bc99f091/cni-plugins/0.log"
Jul 23 12:01:04.948353 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:04.948323    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6x45g_5590e4e5-e701-4509-bea1-6b76bc99f091/bond-cni-plugin/0.log"
Jul 23 12:01:04.968241 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:04.968212    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6x45g_5590e4e5-e701-4509-bea1-6b76bc99f091/routeoverride-cni/0.log"
Jul 23 12:01:04.996609 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:04.996580    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6x45g_5590e4e5-e701-4509-bea1-6b76bc99f091/whereabouts-cni-bincopy/0.log"
Jul 23 12:01:05.027358 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:05.027271    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6x45g_5590e4e5-e701-4509-bea1-6b76bc99f091/whereabouts-cni/0.log"
Jul 23 12:01:05.232060 ip-10-0-132-77 kubenswrapper[2573]: I0723 12:01:05.232030    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-szjts_88de2d63-6b8d-47f4-8fe1-12e15cfffa10/kube-multus/0.log"