Jul 07 12:48:31.628804 ip-10-0-135-39 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 12:48:31.988100 ip-10-0-135-39 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 12:48:31.988100 ip-10-0-135-39 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 12:48:31.988100 ip-10-0-135-39 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 12:48:31.988100 ip-10-0-135-39 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 12:48:31.988100 ip-10-0-135-39 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 12:48:31.989049 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.988963    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 12:48:31.993793 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993776    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 12:48:31.993793 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993793    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993797    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993800    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993804    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993807    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993810    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993812    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993818    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993822    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993826    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993829    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993833    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993836    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993839    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993841    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993844    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993847    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993850    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993853    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 12:48:31.993860 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993856    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993859    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993862    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993865    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993868    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993871    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993874    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993877    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993880    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993882    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993885    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993888    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993890    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993893    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993897    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993900    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993903    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993906    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993909    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 12:48:31.994292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993912    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993914    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993918    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993920    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993923    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993925    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993928    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993930    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993933    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993935    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993937    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993940    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993943    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993945    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993948    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993951    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993954    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993956    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993959    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993961    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 12:48:31.994762 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993964    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993966    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993969    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993971    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993974    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993976    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993979    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993981    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993984    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993986    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993989    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993991    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993994    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993997    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.993999    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994002    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994005    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994008    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994010    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994013    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 12:48:31.995248 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994016    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994018    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994021    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994024    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994026    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994030    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994033    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994037    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994040    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994043    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994045    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994049    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994051    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994054    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994057    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994059    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994062    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994064    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994067    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 12:48:31.995724 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.994069    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 12:48:31.996249 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996237    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 12:48:31.996249 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996249    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996252    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996255    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996258    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996261    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996266    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996269    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996273    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996275    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996278    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996281    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996283    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996286    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996288    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996291    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996293    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996296    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996299    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996301    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 12:48:31.996303 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996304    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996307    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996310    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996313    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996316    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996319    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996321    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996324    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996326    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996329    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996331    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996334    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996336    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996338    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996341    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996343    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996346    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996349    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996351    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996354    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 12:48:31.996817 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996357    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996359    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996362    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996364    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996367    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996369    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996371    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996374    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996376    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996379    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996381    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996384    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996387    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996389    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996393    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996395    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996398    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996401    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996405    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996408    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 12:48:31.997297 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996410    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996414    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996418    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996421    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996424    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996426    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996429    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996432    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996434    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996437    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996440    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996443    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996446    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996449    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996451    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996455    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996457    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996460    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996463    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 12:48:31.997908 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996465    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996468    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996471    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996474    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996476    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996481    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996484    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996487    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996490    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996493    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996496    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996499    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996502    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996520    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996523    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996526    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996529    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996531    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996534    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996537    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 12:48:31.998369 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996906    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996910    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996913    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996916    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996919    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996922    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996925    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996927    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996930    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996932    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996935    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996938    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996940    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996943    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996946    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996948    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996951    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996954    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996957    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996959    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 12:48:31.998883 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996962    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996964    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996967    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996970    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996972    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996975    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996977    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996980    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996982    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996986    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996990    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996993    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996995    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.996999    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997002    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997005    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997008    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997011    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997013    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 12:48:31.999356 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997016    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997019    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997022    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997025    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997027    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997030    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997033    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997035    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997038    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997040    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997043    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997045    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997048    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997050    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997053    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997055    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997058    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997061    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997063    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997066    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 12:48:31.999814 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997068    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997071    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997073    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997076    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997078    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997080    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997083    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997085    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997088    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997091    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997094    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997098    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997101    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997104    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997107    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997109    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997112    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997115    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997117    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 12:48:32.000287 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997120    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997122    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997125    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997127    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997130    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997132    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997134    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997139    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997142    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997144    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997147    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997149    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997151    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997154    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997158    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997161    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997164    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997166    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997169    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997172    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 12:48:32.000748 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997175    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997243    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997250    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997255    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997260    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997264    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997268    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997273    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997278    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997281    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997284    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997287    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997291    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997294    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997296    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997299    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997302    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997305    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997308    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997313    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997316    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997320    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997323    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997326    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 12:48:32.001220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997329    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997332    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997335    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997339    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997342    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997345    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997347    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997351    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997354    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997357    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997360    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997364    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997370    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997373    2580 flags.go:64] FLAG: --enable-server="true"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997376    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997380    2580 flags.go:64] FLAG: --event-burst="100"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997383    2580 flags.go:64] FLAG: --event-qps="50"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997386    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997389    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997392    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997396    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997398    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997401    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997404    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997407    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 12:48:32.001830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997410    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997413    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997416    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997419    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997422    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997425    2580 flags.go:64] FLAG: --feature-gates=""
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997428    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997431    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997435    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997438    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997441    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997443    2580 flags.go:64] FLAG: --help="false"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997446    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997449    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997452    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997455    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997458    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997461    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997464    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997468    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997471    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997474    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997477    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997481    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 12:48:32.002440 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997483    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997486    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997489    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997492    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997495    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997498    2580 flags.go:64] FLAG: --lock-file=""
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997500    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997522    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997527    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997535    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997538    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997541    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997544    2580 flags.go:64] FLAG: --logging-format="text"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997547    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997550    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997553    2580 flags.go:64] FLAG: --manifest-url=""
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997556    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997561    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997564    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997568    2580 flags.go:64] FLAG: --max-pods="110"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997571    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997574    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997577    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997580    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997583    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 12:48:32.003050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997586    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997588    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997597    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997600    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997603    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997606    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997609    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997615    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997618    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997621    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997624    2580 flags.go:64] FLAG: --port="10250"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997627    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997630    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aec9447c1d17a7f6"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997633    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997635    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997638    2580 flags.go:64] FLAG: --register-node="true"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997641    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997645    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997647    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997650    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997653    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997656    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997659    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997662    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997665    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 12:48:32.003665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997668    2580 flags.go:64] FLAG: --runonce="false"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997671    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997674    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997677    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997680    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997683    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997686    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997688    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997692    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997694    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997699    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997702    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997704    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997708    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997711    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997714    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997720    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997722    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997725    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997729    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997732    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997740    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997742    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997745    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997750    2580 flags.go:64] FLAG: --v="2"
Jul 07 12:48:32.004267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997754    2580 flags.go:64] FLAG: --version="false"
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997758    2580 flags.go:64] FLAG: --vmodule=""
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997761    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.997765    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997879    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997882    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997885    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997888    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997891    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997894    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997896    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997899    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997902    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997904    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997907    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997910    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997913    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997917    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997921    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997925    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 12:48:32.004880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997927    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997930    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997933    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997936    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997939    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997941    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997944    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997946    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997949    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997951    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997968    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997974    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997976    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997980    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997983    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997986    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997989    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997992    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997994    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.997997    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 12:48:32.005402 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998000    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998002    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998005    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998008    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998010    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998013    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998015    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998018    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998020    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998024    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998027    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998030    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998032    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998035    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998037    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998040    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998043    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998046    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998048    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998051    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 12:48:32.005897 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998053    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998056    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998059    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998063    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998065    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998068    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998070    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998073    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998075    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998078    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998080    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998083    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998086    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998089    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998091    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998094    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998097    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998099    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998101    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998104    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 12:48:32.006374 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998106    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998110    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998112    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998116    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998119    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998123    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998126    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998128    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998131    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998134    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998137    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998139    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998141    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998144    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998147    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998150    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998153    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998155    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998159    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 12:48:32.006893 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998162    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998165    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998168    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:31.998171    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:31.998798    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.005607    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.005621    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.006423    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.006431    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006488    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006494    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006497    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006501    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006522    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006526    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 12:48:32.007497 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006528    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006532    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006535    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006539    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006544    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006547    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006550    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006553    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006556    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006559    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006562    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006565    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006567    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006570    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006573    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006576    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006579    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006581    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006584    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006587    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 12:48:32.008188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006590    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006593    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006595    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006600    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006603    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006606    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006609    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006611    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006614    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006616    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006619    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006621    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006624    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006626    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006629    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006631    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006634    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006636    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006639    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 12:48:32.008709 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006641    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006645    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006648    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006652    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006654    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006657    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006660    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006662    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006665    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006667    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006670    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006672    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006675    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006678    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006681    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006683    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006686    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006691    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006695    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 12:48:32.009165 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006697    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006700    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006702    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006705    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006707    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006710    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006712    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006715    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006717    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006720    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006722    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006725    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006727    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006730    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006732    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006735    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006737    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006740    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006742    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006745    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 12:48:32.009641 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006747    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006750    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006752    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006754    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006757    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006760    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006763    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006765    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006768    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006771    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006774    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006777    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006779    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006782    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006784    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 12:48:32.010112 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.006789    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.006909    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007098    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007106    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007112    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007118    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007123    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007129    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007134    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007138    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007143    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007147    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007152    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007157    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007166    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007171    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007176    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007180    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007185    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 12:48:32.010472 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007189    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007193    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007198    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007203    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007207    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007215    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007222    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007227    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007237    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007242    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007249    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007254    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007258    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007263    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007267    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007272    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007276    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007280    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007285    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 12:48:32.010996 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007289    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007299    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007303    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007310    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007315    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007320    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007324    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007329    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007334    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007339    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007343    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007348    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007352    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007356    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007365    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007369    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007374    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007378    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007382    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007387    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 12:48:32.011464 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007391    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007395    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007400    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007405    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007410    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007414    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007423    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007428    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007432    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007436    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007440    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007454    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007458    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007462    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007467    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007471    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007475    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007479    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007484    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007493    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 12:48:32.012137 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007502    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007520    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007524    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007528    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007532    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007536    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007541    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007545    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007549    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007554    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007564    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007568    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007574    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007580    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007585    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007589    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007594    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007598    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007603    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 12:48:32.012640 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007607    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 12:48:32.013188 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:32.007611    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 12:48:32.013188 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.007619    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 12:48:32.013188 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.008117    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 12:48:32.013188 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.010424    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 12:48:32.013188 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.011711    2580 server.go:1019] "Starting client certificate rotation"
Jul 07 12:48:32.013188 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.011821    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 12:48:32.013188 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.011863    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 12:48:32.014176 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.014159    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 12:48:32.015295 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.015271    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 12:48:32.025872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.025854    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 07 12:48:32.028041 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.028027    2580 log.go:25] "Validated CRI v1 image API"
Jul 07 12:48:32.028920 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.028903    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 12:48:32.031106 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.031086    2580 fs.go:135] Filesystem UUIDs: map[6cdc4850-f9be-48f4-8d60-9ac23be42775:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cabe522d-311f-4618-95c1-35526f0e031c:/dev/nvme0n1p3]
Jul 07 12:48:32.031193 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.031105    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 12:48:32.036668 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.036553    2580 manager.go:216] Machine: {Timestamp:2026-07-07 12:48:32.036072331 +0000 UTC m=+0.299248793 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114404 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2505915152be7235a8667413e69b6f SystemUUID:ec250591-5152-be72-35a8-667413e69b6f BootID:f427e5d3-20d0-490d-9af0-c18009ccd6d7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:e5:1a:4c:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:e5:1a:4c:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:b2:e0:82:2d:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 12:48:32.036668 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.036658    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 12:48:32.036825 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.036770    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 12:48:32.039634 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.039607    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 12:48:32.039786 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.039637    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 12:48:32.040341 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.040331    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 12:48:32.040373 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.040343    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 12:48:32.040373 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.040350    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 12:48:32.040987 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.040967    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 12:48:32.042664 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.042651    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 12:48:32.046615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.046604    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 12:48:32.046785 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.046775    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 12:48:32.047425 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.047416    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 12:48:32.047468 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.047438    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 12:48:32.047468 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.047461    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 12:48:32.047570 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.047474    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 07 12:48:32.047570 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.047485    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 12:48:32.048075 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.048049    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 12:48:32.048075 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.048078    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 12:48:32.051599 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.051550    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 12:48:32.051895 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.051876    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 12:48:32.053840 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.053825    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 12:48:32.053899 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.053855    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 12:48:32.055323 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055311    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055327    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055333    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055339    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055348    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055353    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055360    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055365    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055372    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055377    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 12:48:32.055385 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055385    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 12:48:32.055650 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055390    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 12:48:32.055650 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055414    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 12:48:32.055650 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.055419    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 12:48:32.058435 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.058422    2580 server.go:1268] "Started kubelet"
Jul 07 12:48:32.058581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.058536    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 12:48:32.058698 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.058500    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 12:48:32.058790 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.058721    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 12:48:32.059325 ip-10-0-135-39 systemd[1]: Started Kubernetes Kubelet.
Jul 07 12:48:32.060518 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.060488    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 12:48:32.060989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.060977    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 12:48:32.062484 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.062467    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 12:48:32.062591 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.062569    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 12:48:32.063741 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.063727    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 12:48:32.067241 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.067225    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 12:48:32.067312 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.067283    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 12:48:32.067376 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.067318    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.067808 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.067783    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 12:48:32.067995 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.067970    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 12:48:32.067995 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.067989    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 12:48:32.068134 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068121    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 12:48:32.068134 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068130    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 12:48:32.068233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068168    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 12:48:32.068233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068181    2580 factory.go:55] Registering systemd factory
Jul 07 12:48:32.068233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068190    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 07 12:48:32.068542 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068499    2580 factory.go:153] Registering CRI-O factory
Jul 07 12:48:32.068615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068554    2580 factory.go:223] Registration of the crio container factory successfully
Jul 07 12:48:32.068615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068598    2580 factory.go:103] Registering Raw factory
Jul 07 12:48:32.068615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.068614    2580 manager.go:1196] Started watching for new ooms in manager
Jul 07 12:48:32.069315 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.069301    2580 manager.go:349] Starting recovery of all containers
Jul 07 12:48:32.070975 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.070946    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 12:48:32.071182 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.071159    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 12:48:32.071736 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.070794    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-39.ec2.internal.18c002c85f8b5070  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-39.ec2.internal,UID:ip-10-0-135-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-39.ec2.internal,},FirstTimestamp:2026-07-07 12:48:32.058396784 +0000 UTC m=+0.321573247,LastTimestamp:2026-07-07 12:48:32.058396784 +0000 UTC m=+0.321573247,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-39.ec2.internal,}"
Jul 07 12:48:32.079300 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.079264    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 12:48:32.081579 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.081559    2580 manager.go:354] Recovery completed
Jul 07 12:48:32.086129 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.086109    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m94vh"
Jul 07 12:48:32.087202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.087189    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:32.088961 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.088837    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:32.089018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.088975    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:32.089018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.088986    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:32.089494 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.089480    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 12:48:32.089494 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.089493    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 12:48:32.089616 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.089499    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:32.089616 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.089523    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 12:48:32.090197 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.090178    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:32.090277 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.090207    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:32.090277 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.090217    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:32.091163 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.091097    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-39.ec2.internal.18c002c8615db069  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-39.ec2.internal,UID:ip-10-0-135-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-39.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-39.ec2.internal,},FirstTimestamp:2026-07-07 12:48:32.088961129 +0000 UTC m=+0.352137595,LastTimestamp:2026-07-07 12:48:32.088961129 +0000 UTC m=+0.352137595,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-39.ec2.internal,}"
Jul 07 12:48:32.091642 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.091631    2580 policy_none.go:49] "None policy: Start"
Jul 07 12:48:32.091705 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.091645    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 12:48:32.091705 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.091656    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 12:48:32.093606 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.093595    2580 policy_none.go:47] "Start"
Jul 07 12:48:32.100489 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.100473    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m94vh"
Jul 07 12:48:32.102076 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.101988    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-39.ec2.internal.18c002c8615df933  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-39.ec2.internal,UID:ip-10-0-135-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-39.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-39.ec2.internal,},FirstTimestamp:2026-07-07 12:48:32.088979763 +0000 UTC m=+0.352156226,LastTimestamp:2026-07-07 12:48:32.088979763 +0000 UTC m=+0.352156226,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-39.ec2.internal,}"
Jul 07 12:48:32.105456 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.105372    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-39.ec2.internal.18c002c8615e1fba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-39.ec2.internal,UID:ip-10-0-135-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-39.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-39.ec2.internal,},FirstTimestamp:2026-07-07 12:48:32.088989626 +0000 UTC m=+0.352166089,LastTimestamp:2026-07-07 12:48:32.088989626 +0000 UTC m=+0.352166089,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-39.ec2.internal,}"
Jul 07 12:48:32.132042 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.132028    2580 manager.go:337] "Starting Device Plugin manager"
Jul 07 12:48:32.132121 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.132064    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 12:48:32.132121 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.132074    2580 server.go:87] "Starting device plugin registration server"
Jul 07 12:48:32.132304 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.132293    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 12:48:32.132346 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.132306    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 12:48:32.132477 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.132456    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 12:48:32.132597 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.132576    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 12:48:32.132681 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.132609    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 12:48:32.133017 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.132996    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 12:48:32.133078 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.133043    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.164458 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.164426    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 12:48:32.171306 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.165636    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 12:48:32.171306 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.165667    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 12:48:32.171306 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.165685    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 12:48:32.171306 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.165718    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 12:48:32.171306 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.168219    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 12:48:32.233384 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.233353    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:32.234369 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.234355    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:32.234429 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.234383    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:32.234429 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.234393    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:32.234429 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.234415    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.242859 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.242798    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.242859 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.242825    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-39.ec2.internal\": node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.264015 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.263995    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.265824 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.265806    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal"]
Jul 07 12:48:32.265906 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.265875    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:32.269563 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.269549    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:32.269661 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.269577    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:32.269661 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.269591    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:32.271996 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.271982    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:32.272112 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.272155 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272125    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:32.272666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272649    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:32.272787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272671    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:32.272787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272684    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:32.272787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272704    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:32.272787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272730    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:32.272787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.272746    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:32.275001 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.274987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.275063 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.275014    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:32.276827 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.276810    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:32.276897 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.276841    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:32.276897 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.276860    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:32.300121 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.300101    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-39.ec2.internal\" not found" node="ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.304372 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.304356    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-39.ec2.internal\" not found" node="ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.364648 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.364622    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.368934 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.368914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9de71094ffed8b984541b3221f649a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal\" (UID: \"e9de71094ffed8b984541b3221f649a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.369022 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.368940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9de71094ffed8b984541b3221f649a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal\" (UID: \"e9de71094ffed8b984541b3221f649a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.465233 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.465203    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.469857 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.469839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9de71094ffed8b984541b3221f649a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal\" (UID: \"e9de71094ffed8b984541b3221f649a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.469925 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.469870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9de71094ffed8b984541b3221f649a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal\" (UID: \"e9de71094ffed8b984541b3221f649a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.469925 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.469893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f56b37d7e2e421e49f960418acbfc2d5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-39.ec2.internal\" (UID: \"f56b37d7e2e421e49f960418acbfc2d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.469993 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.469935    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9de71094ffed8b984541b3221f649a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal\" (UID: \"e9de71094ffed8b984541b3221f649a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.469993 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.469948    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9de71094ffed8b984541b3221f649a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal\" (UID: \"e9de71094ffed8b984541b3221f649a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.565818 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.565753    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.570418 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.570401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f56b37d7e2e421e49f960418acbfc2d5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-39.ec2.internal\" (UID: \"f56b37d7e2e421e49f960418acbfc2d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.570466 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.570439    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f56b37d7e2e421e49f960418acbfc2d5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-39.ec2.internal\" (UID: \"f56b37d7e2e421e49f960418acbfc2d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.604095 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.604055    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.607881 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:32.607857    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:32.668642 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.668614    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.772702 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.772665    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.873744 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.873671    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:32.974590 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:32.974557    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:33.010911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.010886    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 12:48:33.011380 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.011033    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 12:48:33.074714 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:33.074679    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:33.090870 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.090844    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 12:48:33.105830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.105797    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 12:43:32 +0000 UTC" deadline="2028-01-13 19:59:16.182167358 +0000 UTC"
Jul 07 12:48:33.105830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.105830    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13327h10m43.076342792s"
Jul 07 12:48:33.149846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.149792    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 12:48:33.151096 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.151073    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 12:48:33.151202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.151116    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 12:48:33.151202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.151134    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeHasSufficientPID"
Jul 07 12:48:33.175614 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:33.175578    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:33.181885 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:33.181846    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56b37d7e2e421e49f960418acbfc2d5.slice/crio-a3716c745af961fa04504052c06f11254cf4c082e0328f63871408447a3a1161 WatchSource:0}: Error finding container a3716c745af961fa04504052c06f11254cf4c082e0328f63871408447a3a1161: Status 404 returned error can't find the container with id a3716c745af961fa04504052c06f11254cf4c082e0328f63871408447a3a1161
Jul 07 12:48:33.182358 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:33.182333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9de71094ffed8b984541b3221f649a4.slice/crio-b6c24de5052f75b2c7868ca3eb355f67e455a7c3d3028706985d6dbe8431c14e WatchSource:0}: Error finding container b6c24de5052f75b2c7868ca3eb355f67e455a7c3d3028706985d6dbe8431c14e: Status 404 returned error can't find the container with id b6c24de5052f75b2c7868ca3eb355f67e455a7c3d3028706985d6dbe8431c14e
Jul 07 12:48:33.186090 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.186077    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 12:48:33.275730 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:33.275692    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-39.ec2.internal\" not found"
Jul 07 12:48:33.329914 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.329896    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 12:48:33.369121 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.369095    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:33.382945 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.382915    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 12:48:33.383952 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.383935    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal"
Jul 07 12:48:33.393945 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.393925    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 12:48:33.661873 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.661840    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 12:48:33.919193 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:33.919106    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 12:48:34.049688 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.049655    2580 apiserver.go:52] "Watching apiserver"
Jul 07 12:48:34.056656 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.056632    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 12:48:34.058559 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.058515    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-c2vjc","openshift-ovn-kubernetes/ovnkube-node-9fnn8","kube-system/global-pull-secret-syncer-9xmgq","kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws","openshift-cluster-node-tuning-operator/tuned-p7mgc","openshift-dns/node-resolver-v2gz8","openshift-image-registry/node-ca-p5687","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal","openshift-multus/multus-additional-cni-plugins-n45r2","kube-system/konnectivity-agent-vglnc","openshift-multus/multus-r6njr","openshift-multus/network-metrics-daemon-gvjp2","openshift-network-diagnostics/network-check-target-zsclv"]
Jul 07 12:48:34.061315 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.061294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.063521 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.063483    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:34.063628 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.063583    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:34.063887 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.063752    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 12:48:34.063974 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.063954    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 12:48:34.064037 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.064028    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rqcxf\""
Jul 07 12:48:34.064144 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.064106    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 12:48:34.064144 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.064136    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 12:48:34.064269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.064235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 12:48:34.065860 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.065840    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.065958 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.065923    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:34.068598 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.068535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:34.068695 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.068645    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:34.068764 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.068721    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 12:48:34.070989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.070967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.073340 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.073321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.073579 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.073559    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 12:48:34.073900 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.073882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sxmrw\""
Jul 07 12:48:34.073986 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.073913    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 12:48:34.073986 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.073973    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 12:48:34.075719 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.075689    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 12:48:34.075814 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.075786    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.076355 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.076336    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-78cqx\""
Jul 07 12:48:34.076692 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.076677    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 12:48:34.078666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.078325    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.078666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.078370    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 12:48:34.078666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.078443    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99lk5\""
Jul 07 12:48:34.078666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.078375    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 12:48:34.078666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.078328    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 12:48:34.080366 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080349    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 12:48:34.080838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080637    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b56zz\""
Jul 07 12:48:34.080838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080694    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 12:48:34.080838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-cnibin\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.080838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:34.080838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb6v5\" (UniqueName: \"kubernetes.io/projected/08491a53-cfe5-49ca-ab9a-0a437410fc5f-kube-api-access-bb6v5\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:34.080838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxgqs\" (UniqueName: \"kubernetes.io/projected/a245d546-36bf-4b62-aba8-216155ea22b3-kube-api-access-hxgqs\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.080996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-system-cni-dir\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.081021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-os-release\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.081068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.081061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.081103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.081142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d294dbc-5492-4102-925c-0920e7d8715c-kubelet-config\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.081213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.081169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d294dbc-5492-4102-925c-0920e7d8715c-dbus\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.081878 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.081850    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 12:48:34.083615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.083536    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 12:48:34.083719 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.083702    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dwf5\""
Jul 07 12:48:34.084004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.083832    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 12:48:34.084369 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.084160    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 12:48:34.084369 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.084319    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 12:48:34.084734 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.084632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.084734 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.084683    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 12:48:34.084874 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.084713    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 12:48:34.086966 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.086945    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2hrbr\""
Jul 07 12:48:34.087949 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.087933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.088900 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.088806    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 12:48:34.088972 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.088924    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 12:48:34.089498 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.089477    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 12:48:34.090135 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.090115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7xfq\""
Jul 07 12:48:34.090388 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.090371    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 12:48:34.090489 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.090454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 12:48:34.090489 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.090466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.092800 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.092783    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4vbsx\""
Jul 07 12:48:34.093030 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.093014    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 12:48:34.107381 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.107360    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s4zmj"
Jul 07 12:48:34.116779 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.116758    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s4zmj"
Jul 07 12:48:34.169189 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.169157    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 12:48:34.173220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.173131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal" event={"ID":"e9de71094ffed8b984541b3221f649a4","Type":"ContainerStarted","Data":"b6c24de5052f75b2c7868ca3eb355f67e455a7c3d3028706985d6dbe8431c14e"}
Jul 07 12:48:34.174299 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.174275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal" event={"ID":"f56b37d7e2e421e49f960418acbfc2d5","Type":"ContainerStarted","Data":"a3716c745af961fa04504052c06f11254cf4c082e0328f63871408447a3a1161"}
Jul 07 12:48:34.181549 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-hosts-file\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.181664 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-run-netns\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.181664 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-host\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.181664 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f001bf42-0efc-422c-a15d-2944de740776-konnectivity-ca\") pod \"konnectivity-agent-vglnc\" (UID: \"f001bf42-0efc-422c-a15d-2944de740776\") " pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.181664 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jpp\" (UniqueName: \"kubernetes.io/projected/446d8898-d9f8-461a-862d-13ab70b2606b-kube-api-access-m5jpp\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.181893 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.181893 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-device-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.181893 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-run\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.181893 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-sys\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.181893 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcdq4\" (UniqueName: \"kubernetes.io/projected/71c40a5c-27b3-4545-8482-ac0654fa496c-kube-api-access-dcdq4\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.181893 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/446d8898-d9f8-461a-862d-13ab70b2606b-host\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.181893 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-cni-netd\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-netns\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-cni-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.181984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-socket-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-registration-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c40a5c-27b3-4545-8482-ac0654fa496c-host-slash\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.182036    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-hostroot\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-etc-kubernetes\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.182103    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret podName:5d294dbc-5492-4102-925c-0920e7d8715c nodeName:}" failed. No retries permitted until 2026-07-07 12:48:34.682081339 +0000 UTC m=+2.945257810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret") pod "global-pull-secret-syncer-9xmgq" (UID: "5d294dbc-5492-4102-925c-0920e7d8715c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnvn6\" (UniqueName: \"kubernetes.io/projected/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-kube-api-access-cnvn6\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.182249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-os-release\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182292    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d294dbc-5492-4102-925c-0920e7d8715c-kubelet-config\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182355    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-os-release\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182357    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d294dbc-5492-4102-925c-0920e7d8715c-kubelet-config\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d294dbc-5492-4102-925c-0920e7d8715c-dbus\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-var-lib-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-cni-bin\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-system-cni-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l44px\" (UniqueName: \"kubernetes.io/projected/764b02ba-9eed-45f4-9c9e-21d91aae11a0-kube-api-access-l44px\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182506    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182515    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d294dbc-5492-4102-925c-0920e7d8715c-dbus\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-cnibin\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182632    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-cnibin\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb6v5\" (UniqueName: \"kubernetes.io/projected/08491a53-cfe5-49ca-ab9a-0a437410fc5f-kube-api-access-bb6v5\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:34.182911 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.182731    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-systemd\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.182824    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs podName:08491a53-cfe5-49ca-ab9a-0a437410fc5f nodeName:}" failed. No retries permitted until 2026-07-07 12:48:34.682810923 +0000 UTC m=+2.945987375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs") pod "network-metrics-daemon-gvjp2" (UID: "08491a53-cfe5-49ca-ab9a-0a437410fc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-cni-multus\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-slash\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9025918d-2d5d-4c46-9271-7dadac24ea17-ovn-node-metrics-cert\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5jvv\" (UniqueName: \"kubernetes.io/projected/9025918d-2d5d-4c46-9271-7dadac24ea17-kube-api-access-v5jvv\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.182984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8c31982-1ef9-4267-a058-6cc8fed16a31-cni-binary-copy\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysconfig\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-kubernetes\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-systemd\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71c40a5c-27b3-4545-8482-ac0654fa496c-iptables-alerter-script\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-ovnkube-config\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-cnibin\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f001bf42-0efc-422c-a15d-2944de740776-agent-certs\") pod \"konnectivity-agent-vglnc\" (UID: \"f001bf42-0efc-422c-a15d-2944de740776\") " pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.183757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/446d8898-d9f8-461a-862d-13ab70b2606b-serviceca\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-kubelet\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-node-log\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-cni-bin\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-kubelet\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-conf-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysctl-conf\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-tmp-dir\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-ovn\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-env-overrides\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-ovnkube-script-lib\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-sys-fs\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-var-lib-kubelet\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-multus-certs\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxgqs\" (UniqueName: \"kubernetes.io/projected/a245d546-36bf-4b62-aba8-216155ea22b3-kube-api-access-hxgqs\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.184452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-etc-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-run-ovn-kubernetes\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-os-release\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-k8s-cni-cncf-io\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183731    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-modprobe-d\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-system-cni-dir\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183884    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a245d546-36bf-4b62-aba8-216155ea22b3-system-cni-dir\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-socket-dir-parent\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kwn\" (UniqueName: \"kubernetes.io/projected/d8c31982-1ef9-4267-a058-6cc8fed16a31-kube-api-access-n9kwn\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gh8l\" (UniqueName: \"kubernetes.io/projected/a394440a-255b-4620-b4cf-eccc9dacd72a-kube-api-access-8gh8l\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.183975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysctl-d\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-tuned\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764b02ba-9eed-45f4-9c9e-21d91aae11a0-tmp\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-systemd-units\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.185211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-log-socket\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.185872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.185872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-daemon-config\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.185872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-lib-modules\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.185872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:34.185872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.185872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.184851    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a245d546-36bf-4b62-aba8-216155ea22b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.197377 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.197347    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 12:48:34.197377 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.197377    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 12:48:34.197569 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.197391    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xblmw for pod openshift-network-diagnostics/network-check-target-zsclv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:34.197569 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.197456    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw podName:8c632179-6da5-49ae-8ed6-503d2e1f77d7 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:34.697439183 +0000 UTC m=+2.960615657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xblmw" (UniqueName: "kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw") pod "network-check-target-zsclv" (UID: "8c632179-6da5-49ae-8ed6-503d2e1f77d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:34.197693 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.197663    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 12:48:34.201355 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.201327    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb6v5\" (UniqueName: \"kubernetes.io/projected/08491a53-cfe5-49ca-ab9a-0a437410fc5f-kube-api-access-bb6v5\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:34.205935 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.205885    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxgqs\" (UniqueName: \"kubernetes.io/projected/a245d546-36bf-4b62-aba8-216155ea22b3-kube-api-access-hxgqs\") pod \"multus-additional-cni-plugins-n45r2\" (UID: \"a245d546-36bf-4b62-aba8-216155ea22b3\") " pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.284727 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.284679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9025918d-2d5d-4c46-9271-7dadac24ea17-ovn-node-metrics-cert\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.284727 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.284725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5jvv\" (UniqueName: \"kubernetes.io/projected/9025918d-2d5d-4c46-9271-7dadac24ea17-kube-api-access-v5jvv\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.284989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.284852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8c31982-1ef9-4267-a058-6cc8fed16a31-cni-binary-copy\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.284989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.284880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysconfig\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.284989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.284902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-kubernetes\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.284989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.284972    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysconfig\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-systemd\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71c40a5c-27b3-4545-8482-ac0654fa496c-iptables-alerter-script\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-ovnkube-config\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-cnibin\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f001bf42-0efc-422c-a15d-2944de740776-agent-certs\") pod \"konnectivity-agent-vglnc\" (UID: \"f001bf42-0efc-422c-a15d-2944de740776\") " pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/446d8898-d9f8-461a-862d-13ab70b2606b-serviceca\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-kubelet\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.285202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-node-log\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-cni-bin\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-kubelet\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-conf-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysctl-conf\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-tmp-dir\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285389    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-kubelet\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285435    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-node-log\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285481    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-cni-bin\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285527    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-kubelet\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285544    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8c31982-1ef9-4267-a058-6cc8fed16a31-cni-binary-copy\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.285625 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285598    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-conf-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285747    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysctl-conf\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285776    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/446d8898-d9f8-461a-862d-13ab70b2606b-serviceca\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285811    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-cnibin\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285862    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-systemd\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285909    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-kubernetes\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-ovn\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-env-overrides\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.285999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-ovnkube-script-lib\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286004    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-tmp-dir\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-sys-fs\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-var-lib-kubelet\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-multus-certs\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-etc-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286194    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-ovnkube-config\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.286217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-run-ovn-kubernetes\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-os-release\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286257    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-run-ovn-kubernetes\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-k8s-cni-cncf-io\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286324    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-modprobe-d\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-socket-dir-parent\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kwn\" (UniqueName: \"kubernetes.io/projected/d8c31982-1ef9-4267-a058-6cc8fed16a31-kube-api-access-n9kwn\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286440    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gh8l\" (UniqueName: \"kubernetes.io/projected/a394440a-255b-4620-b4cf-eccc9dacd72a-kube-api-access-8gh8l\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysctl-d\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286489    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-ovnkube-script-lib\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286549    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-etc-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286607    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-sys-fs\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286620    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-sysctl-d\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-tuned\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764b02ba-9eed-45f4-9c9e-21d91aae11a0-tmp\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-systemd-units\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-log-socket\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-daemon-config\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-lib-modules\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286944    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9025918d-2d5d-4c46-9271-7dadac24ea17-env-overrides\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-hosts-file\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286938    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-var-lib-kubelet\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286980    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-multus-certs\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.286988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-run-netns\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287018    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-k8s-cni-cncf-io\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287028    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-systemd-units\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287040    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-run-netns\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-host\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287075    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-os-release\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287077    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-log-socket\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.287921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287112    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287143    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71c40a5c-27b3-4545-8482-ac0654fa496c-iptables-alerter-script\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287180    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-hosts-file\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287183    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-socket-dir-parent\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287230    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-host\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287265    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-modprobe-d\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287306    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-ovn\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287332    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-lib-modules\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f001bf42-0efc-422c-a15d-2944de740776-konnectivity-ca\") pod \"konnectivity-agent-vglnc\" (UID: \"f001bf42-0efc-422c-a15d-2944de740776\") " pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jpp\" (UniqueName: \"kubernetes.io/projected/446d8898-d9f8-461a-862d-13ab70b2606b-kube-api-access-m5jpp\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-device-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-run\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-sys\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-sys\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287637    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-device-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287694    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/764b02ba-9eed-45f4-9c9e-21d91aae11a0-run\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287745    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9025918d-2d5d-4c46-9271-7dadac24ea17-ovn-node-metrics-cert\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcdq4\" (UniqueName: \"kubernetes.io/projected/71c40a5c-27b3-4545-8482-ac0654fa496c-kube-api-access-dcdq4\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.288846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/446d8898-d9f8-461a-862d-13ab70b2606b-host\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-cni-netd\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-netns\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-cni-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-socket-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-registration-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c40a5c-27b3-4545-8482-ac0654fa496c-host-slash\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.287972    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-cni-netd\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288028    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c40a5c-27b3-4545-8482-ac0654fa496c-host-slash\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288031    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/446d8898-d9f8-461a-862d-13ab70b2606b-host\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288089    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-run-netns\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288104    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-cni-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-hostroot\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-etc-kubernetes\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288224    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f001bf42-0efc-422c-a15d-2944de740776-konnectivity-ca\") pod \"konnectivity-agent-vglnc\" (UID: \"f001bf42-0efc-422c-a15d-2944de740776\") " pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288260    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-socket-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnvn6\" (UniqueName: \"kubernetes.io/projected/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-kube-api-access-cnvn6\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.289783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288289    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-hostroot\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288310    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a394440a-255b-4620-b4cf-eccc9dacd72a-registration-dir\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-var-lib-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288342    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-etc-kubernetes\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-cni-bin\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-system-cni-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288402    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-var-lib-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l44px\" (UniqueName: \"kubernetes.io/projected/764b02ba-9eed-45f4-9c9e-21d91aae11a0-kube-api-access-l44px\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288448    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-cni-bin\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-systemd\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-cni-multus\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-slash\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288564    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f001bf42-0efc-422c-a15d-2944de740776-agent-certs\") pod \"konnectivity-agent-vglnc\" (UID: \"f001bf42-0efc-422c-a15d-2944de740776\") " pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288359    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-openvswitch\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288615    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-run-systemd\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288627    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8c31982-1ef9-4267-a058-6cc8fed16a31-multus-daemon-config\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288655    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-host-var-lib-cni-multus\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288685    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8c31982-1ef9-4267-a058-6cc8fed16a31-system-cni-dir\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.290700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.288691    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9025918d-2d5d-4c46-9271-7dadac24ea17-host-slash\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.291575 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.289781    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/764b02ba-9eed-45f4-9c9e-21d91aae11a0-tmp\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.291575 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.290832    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/764b02ba-9eed-45f4-9c9e-21d91aae11a0-etc-tuned\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.294988 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.294950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5jvv\" (UniqueName: \"kubernetes.io/projected/9025918d-2d5d-4c46-9271-7dadac24ea17-kube-api-access-v5jvv\") pod \"ovnkube-node-9fnn8\" (UID: \"9025918d-2d5d-4c46-9271-7dadac24ea17\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.295372 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.295350    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gh8l\" (UniqueName: \"kubernetes.io/projected/a394440a-255b-4620-b4cf-eccc9dacd72a-kube-api-access-8gh8l\") pod \"aws-ebs-csi-driver-node-zpdws\" (UID: \"a394440a-255b-4620-b4cf-eccc9dacd72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.296043 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.295952    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kwn\" (UniqueName: \"kubernetes.io/projected/d8c31982-1ef9-4267-a058-6cc8fed16a31-kube-api-access-n9kwn\") pod \"multus-r6njr\" (UID: \"d8c31982-1ef9-4267-a058-6cc8fed16a31\") " pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.297859 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.297736    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnvn6\" (UniqueName: \"kubernetes.io/projected/ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89-kube-api-access-cnvn6\") pod \"node-resolver-v2gz8\" (UID: \"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89\") " pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.297859 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.297823    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jpp\" (UniqueName: \"kubernetes.io/projected/446d8898-d9f8-461a-862d-13ab70b2606b-kube-api-access-m5jpp\") pod \"node-ca-p5687\" (UID: \"446d8898-d9f8-461a-862d-13ab70b2606b\") " pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.298597 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.298568    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcdq4\" (UniqueName: \"kubernetes.io/projected/71c40a5c-27b3-4545-8482-ac0654fa496c-kube-api-access-dcdq4\") pod \"iptables-alerter-c2vjc\" (UID: \"71c40a5c-27b3-4545-8482-ac0654fa496c\") " pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.299526 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.299502    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l44px\" (UniqueName: \"kubernetes.io/projected/764b02ba-9eed-45f4-9c9e-21d91aae11a0-kube-api-access-l44px\") pod \"tuned-p7mgc\" (UID: \"764b02ba-9eed-45f4-9c9e-21d91aae11a0\") " pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.372262 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.372230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n45r2"
Jul 07 12:48:34.381330 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.381305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws"
Jul 07 12:48:34.393593 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.393560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p7mgc"
Jul 07 12:48:34.401556 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.401533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c2vjc"
Jul 07 12:48:34.409396 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.409376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p5687"
Jul 07 12:48:34.418156 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.418136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v2gz8"
Jul 07 12:48:34.427117 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.427048    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:48:34.434988 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.434968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:34.439773 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.439753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6njr"
Jul 07 12:48:34.691971 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.691874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:34.691971 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.691940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:34.692197 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.692051    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:34.692197 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.692057    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:34.692197 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.692125    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs podName:08491a53-cfe5-49ca-ab9a-0a437410fc5f nodeName:}" failed. No retries permitted until 2026-07-07 12:48:35.692096306 +0000 UTC m=+3.955272762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs") pod "network-metrics-daemon-gvjp2" (UID: "08491a53-cfe5-49ca-ab9a-0a437410fc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:34.692197 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.692144    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret podName:5d294dbc-5492-4102-925c-0920e7d8715c nodeName:}" failed. No retries permitted until 2026-07-07 12:48:35.692134174 +0000 UTC m=+3.955310641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret") pod "global-pull-secret-syncer-9xmgq" (UID: "5d294dbc-5492-4102-925c-0920e7d8715c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:34.792830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:34.792797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:34.793006 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.792937    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 12:48:34.793006 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.792958    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 12:48:34.793006 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.792968    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xblmw for pod openshift-network-diagnostics/network-check-target-zsclv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:34.793146 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:34.793023    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw podName:8c632179-6da5-49ae-8ed6-503d2e1f77d7 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:35.79300661 +0000 UTC m=+4.056183079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xblmw" (UniqueName: "kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw") pod "network-check-target-zsclv" (UID: "8c632179-6da5-49ae-8ed6-503d2e1f77d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:35.120329 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:35.120231    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 12:43:34 +0000 UTC" deadline="2028-03-13 03:05:40.816623773 +0000 UTC"
Jul 07 12:48:35.120329 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:35.120270    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14750h17m5.696359263s"
Jul 07 12:48:35.166833 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:35.166799    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:35.167004 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.166926    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:35.246800 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.246731    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda394440a_255b_4620_b4cf_eccc9dacd72a.slice/crio-13557a7074788dd1b67b673047cd7fe87801818b956f38f6485583e463068f35 WatchSource:0}: Error finding container 13557a7074788dd1b67b673047cd7fe87801818b956f38f6485583e463068f35: Status 404 returned error can't find the container with id 13557a7074788dd1b67b673047cd7fe87801818b956f38f6485583e463068f35
Jul 07 12:48:35.249344 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.249312    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446d8898_d9f8_461a_862d_13ab70b2606b.slice/crio-3b955e3c2a27f2ea0cd9ef198de2695c71917057660587513c611226d7b70520 WatchSource:0}: Error finding container 3b955e3c2a27f2ea0cd9ef198de2695c71917057660587513c611226d7b70520: Status 404 returned error can't find the container with id 3b955e3c2a27f2ea0cd9ef198de2695c71917057660587513c611226d7b70520
Jul 07 12:48:35.251941 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.251915    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf001bf42_0efc_422c_a15d_2944de740776.slice/crio-c08e9c786c8e48dd4eec540c8c390333f91de292ba3b4f634ad023df0ae08b89 WatchSource:0}: Error finding container c08e9c786c8e48dd4eec540c8c390333f91de292ba3b4f634ad023df0ae08b89: Status 404 returned error can't find the container with id c08e9c786c8e48dd4eec540c8c390333f91de292ba3b4f634ad023df0ae08b89
Jul 07 12:48:35.253348 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.253242    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda245d546_36bf_4b62_aba8_216155ea22b3.slice/crio-be5aa72e256ba638c06e686150aa107b772f7dc284a6bcc497bd55bbf4c1d5fb WatchSource:0}: Error finding container be5aa72e256ba638c06e686150aa107b772f7dc284a6bcc497bd55bbf4c1d5fb: Status 404 returned error can't find the container with id be5aa72e256ba638c06e686150aa107b772f7dc284a6bcc497bd55bbf4c1d5fb
Jul 07 12:48:35.254160 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.254111    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c40a5c_27b3_4545_8482_ac0654fa496c.slice/crio-4a36f99dad1730e462beb8dd52e8903ae3e9f6fd32d1720ac953b3cc4d9ae66d WatchSource:0}: Error finding container 4a36f99dad1730e462beb8dd52e8903ae3e9f6fd32d1720ac953b3cc4d9ae66d: Status 404 returned error can't find the container with id 4a36f99dad1730e462beb8dd52e8903ae3e9f6fd32d1720ac953b3cc4d9ae66d
Jul 07 12:48:35.255870 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.255699    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9025918d_2d5d_4c46_9271_7dadac24ea17.slice/crio-dfa187b6353a5f2291e42a6345aff663e9a5830925aa73fc54e4552bd6be703d WatchSource:0}: Error finding container dfa187b6353a5f2291e42a6345aff663e9a5830925aa73fc54e4552bd6be703d: Status 404 returned error can't find the container with id dfa187b6353a5f2291e42a6345aff663e9a5830925aa73fc54e4552bd6be703d
Jul 07 12:48:35.257386 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.257248    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c31982_1ef9_4267_a058_6cc8fed16a31.slice/crio-b644b8e063ed53a876a278b4889547605c76cf61b2afb6f258c01be28ec110b7 WatchSource:0}: Error finding container b644b8e063ed53a876a278b4889547605c76cf61b2afb6f258c01be28ec110b7: Status 404 returned error can't find the container with id b644b8e063ed53a876a278b4889547605c76cf61b2afb6f258c01be28ec110b7
Jul 07 12:48:35.259626 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.259596    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2ba82d_b5a5_4bc9_9c72_2f953aba2a89.slice/crio-5694401a377793aaaa69e8075974872648f1ee695acd8a1c3a762e6859675cc0 WatchSource:0}: Error finding container 5694401a377793aaaa69e8075974872648f1ee695acd8a1c3a762e6859675cc0: Status 404 returned error can't find the container with id 5694401a377793aaaa69e8075974872648f1ee695acd8a1c3a762e6859675cc0
Jul 07 12:48:35.260582 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:48:35.260361    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764b02ba_9eed_45f4_9c9e_21d91aae11a0.slice/crio-5aa421360676262f9a1c1bcfc6da7f161ed838ba8374284a56e39c4fc94276c8 WatchSource:0}: Error finding container 5aa421360676262f9a1c1bcfc6da7f161ed838ba8374284a56e39c4fc94276c8: Status 404 returned error can't find the container with id 5aa421360676262f9a1c1bcfc6da7f161ed838ba8374284a56e39c4fc94276c8
Jul 07 12:48:35.699312 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:35.699105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:35.699454 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:35.699327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:35.699454 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.699257    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:35.699454 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.699423    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:35.699681 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.699464    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret podName:5d294dbc-5492-4102-925c-0920e7d8715c nodeName:}" failed. No retries permitted until 2026-07-07 12:48:37.699439055 +0000 UTC m=+5.962615508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret") pod "global-pull-secret-syncer-9xmgq" (UID: "5d294dbc-5492-4102-925c-0920e7d8715c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:35.699681 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.699487    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs podName:08491a53-cfe5-49ca-ab9a-0a437410fc5f nodeName:}" failed. No retries permitted until 2026-07-07 12:48:37.699475136 +0000 UTC m=+5.962651590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs") pod "network-metrics-daemon-gvjp2" (UID: "08491a53-cfe5-49ca-ab9a-0a437410fc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:35.800922 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:35.800836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:35.801071 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.801038    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 12:48:35.801071 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.801067    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 12:48:35.801234 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.801081    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xblmw for pod openshift-network-diagnostics/network-check-target-zsclv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:35.801234 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:35.801144    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw podName:8c632179-6da5-49ae-8ed6-503d2e1f77d7 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:37.801122044 +0000 UTC m=+6.064298517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xblmw" (UniqueName: "kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw") pod "network-check-target-zsclv" (UID: "8c632179-6da5-49ae-8ed6-503d2e1f77d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:36.121358 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.121201    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 12:43:34 +0000 UTC" deadline="2028-01-05 18:44:00.085687683 +0000 UTC"
Jul 07 12:48:36.121358 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.121266    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13133h55m23.964426068s"
Jul 07 12:48:36.170731 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.170167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:36.170731 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:36.170333    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:36.171243 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.171063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:36.171243 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:36.171173    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:36.197786 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.197747    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9de71094ffed8b984541b3221f649a4" containerID="1862111e58e7d1b47932b5d0e57f811aac0e30c3c1a3b242fa730bb19326af97" exitCode=0
Jul 07 12:48:36.198133 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.198058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal" event={"ID":"e9de71094ffed8b984541b3221f649a4","Type":"ContainerDied","Data":"1862111e58e7d1b47932b5d0e57f811aac0e30c3c1a3b242fa730bb19326af97"}
Jul 07 12:48:36.213976 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.213868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p7mgc" event={"ID":"764b02ba-9eed-45f4-9c9e-21d91aae11a0","Type":"ContainerStarted","Data":"5aa421360676262f9a1c1bcfc6da7f161ed838ba8374284a56e39c4fc94276c8"}
Jul 07 12:48:36.245535 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.245150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6njr" event={"ID":"d8c31982-1ef9-4267-a058-6cc8fed16a31","Type":"ContainerStarted","Data":"b644b8e063ed53a876a278b4889547605c76cf61b2afb6f258c01be28ec110b7"}
Jul 07 12:48:36.257732 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.257689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"dfa187b6353a5f2291e42a6345aff663e9a5830925aa73fc54e4552bd6be703d"}
Jul 07 12:48:36.286452 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.286331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2vjc" event={"ID":"71c40a5c-27b3-4545-8482-ac0654fa496c","Type":"ContainerStarted","Data":"4a36f99dad1730e462beb8dd52e8903ae3e9f6fd32d1720ac953b3cc4d9ae66d"}
Jul 07 12:48:36.315211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.315059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerStarted","Data":"be5aa72e256ba638c06e686150aa107b772f7dc284a6bcc497bd55bbf4c1d5fb"}
Jul 07 12:48:36.324909 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.324205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal" event={"ID":"f56b37d7e2e421e49f960418acbfc2d5","Type":"ContainerStarted","Data":"19ceb2052d7b93764efb7123aa0b5e35fd2b8486f7d18e262fe5bf309ad04136"}
Jul 07 12:48:36.337621 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.337556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v2gz8" event={"ID":"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89","Type":"ContainerStarted","Data":"5694401a377793aaaa69e8075974872648f1ee695acd8a1c3a762e6859675cc0"}
Jul 07 12:48:36.354162 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.354089    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-39.ec2.internal" podStartSLOduration=2.3540646450000002 podStartE2EDuration="2.354064645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:36.352857638 +0000 UTC m=+4.616034114" watchObservedRunningTime="2026-07-07 12:48:36.354064645 +0000 UTC m=+4.617241122"
Jul 07 12:48:36.356920 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.356607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vglnc" event={"ID":"f001bf42-0efc-422c-a15d-2944de740776","Type":"ContainerStarted","Data":"c08e9c786c8e48dd4eec540c8c390333f91de292ba3b4f634ad023df0ae08b89"}
Jul 07 12:48:36.371067 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.370909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p5687" event={"ID":"446d8898-d9f8-461a-862d-13ab70b2606b","Type":"ContainerStarted","Data":"3b955e3c2a27f2ea0cd9ef198de2695c71917057660587513c611226d7b70520"}
Jul 07 12:48:36.377029 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:36.376947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws" event={"ID":"a394440a-255b-4620-b4cf-eccc9dacd72a","Type":"ContainerStarted","Data":"13557a7074788dd1b67b673047cd7fe87801818b956f38f6485583e463068f35"}
Jul 07 12:48:37.166759 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:37.166721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:37.167270 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.166859    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:37.419935 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:37.419846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal" event={"ID":"e9de71094ffed8b984541b3221f649a4","Type":"ContainerStarted","Data":"5efe9cc4e1c660b91d76eaaf59c43c1981c94c8a75d538e51d04924f21692c6f"}
Jul 07 12:48:37.717224 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:37.717138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:37.717224 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:37.717204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:37.717459 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.717332    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:37.717459 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.717388    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:37.717459 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.717429    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret podName:5d294dbc-5492-4102-925c-0920e7d8715c nodeName:}" failed. No retries permitted until 2026-07-07 12:48:41.717409201 +0000 UTC m=+9.980585677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret") pod "global-pull-secret-syncer-9xmgq" (UID: "5d294dbc-5492-4102-925c-0920e7d8715c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:37.717459 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.717448    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs podName:08491a53-cfe5-49ca-ab9a-0a437410fc5f nodeName:}" failed. No retries permitted until 2026-07-07 12:48:41.717438996 +0000 UTC m=+9.980615449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs") pod "network-metrics-daemon-gvjp2" (UID: "08491a53-cfe5-49ca-ab9a-0a437410fc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:37.818312 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:37.818275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:37.818528 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.818509    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 12:48:37.818650 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.818536    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 12:48:37.818650 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.818567    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xblmw for pod openshift-network-diagnostics/network-check-target-zsclv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:37.818650 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:37.818635    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw podName:8c632179-6da5-49ae-8ed6-503d2e1f77d7 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:41.818615929 +0000 UTC m=+10.081792384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xblmw" (UniqueName: "kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw") pod "network-check-target-zsclv" (UID: "8c632179-6da5-49ae-8ed6-503d2e1f77d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:38.167058 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:38.166954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:38.167575 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:38.167120    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:38.174627 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:38.173711    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:38.174627 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:38.173931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:39.166432 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:39.166390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:39.166644 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:39.166553    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:40.167294 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:40.166777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:40.167294 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:40.166806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:40.167294 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:40.166931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:40.167294 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:40.167221    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:41.166037 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:41.166007    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:41.166250 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.166153    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:41.754220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:41.754180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:41.754749 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:41.754244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:41.754749 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.754394    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:41.754749 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.754461    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs podName:08491a53-cfe5-49ca-ab9a-0a437410fc5f nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.754440417 +0000 UTC m=+18.017616878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs") pod "network-metrics-daemon-gvjp2" (UID: "08491a53-cfe5-49ca-ab9a-0a437410fc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:41.754939 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.754891    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:41.754996 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.754944    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret podName:5d294dbc-5492-4102-925c-0920e7d8715c nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.754926291 +0000 UTC m=+18.018102744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret") pod "global-pull-secret-syncer-9xmgq" (UID: "5d294dbc-5492-4102-925c-0920e7d8715c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:41.855558 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:41.855489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:41.855714 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.855694    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 12:48:41.855783 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.855720    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 12:48:41.855783 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.855730    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xblmw for pod openshift-network-diagnostics/network-check-target-zsclv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:41.855783 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:41.855779    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw podName:8c632179-6da5-49ae-8ed6-503d2e1f77d7 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.855764915 +0000 UTC m=+18.118941372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xblmw" (UniqueName: "kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw") pod "network-check-target-zsclv" (UID: "8c632179-6da5-49ae-8ed6-503d2e1f77d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:42.167698 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:42.167107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:42.167698 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:42.167248    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:42.167698 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:42.167500    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:42.167698 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:42.167606    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:43.166238 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:43.166196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:43.166772 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:43.166328    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:44.166496 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:44.166388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:44.166945 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:44.166400    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:44.166945 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:44.166554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:44.166945 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:44.166679    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:45.166458 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:45.166429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:45.166654 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:45.166561    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:46.165913 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:46.165883    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:46.166034 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:46.166002    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:46.166092 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:46.166064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:46.166169 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:46.166148    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:47.166713 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:47.166678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:47.167167 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:47.166806    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:48.166859 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:48.166826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:48.167304 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:48.166956    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:48.167304 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:48.167006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:48.167304 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:48.167130    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:49.166863 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:49.166827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:49.167324 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.166962    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:49.822270 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:49.822241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:49.822429 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:49.822320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:49.822429 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.822405    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:49.822429 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.822405    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:49.822596 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.822461    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret podName:5d294dbc-5492-4102-925c-0920e7d8715c nodeName:}" failed. No retries permitted until 2026-07-07 12:49:05.822440875 +0000 UTC m=+34.085617344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret") pod "global-pull-secret-syncer-9xmgq" (UID: "5d294dbc-5492-4102-925c-0920e7d8715c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 12:48:49.822596 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.822480    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs podName:08491a53-cfe5-49ca-ab9a-0a437410fc5f nodeName:}" failed. No retries permitted until 2026-07-07 12:49:05.82247035 +0000 UTC m=+34.085646801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs") pod "network-metrics-daemon-gvjp2" (UID: "08491a53-cfe5-49ca-ab9a-0a437410fc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:48:49.923388 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:49.923355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:49.923587 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.923500    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 12:48:49.923587 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.923552    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 12:48:49.923587 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.923566    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xblmw for pod openshift-network-diagnostics/network-check-target-zsclv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:49.923742 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:49.923622    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw podName:8c632179-6da5-49ae-8ed6-503d2e1f77d7 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:05.92360727 +0000 UTC m=+34.186783719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xblmw" (UniqueName: "kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw") pod "network-check-target-zsclv" (UID: "8c632179-6da5-49ae-8ed6-503d2e1f77d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:48:50.166093 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:50.166028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:50.166226 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:50.166124    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:50.166226 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:50.166211    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:50.166343 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:50.166323    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:51.166175 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:51.166141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:51.166567 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:51.166264    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:52.167024 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:52.166992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:52.167417 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:52.167114    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:52.167417 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:52.167165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:52.167417 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:52.167220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:53.166325 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:53.166295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:53.166491 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:53.166418    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:54.166407 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:54.166367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:54.166968 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:54.166522    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:54.166968 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:54.166579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:54.166968 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:54.166698    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:55.167008 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.166843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:55.167602 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:55.167082    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:55.457823 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.457753    2580 generic.go:356] "Generic (PLEG): container finished" podID="a245d546-36bf-4b62-aba8-216155ea22b3" containerID="6b84afac049a0204088345f0aad9b64871cee66dddfac1804dd46553161fde18" exitCode=0
Jul 07 12:48:55.458046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.457828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerDied","Data":"6b84afac049a0204088345f0aad9b64871cee66dddfac1804dd46553161fde18"}
Jul 07 12:48:55.459302 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.459246    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v2gz8" event={"ID":"ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89","Type":"ContainerStarted","Data":"726b89994087597b47f626b8d07f0c4c124e39d215d67a9ac9632d5022ff3433"}
Jul 07 12:48:55.460799 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.460761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vglnc" event={"ID":"f001bf42-0efc-422c-a15d-2944de740776","Type":"ContainerStarted","Data":"e9514f61508cc4b9ded49ca0e537e92c563d39215a6c93b87ffede1213adf270"}
Jul 07 12:48:55.462359 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.462331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p5687" event={"ID":"446d8898-d9f8-461a-862d-13ab70b2606b","Type":"ContainerStarted","Data":"0ffd477d969461431ef12e1895cbf4923751255ae158b44f4f15ff1946868bfd"}
Jul 07 12:48:55.465255 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.465231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws" event={"ID":"a394440a-255b-4620-b4cf-eccc9dacd72a","Type":"ContainerStarted","Data":"e08ab37a887810afb9ac3ef28146ef6199236a0f886cd459d3cb3a73e902ce24"}
Jul 07 12:48:55.466803 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.466775    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p7mgc" event={"ID":"764b02ba-9eed-45f4-9c9e-21d91aae11a0","Type":"ContainerStarted","Data":"3edc25b98c7b1a5f120004d8b8104392d72fdb0dea8dadc0c86fa56221bab190"}
Jul 07 12:48:55.468082 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.468063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6njr" event={"ID":"d8c31982-1ef9-4267-a058-6cc8fed16a31","Type":"ContainerStarted","Data":"bf17c3f8b7a45114cb0216ebb4d41b063533c2fd75b552a8d53ef8eb05ca535f"}
Jul 07 12:48:55.474226 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.474204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"4447cd69ea6b2d33cb2a4b62deec2adada9fee0400cd3f1b8f7f9e3c8968c3f1"}
Jul 07 12:48:55.474318 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.474278    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"6c8587a03233065e050c55f8ffe3a9637a83cd5a1521b60fad9b07abf0636794"}
Jul 07 12:48:55.474318 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.474308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"b18b42e458bf3542d5b29089e2c548f09131b7f5b2c10bd5e9312f3c3eeb7fb3"}
Jul 07 12:48:55.474429 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.474334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"687d905a985948a8c207d30e20a84ebf2a0933cb26187224ecc0cf25d4138e13"}
Jul 07 12:48:55.474429 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.474372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"fbe66ac51e25fc8fe5f44b206824e0bb841f69dcf31906fffbfabf2f8370e114"}
Jul 07 12:48:55.474539 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.474404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"21c9ecf4acf4633f317357ff7b98d07c0e549c7b888ec92c0b886c35151b591b"}
Jul 07 12:48:55.490865 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.490826    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-39.ec2.internal" podStartSLOduration=21.4908118 podStartE2EDuration="21.4908118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:37.445872385 +0000 UTC m=+5.709048861" watchObservedRunningTime="2026-07-07 12:48:55.4908118 +0000 UTC m=+23.753988271"
Jul 07 12:48:55.541766 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.541725    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p5687" podStartSLOduration=7.754368531 podStartE2EDuration="22.541713305s" totalImagesPullingTime="14.787344774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:55.512925597 +0000 UTC m=+23.776102069" watchObservedRunningTime="2026-07-07 12:48:55.541713305 +0000 UTC m=+23.804889776"
Jul 07 12:48:55.569197 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.569165    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v2gz8" podStartSLOduration=3.280892956 podStartE2EDuration="22.569154504s" totalImagesPullingTime="19.288261548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:55.542474595 +0000 UTC m=+23.805651060" watchObservedRunningTime="2026-07-07 12:48:55.569154504 +0000 UTC m=+23.832330977"
Jul 07 12:48:55.569363 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.569342    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r6njr" podStartSLOduration=3.204329848 podStartE2EDuration="22.569336202s" totalImagesPullingTime="19.365006354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:55.568758361 +0000 UTC m=+23.831934832" watchObservedRunningTime="2026-07-07 12:48:55.569336202 +0000 UTC m=+23.832512673"
Jul 07 12:48:55.598411 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.598372    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p7mgc" podStartSLOduration=3.27671209 podStartE2EDuration="22.598358936s" totalImagesPullingTime="19.321646846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:55.598096155 +0000 UTC m=+23.861272624" watchObservedRunningTime="2026-07-07 12:48:55.598358936 +0000 UTC m=+23.861535407"
Jul 07 12:48:55.619904 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:55.619871    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vglnc" podStartSLOduration=7.83502348 podStartE2EDuration="22.619858674s" totalImagesPullingTime="14.784835194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:55.61953037 +0000 UTC m=+23.882706841" watchObservedRunningTime="2026-07-07 12:48:55.619858674 +0000 UTC m=+23.883035145"
Jul 07 12:48:56.000407 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.000368    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:56.000887 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.000874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:56.165945 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.165926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:56.166040 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:56.166018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:56.166130 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.166112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:56.166250 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:56.166231    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:56.215082 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.215049    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 12:48:56.477891 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.477799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c2vjc" event={"ID":"71c40a5c-27b3-4545-8482-ac0654fa496c","Type":"ContainerStarted","Data":"d0d16c6febec8ecc0cc40bb265cd59bc6f6242170253a77bceaf989d3abe4d9b"}
Jul 07 12:48:56.479582 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.479550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws" event={"ID":"a394440a-255b-4620-b4cf-eccc9dacd72a","Type":"ContainerStarted","Data":"fab8715b65b20b3b968eb9ae70db8bdd934f9652ff2cff185473dedfd0578309"}
Jul 07 12:48:56.480283 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.480252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:56.480723 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.480705    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vglnc"
Jul 07 12:48:56.531199 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:56.531165    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c2vjc" podStartSLOduration=4.21639348 podStartE2EDuration="23.531151678s" totalImagesPullingTime="19.314758198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:56.498418968 +0000 UTC m=+24.761595440" watchObservedRunningTime="2026-07-07 12:48:56.531151678 +0000 UTC m=+24.794328149"
Jul 07 12:48:57.147567 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:57.147461    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T12:48:56.215066915Z","UUID":"8faa7609-405f-4742-9225-c65ad78918c1","Handler":null,"Name":"","Endpoint":""}
Jul 07 12:48:57.149154 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:57.149129    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 12:48:57.149291 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:57.149172    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 12:48:57.166592 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:57.166562    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:57.166692 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:57.166649    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:48:57.485377 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:57.485292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"01a0b5accc2d6f94b5bca3e635d938de740e5200f3b3f087d69b534e8641e72e"}
Jul 07 12:48:58.166738 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:58.166708    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:48:58.166937 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:58.166843    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:48:58.166937 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:58.166881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:48:58.167060 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:58.166952    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:48:58.489790 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:58.489705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws" event={"ID":"a394440a-255b-4620-b4cf-eccc9dacd72a","Type":"ContainerStarted","Data":"e0112dfb845a1759867cfedeff747dd13a41e4a8af66688398c6241ec9de16f8"}
Jul 07 12:48:59.165973 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:48:59.165942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:48:59.166158 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:48:59.166045    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:00.063762 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:00.063737    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v2gz8_ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89/dns-node-resolver/0.log"
Jul 07 12:49:00.166930 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:00.166905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:00.167102 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:00.166914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:00.167102 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:00.167017    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:00.167190 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:00.167111    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:01.039250 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.039230    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p5687_446d8898-d9f8-461a-862d-13ab70b2606b/node-ca/0.log"
Jul 07 12:49:01.166971 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.166836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:01.167450 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:01.167054    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:01.499670 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.499644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" event={"ID":"9025918d-2d5d-4c46-9271-7dadac24ea17","Type":"ContainerStarted","Data":"f529c60a4e9ca7c63e046fc535b22b871d601e9eba43d28d857a96a7c72af025"}
Jul 07 12:49:01.499982 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.499941    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:49:01.501441 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.501421    2580 generic.go:356] "Generic (PLEG): container finished" podID="a245d546-36bf-4b62-aba8-216155ea22b3" containerID="4bbb0069e8b6b26ab824c7409fdb70bff96f9e8e19cefe4cd03919a67772b8e7" exitCode=0
Jul 07 12:49:01.501545 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.501449    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerDied","Data":"4bbb0069e8b6b26ab824c7409fdb70bff96f9e8e19cefe4cd03919a67772b8e7"}
Jul 07 12:49:01.514405 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.514388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:49:01.577975 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.577912    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpdws" podStartSLOduration=6.5879436 podStartE2EDuration="28.577900655s" totalImagesPullingTime="21.989957055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.526090973 +0000 UTC m=+26.789267444" watchObservedRunningTime="2026-07-07 12:49:01.577900655 +0000 UTC m=+29.841077127"
Jul 07 12:49:01.627010 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:01.626973    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8" podStartSLOduration=9.203766326 podStartE2EDuration="28.626963275s" totalImagesPullingTime="19.423196949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:01.578642415 +0000 UTC m=+29.841818888" watchObservedRunningTime="2026-07-07 12:49:01.626963275 +0000 UTC m=+29.890139747"
Jul 07 12:49:02.167129 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:02.167096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:02.167703 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:02.167180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:02.167703 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:02.167208    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:02.167703 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:02.167351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:02.503222 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:02.503202    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 12:49:02.503684 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:02.503664    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:49:02.528366 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:02.528346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:49:03.165892 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.165870    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:03.166025 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:03.165959    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:03.192233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.192213    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:49:03.490403 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.490378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xmgq"]
Jul 07 12:49:03.490552 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.490484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:03.490635 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:03.490610    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:03.493846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.493797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gvjp2"]
Jul 07 12:49:03.493962 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.493910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:03.494028 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:03.494009    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:03.494649 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.494624    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zsclv"]
Jul 07 12:49:03.509068 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.509033    2580 generic.go:356] "Generic (PLEG): container finished" podID="a245d546-36bf-4b62-aba8-216155ea22b3" containerID="314fc0434d4a8a319776e340d97cd4bfec0ca8cf110c83119d1d76686ce85726" exitCode=0
Jul 07 12:49:03.509185 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.509083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerDied","Data":"314fc0434d4a8a319776e340d97cd4bfec0ca8cf110c83119d1d76686ce85726"}
Jul 07 12:49:03.509185 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:03.509109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:03.509298 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:03.509206    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:05.166871 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.166805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:05.167296 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.166805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:05.167296 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.166897    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:05.167296 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.166812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:05.167296 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.166969    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:05.167296 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.167079    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:05.515407 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.515333    2580 generic.go:356] "Generic (PLEG): container finished" podID="a245d546-36bf-4b62-aba8-216155ea22b3" containerID="db8fb4e27460b32c3a7f8130107a919b7b8c188d733a834fb9b23c1b8a659f19" exitCode=0
Jul 07 12:49:05.515407 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.515379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerDied","Data":"db8fb4e27460b32c3a7f8130107a919b7b8c188d733a834fb9b23c1b8a659f19"}
Jul 07 12:49:05.844354 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.844268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:05.844354 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.844351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:05.844526 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.844413    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:49:05.844526 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.844441    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 12:49:05.844526 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.844482    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret podName:5d294dbc-5492-4102-925c-0920e7d8715c nodeName:}" failed. No retries permitted until 2026-07-07 12:49:37.844465569 +0000 UTC m=+66.107642021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret") pod "global-pull-secret-syncer-9xmgq" (UID: "5d294dbc-5492-4102-925c-0920e7d8715c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 12:49:05.844526 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.844497    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs podName:08491a53-cfe5-49ca-ab9a-0a437410fc5f nodeName:}" failed. No retries permitted until 2026-07-07 12:49:37.844489036 +0000 UTC m=+66.107665486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs") pod "network-metrics-daemon-gvjp2" (UID: "08491a53-cfe5-49ca-ab9a-0a437410fc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 12:49:05.944975 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:05.944942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:05.945113 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.945094    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 12:49:05.945113 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.945113    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 12:49:05.945182 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.945122    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xblmw for pod openshift-network-diagnostics/network-check-target-zsclv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:49:05.945182 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:05.945167    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw podName:8c632179-6da5-49ae-8ed6-503d2e1f77d7 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:37.945153514 +0000 UTC m=+66.208329964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xblmw" (UniqueName: "kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw") pod "network-check-target-zsclv" (UID: "8c632179-6da5-49ae-8ed6-503d2e1f77d7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 12:49:07.166053 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:07.166017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:07.166567 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:07.166017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:07.166567 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:07.166017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:07.166567 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:07.166278    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:07.166567 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:07.166334    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:07.166567 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:07.166148    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:09.166718 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:09.166689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:09.167071 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:09.166733    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:09.167071 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:09.166826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:09.167071 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:09.166841    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:09.167071 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:09.166916    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:09.167071 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:09.166986    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:11.166654 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:11.166625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:11.167113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:11.166625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:11.167113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:11.166626    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:11.167113 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:11.167085    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:11.167269 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:11.167201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:11.167386 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:11.167319    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:12.531620 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:12.531591    2580 generic.go:356] "Generic (PLEG): container finished" podID="a245d546-36bf-4b62-aba8-216155ea22b3" containerID="2a906c7248980b07ea7383a664899f37de6818a6f05db307a33f105c08f3b96f" exitCode=0
Jul 07 12:49:12.532045 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:12.531626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerDied","Data":"2a906c7248980b07ea7383a664899f37de6818a6f05db307a33f105c08f3b96f"}
Jul 07 12:49:13.166871 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:13.166796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:13.166871 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:13.166821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:13.167045 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:13.166888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:13.167045 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:13.166903    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:13.167045 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:13.166972    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:13.167145 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:13.167049    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:13.539308 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:13.539230    2580 generic.go:356] "Generic (PLEG): container finished" podID="a245d546-36bf-4b62-aba8-216155ea22b3" containerID="4c0e2d3bc3865c55a1b4030ce27f63f26442467489d8abd0d67188703356f898" exitCode=0
Jul 07 12:49:13.539308 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:13.539278    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerDied","Data":"4c0e2d3bc3865c55a1b4030ce27f63f26442467489d8abd0d67188703356f898"}
Jul 07 12:49:14.544305 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:14.544272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n45r2" event={"ID":"a245d546-36bf-4b62-aba8-216155ea22b3","Type":"ContainerStarted","Data":"7a9bef0d03255a1fe17415c5fad5631cc176f9ae4022cd5f1b082955258849ae"}
Jul 07 12:49:15.165966 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:15.165935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:15.166152 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:15.166022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:15.166152 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:15.166021    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:15.166152 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:15.166028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:15.166152 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:15.166118    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:15.166363 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:15.166189    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:17.166793 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:17.166762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:17.167261 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:17.166764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:17.167261 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:17.166864    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:17.167261 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:17.166769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:17.167261 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:17.166938    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:17.167261 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:17.167041    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:19.166861 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:19.166825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:19.166861 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:19.166852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:19.167435 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:19.166908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:19.167435 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:19.167000    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:19.167435 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:19.167050    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:19.167435 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:19.167093    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:21.166122 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:21.166090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:21.166122 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:21.166111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:21.166540 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:21.166090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:21.166540 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:21.166209    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:21.166540 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:21.166327    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:21.166540 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:21.166359    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:23.166305 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:23.166274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:23.166681 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:23.166274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:23.166681 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:23.166367    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:23.166681 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:23.166274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:23.166681 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:23.166446    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:23.166681 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:23.166536    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:25.166819 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:25.166792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:25.166819 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:25.166811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:25.167208 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:25.166790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:25.167208 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:25.166891    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:25.167208 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:25.166950    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:25.167208 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:25.167020    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:27.166329 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.166302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:27.166636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.166301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:27.166636 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.166412    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xmgq" podUID="5d294dbc-5492-4102-925c-0920e7d8715c"
Jul 07 12:49:27.166636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.166301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:27.166636 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.166470    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zsclv" podUID="8c632179-6da5-49ae-8ed6-503d2e1f77d7"
Jul 07 12:49:27.166636 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.166563    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvjp2" podUID="08491a53-cfe5-49ca-ab9a-0a437410fc5f"
Jul 07 12:49:27.533715 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.533695    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-39.ec2.internal" event="NodeReady"
Jul 07 12:49:27.533841 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.533790    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 12:49:27.604860 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.604502    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n45r2" podStartSLOduration=21.136164281 podStartE2EDuration="54.604482969s" totalImagesPullingTime="33.468318688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:14.58385254 +0000 UTC m=+42.847029012" watchObservedRunningTime="2026-07-07 12:49:27.604482969 +0000 UTC m=+55.867659442"
Jul 07 12:49:27.604860 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.604835    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d75c4c488-zpqc2"]
Jul 07 12:49:27.606566 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.606549    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.611161 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.611144    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 12:49:27.611352 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.611335    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 12:49:27.611399 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.611370    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vgk5d\""
Jul 07 12:49:27.612247 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.612222    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 12:49:27.618561 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.618543    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 12:49:27.650319 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.650299    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d75c4c488-zpqc2"]
Jul 07 12:49:27.702193 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.702171    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stxz4"]
Jul 07 12:49:27.703876 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.703860    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-488bd"]
Jul 07 12:49:27.704002 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.703984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.705605 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.705588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.706594 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.706567    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 07 12:49:27.708680 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.708660    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Jul 07 12:49:27.708928 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.708903    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-stxz4\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="229a5731-4cf3-4d59-95c4-82c25afa469b" pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.708999 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.708946    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-2zm52\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2zm52\"" type="*v1.Secret"
Jul 07 12:49:27.709316 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.709293    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 07 12:49:27.709383 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.709309    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-default-metrics-tls\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret"
Jul 07 12:49:27.709709 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.709684    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-dockercfg-wb7sm\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wb7sm\"" type="*v1.Secret"
Jul 07 12:49:27.709900 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.709861    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 07 12:49:27.709900 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.709878    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-default\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap"
Jul 07 12:49:27.710672 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.710643    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"dns-default-488bd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="cca2606f-d189-4b3d-aa4c-9c6c5d20b14b" pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.714652 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b66dd520-9208-4735-ab28-d20b99120daf-ca-trust-extracted\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.714726 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b66dd520-9208-4735-ab28-d20b99120daf-image-registry-private-configuration\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.714726 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b66dd520-9208-4735-ab28-d20b99120daf-registry-certificates\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.714811 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b66dd520-9208-4735-ab28-d20b99120daf-trusted-ca\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.714811 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b66dd520-9208-4735-ab28-d20b99120daf-installation-pull-secrets\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.714811 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-registry-tls\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.714929 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dk6p\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-kube-api-access-9dk6p\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.714929 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:27.714895    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-stxz4\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="229a5731-4cf3-4d59-95c4-82c25afa469b" pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.714929 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.714902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-bound-sa-token\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.742742 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.742719    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-488bd"]
Jul 07 12:49:27.750702 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.750276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stxz4"]
Jul 07 12:49:27.815854 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.815806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-bound-sa-token\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.815854 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.815842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ppxj\" (UniqueName: \"kubernetes.io/projected/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-kube-api-access-7ppxj\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.815973 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.815861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-tmp-dir\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.815973 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.815938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b66dd520-9208-4735-ab28-d20b99120daf-ca-trust-extracted\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816058 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.815982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/229a5731-4cf3-4d59-95c4-82c25afa469b-crio-socket\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.816058 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrfdz\" (UniqueName: \"kubernetes.io/projected/229a5731-4cf3-4d59-95c4-82c25afa469b-kube-api-access-qrfdz\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.816058 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b66dd520-9208-4735-ab28-d20b99120daf-image-registry-private-configuration\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816201 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b66dd520-9208-4735-ab28-d20b99120daf-registry-certificates\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816201 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b66dd520-9208-4735-ab28-d20b99120daf-trusted-ca\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816201 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b66dd520-9208-4735-ab28-d20b99120daf-installation-pull-secrets\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816345 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/229a5731-4cf3-4d59-95c4-82c25afa469b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.816345 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816210    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b66dd520-9208-4735-ab28-d20b99120daf-ca-trust-extracted\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816345 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/229a5731-4cf3-4d59-95c4-82c25afa469b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.816345 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-metrics-tls\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.816345 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-config-volume\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.816345 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-registry-tls\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816688 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/229a5731-4cf3-4d59-95c4-82c25afa469b-data-volume\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.816688 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dk6p\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-kube-api-access-9dk6p\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.816953 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.816931    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b66dd520-9208-4735-ab28-d20b99120daf-registry-certificates\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.817074 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.817055    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b66dd520-9208-4735-ab28-d20b99120daf-trusted-ca\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.820168 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.820148    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b66dd520-9208-4735-ab28-d20b99120daf-image-registry-private-configuration\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.820168 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.820162    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-registry-tls\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.820277 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.820239    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b66dd520-9208-4735-ab28-d20b99120daf-installation-pull-secrets\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.877459 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.877430    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-bound-sa-token\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.878150 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.878131    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dzrbn"]
Jul 07 12:49:27.879278 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.879261    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dk6p\" (UniqueName: \"kubernetes.io/projected/b66dd520-9208-4735-ab28-d20b99120daf-kube-api-access-9dk6p\") pod \"image-registry-7d75c4c488-zpqc2\" (UID: \"b66dd520-9208-4735-ab28-d20b99120daf\") " pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.880332 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.880316    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:27.892157 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.892140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 12:49:27.892646 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.892632    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-58r4b\""
Jul 07 12:49:27.896556 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.896537    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 12:49:27.896603 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.896554    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 12:49:27.915701 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.915681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:27.916809 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.916792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/229a5731-4cf3-4d59-95c4-82c25afa469b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.916875 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.916817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/229a5731-4cf3-4d59-95c4-82c25afa469b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.916875 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.916838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-metrics-tls\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.916875 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.916855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-config-volume\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.916995 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.916942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/229a5731-4cf3-4d59-95c4-82c25afa469b-data-volume\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.917034 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.917004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ppxj\" (UniqueName: \"kubernetes.io/projected/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-kube-api-access-7ppxj\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.917034 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.917023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-tmp-dir\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.917121 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.917053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/229a5731-4cf3-4d59-95c4-82c25afa469b-crio-socket\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.917121 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.917076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrfdz\" (UniqueName: \"kubernetes.io/projected/229a5731-4cf3-4d59-95c4-82c25afa469b-kube-api-access-qrfdz\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.917255 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.917189    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/229a5731-4cf3-4d59-95c4-82c25afa469b-data-volume\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.917304 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.917256    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/229a5731-4cf3-4d59-95c4-82c25afa469b-crio-socket\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:27.917462 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.917320    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-tmp-dir\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.971971 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.971941    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ppxj\" (UniqueName: \"kubernetes.io/projected/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-kube-api-access-7ppxj\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:27.985696 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:27.985647    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dzrbn"]
Jul 07 12:49:28.017430 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.017396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509b383c-7239-400e-b928-6f56b9127712-cert\") pod \"ingress-canary-dzrbn\" (UID: \"509b383c-7239-400e-b928-6f56b9127712\") " pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:28.017581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.017462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtw5f\" (UniqueName: \"kubernetes.io/projected/509b383c-7239-400e-b928-6f56b9127712-kube-api-access-mtw5f\") pod \"ingress-canary-dzrbn\" (UID: \"509b383c-7239-400e-b928-6f56b9127712\") " pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:28.118463 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.118367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509b383c-7239-400e-b928-6f56b9127712-cert\") pod \"ingress-canary-dzrbn\" (UID: \"509b383c-7239-400e-b928-6f56b9127712\") " pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:28.118463 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.118429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtw5f\" (UniqueName: \"kubernetes.io/projected/509b383c-7239-400e-b928-6f56b9127712-kube-api-access-mtw5f\") pod \"ingress-canary-dzrbn\" (UID: \"509b383c-7239-400e-b928-6f56b9127712\") " pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:28.120673 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.120650    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509b383c-7239-400e-b928-6f56b9127712-cert\") pod \"ingress-canary-dzrbn\" (UID: \"509b383c-7239-400e-b928-6f56b9127712\") " pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:28.145652 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.145630    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtw5f\" (UniqueName: \"kubernetes.io/projected/509b383c-7239-400e-b928-6f56b9127712-kube-api-access-mtw5f\") pod \"ingress-canary-dzrbn\" (UID: \"509b383c-7239-400e-b928-6f56b9127712\") " pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:28.163295 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:28.163274    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66dd520_9208_4735_ab28_d20b99120daf.slice/crio-dbee57a28e5c47198cd9c66625c1e31271f2cd6ef1ce97e1dbfdfa81ab42d177 WatchSource:0}: Error finding container dbee57a28e5c47198cd9c66625c1e31271f2cd6ef1ce97e1dbfdfa81ab42d177: Status 404 returned error can't find the container with id dbee57a28e5c47198cd9c66625c1e31271f2cd6ef1ce97e1dbfdfa81ab42d177
Jul 07 12:49:28.165948 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.165928    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d75c4c488-zpqc2"]
Jul 07 12:49:28.192187 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.192168    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dzrbn"
Jul 07 12:49:28.377035 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.377006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dzrbn"]
Jul 07 12:49:28.380428 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:28.380399    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509b383c_7239_400e_b928_6f56b9127712.slice/crio-fe531034dcbf473373a2e798d7d0974e033a6e184ff24b18c6aea06cecc52049 WatchSource:0}: Error finding container fe531034dcbf473373a2e798d7d0974e033a6e184ff24b18c6aea06cecc52049: Status 404 returned error can't find the container with id fe531034dcbf473373a2e798d7d0974e033a6e184ff24b18c6aea06cecc52049
Jul 07 12:49:28.570320 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.570283    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 12:49:28.574573 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.574537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dzrbn" event={"ID":"509b383c-7239-400e-b928-6f56b9127712","Type":"ContainerStarted","Data":"fe531034dcbf473373a2e798d7d0974e033a6e184ff24b18c6aea06cecc52049"}
Jul 07 12:49:28.575954 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.575931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2" event={"ID":"b66dd520-9208-4735-ab28-d20b99120daf","Type":"ContainerStarted","Data":"1f47059cff8bc7bfbc7d6364e72f06c5ecf63fa78bbccfb48206111f25093ea2"}
Jul 07 12:49:28.576082 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.575966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2" event={"ID":"b66dd520-9208-4735-ab28-d20b99120daf","Type":"ContainerStarted","Data":"dbee57a28e5c47198cd9c66625c1e31271f2cd6ef1ce97e1dbfdfa81ab42d177"}
Jul 07 12:49:28.576082 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.576052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:28.577736 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.577716    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-config-volume\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:28.647734 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.647677    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2" podStartSLOduration=2.647661152 podStartE2EDuration="2.647661152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:28.646342332 +0000 UTC m=+56.909518803" watchObservedRunningTime="2026-07-07 12:49:28.647661152 +0000 UTC m=+56.910837616"
Jul 07 12:49:28.652082 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.652061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 12:49:28.657888 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.657872    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/229a5731-4cf3-4d59-95c4-82c25afa469b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:28.738874 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.738847    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2zm52\""
Jul 07 12:49:28.747284 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.747267    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 12:49:28.759003 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.758977    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/229a5731-4cf3-4d59-95c4-82c25afa469b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:28.761768 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.761752    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 12:49:28.769444 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.769425    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2606f-d189-4b3d-aa4c-9c6c5d20b14b-metrics-tls\") pod \"dns-default-488bd\" (UID: \"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b\") " pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:28.878996 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.878968    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"]
Jul 07 12:49:28.882156 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.882143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:28.902557 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.902497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 12:49:28.902653 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.902566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6zms4\""
Jul 07 12:49:28.925250 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.925229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4675dd23-eae5-44dc-abe1-96ddf6a55c07-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-flwwm\" (UID: \"4675dd23-eae5-44dc-abe1-96ddf6a55c07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:28.936533 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.936497    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 12:49:28.941036 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:28.941019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"]
Jul 07 12:49:29.026549 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.026523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4675dd23-eae5-44dc-abe1-96ddf6a55c07-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-flwwm\" (UID: \"4675dd23-eae5-44dc-abe1-96ddf6a55c07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:29.026679 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:29.026665    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 07 12:49:29.026726 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:49:29.026718    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4675dd23-eae5-44dc-abe1-96ddf6a55c07-tls-certificates podName:4675dd23-eae5-44dc-abe1-96ddf6a55c07 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:29.526704565 +0000 UTC m=+57.789881018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4675dd23-eae5-44dc-abe1-96ddf6a55c07-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-flwwm" (UID: "4675dd23-eae5-44dc-abe1-96ddf6a55c07") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 07 12:49:29.166258 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.166185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:29.166391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.166198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:29.166391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.166303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:29.169557 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.169538    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cw2d4\""
Jul 07 12:49:29.169636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.169586    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 12:49:29.169865 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.169852    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5zg7\""
Jul 07 12:49:29.170177 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.170161    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 12:49:29.170252 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.170241    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 12:49:29.170486 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.170474    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 12:49:29.182178 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.180648    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wb7sm\""
Jul 07 12:49:29.188927 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.188910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:29.249229 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.249201    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7fd85cbb-c6cs5"]
Jul 07 12:49:29.250916 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.250896    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 12:49:29.251649 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.251634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.254703 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.254682    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 12:49:29.254857 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.254842    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 12:49:29.254950 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.254846    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 12:49:29.255726 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.255709    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 12:49:29.256013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.255994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 12:49:29.256013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.256020    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 12:49:29.256120 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.256101    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4bbkw\""
Jul 07 12:49:29.259626 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.259609    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrfdz\" (UniqueName: \"kubernetes.io/projected/229a5731-4cf3-4d59-95c4-82c25afa469b-kube-api-access-qrfdz\") pod \"insights-runtime-extractor-stxz4\" (UID: \"229a5731-4cf3-4d59-95c4-82c25afa469b\") " pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:29.263632 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.263615    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 12:49:29.296438 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.296414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7fd85cbb-c6cs5"]
Jul 07 12:49:29.329120 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.329089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-oauth-config\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.329237 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.329164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-console-config\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.329237 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.329193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-oauth-serving-cert\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.329351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.329307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-serving-cert\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.329351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.329339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-service-ca\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.329438 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.329367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldxpf\" (UniqueName: \"kubernetes.io/projected/47a96cf1-69a4-4ff8-9723-061c681184ea-kube-api-access-ldxpf\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.384195 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:29.384164    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca2606f_d189_4b3d_aa4c_9c6c5d20b14b.slice/crio-ef17f66cd305caa2543768ce6f5f07fe928cf2692f5a69f736fd75c4a098796b WatchSource:0}: Error finding container ef17f66cd305caa2543768ce6f5f07fe928cf2692f5a69f736fd75c4a098796b: Status 404 returned error can't find the container with id ef17f66cd305caa2543768ce6f5f07fe928cf2692f5a69f736fd75c4a098796b
Jul 07 12:49:29.385637 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.385614    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-488bd"]
Jul 07 12:49:29.430249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.430196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-console-config\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.430249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.430233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-oauth-serving-cert\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.430417 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.430308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-serving-cert\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.430417 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.430333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-service-ca\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.430417 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.430356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldxpf\" (UniqueName: \"kubernetes.io/projected/47a96cf1-69a4-4ff8-9723-061c681184ea-kube-api-access-ldxpf\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.430417 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.430409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-oauth-config\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.430994 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.430967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-console-config\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.431080 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.431042    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-oauth-serving-cert\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.431156 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.431133    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-service-ca\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.432919 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.432901    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-oauth-config\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.432993 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.432945    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-serving-cert\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.491628 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.491604    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldxpf\" (UniqueName: \"kubernetes.io/projected/47a96cf1-69a4-4ff8-9723-061c681184ea-kube-api-access-ldxpf\") pod \"console-6d7fd85cbb-c6cs5\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") " pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.513245 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.513224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stxz4"
Jul 07 12:49:29.530874 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.530855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4675dd23-eae5-44dc-abe1-96ddf6a55c07-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-flwwm\" (UID: \"4675dd23-eae5-44dc-abe1-96ddf6a55c07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:29.533176 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.533147    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4675dd23-eae5-44dc-abe1-96ddf6a55c07-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-flwwm\" (UID: \"4675dd23-eae5-44dc-abe1-96ddf6a55c07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:29.565414 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.565387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:29.580529 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.580479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-488bd" event={"ID":"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b","Type":"ContainerStarted","Data":"ef17f66cd305caa2543768ce6f5f07fe928cf2692f5a69f736fd75c4a098796b"}
Jul 07 12:49:29.705274 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.705197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stxz4"]
Jul 07 12:49:29.710104 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:29.710080    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229a5731_4cf3_4d59_95c4_82c25afa469b.slice/crio-4fefaca8ea974d003fe2fff7f268e5f40eae0a502d6ee29967bce68e91f97210 WatchSource:0}: Error finding container 4fefaca8ea974d003fe2fff7f268e5f40eae0a502d6ee29967bce68e91f97210: Status 404 returned error can't find the container with id 4fefaca8ea974d003fe2fff7f268e5f40eae0a502d6ee29967bce68e91f97210
Jul 07 12:49:29.742391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.742361    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7fd85cbb-c6cs5"]
Jul 07 12:49:29.746630 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:29.746601    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a96cf1_69a4_4ff8_9723_061c681184ea.slice/crio-472160962bc9d2101e1044771d805921a78553f1687beb7036b5d596e4554202 WatchSource:0}: Error finding container 472160962bc9d2101e1044771d805921a78553f1687beb7036b5d596e4554202: Status 404 returned error can't find the container with id 472160962bc9d2101e1044771d805921a78553f1687beb7036b5d596e4554202
Jul 07 12:49:29.790080 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.790047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:29.952020 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:29.951751    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"]
Jul 07 12:49:29.955060 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:29.955030    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4675dd23_eae5_44dc_abe1_96ddf6a55c07.slice/crio-b9601cc90519e0b35eb49a545dd57bd715bd0618d30105f59eb3addfb8cded78 WatchSource:0}: Error finding container b9601cc90519e0b35eb49a545dd57bd715bd0618d30105f59eb3addfb8cded78: Status 404 returned error can't find the container with id b9601cc90519e0b35eb49a545dd57bd715bd0618d30105f59eb3addfb8cded78
Jul 07 12:49:30.587766 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:30.587675    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm" event={"ID":"4675dd23-eae5-44dc-abe1-96ddf6a55c07","Type":"ContainerStarted","Data":"b9601cc90519e0b35eb49a545dd57bd715bd0618d30105f59eb3addfb8cded78"}
Jul 07 12:49:30.590393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:30.590273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stxz4" event={"ID":"229a5731-4cf3-4d59-95c4-82c25afa469b","Type":"ContainerStarted","Data":"4fefaca8ea974d003fe2fff7f268e5f40eae0a502d6ee29967bce68e91f97210"}
Jul 07 12:49:30.592344 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:30.592269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7fd85cbb-c6cs5" event={"ID":"47a96cf1-69a4-4ff8-9723-061c681184ea","Type":"ContainerStarted","Data":"472160962bc9d2101e1044771d805921a78553f1687beb7036b5d596e4554202"}
Jul 07 12:49:34.521930 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:34.521904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fnn8"
Jul 07 12:49:36.611578 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.611544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dzrbn" event={"ID":"509b383c-7239-400e-b928-6f56b9127712","Type":"ContainerStarted","Data":"b73b13bb0496d1cb31202c4a5905fba1cd3ced97156b281cc06214db975077c7"}
Jul 07 12:49:36.612942 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.612920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7fd85cbb-c6cs5" event={"ID":"47a96cf1-69a4-4ff8-9723-061c681184ea","Type":"ContainerStarted","Data":"dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254"}
Jul 07 12:49:36.614336 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.614316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-488bd" event={"ID":"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b","Type":"ContainerStarted","Data":"1ffe79dbb90d1a702a842e999c60a5f89fc47dc20161dfae4593ac131c686adc"}
Jul 07 12:49:36.614411 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.614360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-488bd" event={"ID":"cca2606f-d189-4b3d-aa4c-9c6c5d20b14b","Type":"ContainerStarted","Data":"66083241f124d6a9dd600915d075e1facc81874cfe83629526c57d2f4f2b97e7"}
Jul 07 12:49:36.614488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.614458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:36.615696 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.615673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm" event={"ID":"4675dd23-eae5-44dc-abe1-96ddf6a55c07","Type":"ContainerStarted","Data":"9328a90c6b23e659c047b06ac4311fd7cc10a3d046f7eddc8fd21e961e947cc3"}
Jul 07 12:49:36.615822 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.615806    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:36.617205 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.617187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stxz4" event={"ID":"229a5731-4cf3-4d59-95c4-82c25afa469b","Type":"ContainerStarted","Data":"97442d1cf936c5c7e0a45e3025cbe25795038fac8f3d93e7638e6a4ca74e8eec"}
Jul 07 12:49:36.620940 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.620918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm"
Jul 07 12:49:36.636244 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.636204    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dzrbn" podStartSLOduration=2.156550581 podStartE2EDuration="9.63619111s" totalImagesPullingTime="7.479640529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:36.635980857 +0000 UTC m=+64.899157322" watchObservedRunningTime="2026-07-07 12:49:36.63619111 +0000 UTC m=+64.899367614"
Jul 07 12:49:36.676922 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.676871    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-flwwm" podStartSLOduration=2.721198765 podStartE2EDuration="8.676855584s" totalImagesPullingTime="5.955656819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:36.67664712 +0000 UTC m=+64.939823656" watchObservedRunningTime="2026-07-07 12:49:36.676855584 +0000 UTC m=+64.940032034"
Jul 07 12:49:36.716249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:36.716192    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-488bd" podStartSLOduration=3.194109843 podStartE2EDuration="9.716171649s" totalImagesPullingTime="6.522061806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:36.714827708 +0000 UTC m=+64.978004182" watchObservedRunningTime="2026-07-07 12:49:36.716171649 +0000 UTC m=+64.979348122"
Jul 07 12:49:37.623891 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:37.623850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stxz4" event={"ID":"229a5731-4cf3-4d59-95c4-82c25afa469b","Type":"ContainerStarted","Data":"8c86cedc9be720e5ebc75b8b1b41769dc66fb27b8e0bde00288791625c64aa3b"}
Jul 07 12:49:37.906062 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:37.905982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:37.906214 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:37.906084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:37.910826 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:37.910799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 12:49:37.910955 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:37.910800    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 12:49:37.919002 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:37.918977    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08491a53-cfe5-49ca-ab9a-0a437410fc5f-metrics-certs\") pod \"network-metrics-daemon-gvjp2\" (UID: \"08491a53-cfe5-49ca-ab9a-0a437410fc5f\") " pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:37.919104 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:37.919044    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d294dbc-5492-4102-925c-0920e7d8715c-original-pull-secret\") pod \"global-pull-secret-syncer-9xmgq\" (UID: \"5d294dbc-5492-4102-925c-0920e7d8715c\") " pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:38.006960 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.006921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:38.009758 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.009738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 12:49:38.021218 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.021187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 12:49:38.030758 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.030734    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblmw\" (UniqueName: \"kubernetes.io/projected/8c632179-6da5-49ae-8ed6-503d2e1f77d7-kube-api-access-xblmw\") pod \"network-check-target-zsclv\" (UID: \"8c632179-6da5-49ae-8ed6-503d2e1f77d7\") " pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:38.178649 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.178568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cw2d4\""
Jul 07 12:49:38.182039 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.182019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xmgq"
Jul 07 12:49:38.185980 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.185963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvjp2"
Jul 07 12:49:38.192175 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.192147    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5zg7\""
Jul 07 12:49:38.198211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:38.198191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:39.216276 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.216226    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7fd85cbb-c6cs5" podStartSLOduration=4.061221847 podStartE2EDuration="10.216208592s" totalImagesPullingTime="6.154986745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:36.75033988 +0000 UTC m=+65.013516351" watchObservedRunningTime="2026-07-07 12:49:39.216208592 +0000 UTC m=+67.479385055"
Jul 07 12:49:39.216842 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.216825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xmgq"]
Jul 07 12:49:39.219609 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:39.219584    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d294dbc_5492_4102_925c_0920e7d8715c.slice/crio-bf4608bc10e7b819db83dd7a1aa60e236c3bdfb8eef0d70e1abb2c98bc59d825 WatchSource:0}: Error finding container bf4608bc10e7b819db83dd7a1aa60e236c3bdfb8eef0d70e1abb2c98bc59d825: Status 404 returned error can't find the container with id bf4608bc10e7b819db83dd7a1aa60e236c3bdfb8eef0d70e1abb2c98bc59d825
Jul 07 12:49:39.226688 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.226616    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gvjp2"]
Jul 07 12:49:39.230554 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:39.230531    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08491a53_cfe5_49ca_ab9a_0a437410fc5f.slice/crio-ec42c853597d621269ace3c909702626ebcd82a093c8ecf0d85506d0b083d303 WatchSource:0}: Error finding container ec42c853597d621269ace3c909702626ebcd82a093c8ecf0d85506d0b083d303: Status 404 returned error can't find the container with id ec42c853597d621269ace3c909702626ebcd82a093c8ecf0d85506d0b083d303
Jul 07 12:49:39.240005 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.239986    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zsclv"]
Jul 07 12:49:39.242935 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:39.242912    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c632179_6da5_49ae_8ed6_503d2e1f77d7.slice/crio-4e0c8e49ae9388bc8e0ebd80618e856b3f41847850c43a2d41f6bdd4c3e55fc3 WatchSource:0}: Error finding container 4e0c8e49ae9388bc8e0ebd80618e856b3f41847850c43a2d41f6bdd4c3e55fc3: Status 404 returned error can't find the container with id 4e0c8e49ae9388bc8e0ebd80618e856b3f41847850c43a2d41f6bdd4c3e55fc3
Jul 07 12:49:39.565715 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.565660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:39.565887 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.565735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:39.566984 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.566962    2580 patch_prober.go:28] interesting pod/console-6d7fd85cbb-c6cs5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body=
Jul 07 12:49:39.567023 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.567003    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d7fd85cbb-c6cs5" podUID="47a96cf1-69a4-4ff8-9723-061c681184ea" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused"
Jul 07 12:49:39.633083 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.633044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xmgq" event={"ID":"5d294dbc-5492-4102-925c-0920e7d8715c","Type":"ContainerStarted","Data":"bf4608bc10e7b819db83dd7a1aa60e236c3bdfb8eef0d70e1abb2c98bc59d825"}
Jul 07 12:49:39.634797 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.634773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stxz4" event={"ID":"229a5731-4cf3-4d59-95c4-82c25afa469b","Type":"ContainerStarted","Data":"99ea2553d36e2e387aa8feddc518db398e060a225abb21168b00e94c7e3cd9b1"}
Jul 07 12:49:39.635829 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.635806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zsclv" event={"ID":"8c632179-6da5-49ae-8ed6-503d2e1f77d7","Type":"ContainerStarted","Data":"4e0c8e49ae9388bc8e0ebd80618e856b3f41847850c43a2d41f6bdd4c3e55fc3"}
Jul 07 12:49:39.636829 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.636814    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gvjp2" event={"ID":"08491a53-cfe5-49ca-ab9a-0a437410fc5f","Type":"ContainerStarted","Data":"ec42c853597d621269ace3c909702626ebcd82a093c8ecf0d85506d0b083d303"}
Jul 07 12:49:39.658461 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:39.658421    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stxz4" podStartSLOduration=3.414521027 podStartE2EDuration="12.658409089s" totalImagesPullingTime="9.243888062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:49:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:39.656943055 +0000 UTC m=+67.920119527" watchObservedRunningTime="2026-07-07 12:49:39.658409089 +0000 UTC m=+67.921585560"
Jul 07 12:49:41.647576 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:41.647538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gvjp2" event={"ID":"08491a53-cfe5-49ca-ab9a-0a437410fc5f","Type":"ContainerStarted","Data":"cd5d28fb7869f023ee04114cc7c01e83e3ecdf24267dd75eeea6fc08f2c1984d"}
Jul 07 12:49:41.648037 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:41.647600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gvjp2" event={"ID":"08491a53-cfe5-49ca-ab9a-0a437410fc5f","Type":"ContainerStarted","Data":"01132e16baee4a491f50cf67f71711eaee6be04274d653739bfe5001b3fbb26b"}
Jul 07 12:49:41.670818 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:41.670764    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gvjp2" podStartSLOduration=67.146576064 podStartE2EDuration="1m8.670748054s" totalImagesPullingTime="1.52417199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:41.670438283 +0000 UTC m=+69.933614756" watchObservedRunningTime="2026-07-07 12:49:41.670748054 +0000 UTC m=+69.933924526"
Jul 07 12:49:44.658971 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:44.658936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xmgq" event={"ID":"5d294dbc-5492-4102-925c-0920e7d8715c","Type":"ContainerStarted","Data":"c4b46043bc3f7591f87f823844a6a9d0e2b2d7001af86e89b64e3ebb1e59bc15"}
Jul 07 12:49:44.660272 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:44.660250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zsclv" event={"ID":"8c632179-6da5-49ae-8ed6-503d2e1f77d7","Type":"ContainerStarted","Data":"0819de48b42535aa3688b09abb8dddfa0eea4bd426c02af61c02ec97f08dca7f"}
Jul 07 12:49:44.660384 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:44.660305    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:49:44.690562 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:44.690490    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9xmgq" podStartSLOduration=66.811113995 podStartE2EDuration="1m11.690471603s" totalImagesPullingTime="4.879357608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:44.689800374 +0000 UTC m=+72.952976846" watchObservedRunningTime="2026-07-07 12:49:44.690471603 +0000 UTC m=+72.953648072"
Jul 07 12:49:44.736921 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:44.736874    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zsclv" podStartSLOduration=66.885967215 podStartE2EDuration="1m11.736858935s" totalImagesPullingTime="4.85089172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:44.736733748 +0000 UTC m=+72.999910221" watchObservedRunningTime="2026-07-07 12:49:44.736858935 +0000 UTC m=+73.000035407"
Jul 07 12:49:45.622036 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.622003    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"]
Jul 07 12:49:45.624748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.624731    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.627703 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.627678    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 12:49:45.628329 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.628301    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 12:49:45.628413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.628380    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 12:49:45.628413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.628390    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 12:49:45.629480 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.629459    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 12:49:45.629615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.629482    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 12:49:45.629615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.629460    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4gpz9\""
Jul 07 12:49:45.655231 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.655205    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ncl78"]
Jul 07 12:49:45.658190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.658176    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.661855 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.661830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 12:49:45.662261 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.662246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j4q47\""
Jul 07 12:49:45.662334 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.662295    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 12:49:45.662388 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.662340    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 12:49:45.684394 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.682638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"]
Jul 07 12:49:45.764365 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7pjt\" (UniqueName: \"kubernetes.io/projected/dab55708-4582-42f7-8a56-4e44eb93ba79-kube-api-access-r7pjt\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.764566 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.764566 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7srl\" (UniqueName: \"kubernetes.io/projected/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-api-access-z7srl\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.764566 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-tls\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.764735 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.764735 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-root\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.764735 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-accelerators-collector-config\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.764735 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-sys\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.764735 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab55708-4582-42f7-8a56-4e44eb93ba79-metrics-client-ca\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.764735 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.765006 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.765006 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-textfile\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.765006 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-wtmp\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.765006 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.765006 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.764869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.865621 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.865771 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7srl\" (UniqueName: \"kubernetes.io/projected/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-api-access-z7srl\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.865771 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-tls\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.865771 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.865771 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-root\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.865771 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-accelerators-collector-config\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-sys\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab55708-4582-42f7-8a56-4e44eb93ba79-metrics-client-ca\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865824    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-root\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-textfile\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-wtmp\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.865978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.866392 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7pjt\" (UniqueName: \"kubernetes.io/projected/dab55708-4582-42f7-8a56-4e44eb93ba79-kube-api-access-r7pjt\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866392 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866056    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-sys\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866392 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866188    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-wtmp\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866392 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866379    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-accelerators-collector-config\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866615 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866406    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.866699 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866669    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-textfile\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.866964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866918    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.867078 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866964    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab55708-4582-42f7-8a56-4e44eb93ba79-metrics-client-ca\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.867078 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.866984    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.868398 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.868371    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-tls\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.868524 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.868476    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dab55708-4582-42f7-8a56-4e44eb93ba79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.868630 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.868611    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.868683 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.868661    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.908843 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.908813    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7srl\" (UniqueName: \"kubernetes.io/projected/cb46ce5b-8153-47d7-9492-ef7f3e49afdc-kube-api-access-z7srl\") pod \"kube-state-metrics-7c9dbb8b7d-thgh5\" (UID: \"cb46ce5b-8153-47d7-9492-ef7f3e49afdc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.909948 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.909932    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7pjt\" (UniqueName: \"kubernetes.io/projected/dab55708-4582-42f7-8a56-4e44eb93ba79-kube-api-access-r7pjt\") pod \"node-exporter-ncl78\" (UID: \"dab55708-4582-42f7-8a56-4e44eb93ba79\") " pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.933568 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.933548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"
Jul 07 12:49:45.965916 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:45.965884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ncl78"
Jul 07 12:49:45.976978 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:45.976951    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab55708_4582_42f7_8a56_4e44eb93ba79.slice/crio-30e3901ef8ea617379ad959da4d065fb6c643dc36863ab141dff34a252117a8e WatchSource:0}: Error finding container 30e3901ef8ea617379ad959da4d065fb6c643dc36863ab141dff34a252117a8e: Status 404 returned error can't find the container with id 30e3901ef8ea617379ad959da4d065fb6c643dc36863ab141dff34a252117a8e
Jul 07 12:49:46.082246 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:46.082219    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb46ce5b_8153_47d7_9492_ef7f3e49afdc.slice/crio-a92a4b93e343a6d1a055f4c0336ac7e4556aed213b9b8ed66e0e5b821d2487d1 WatchSource:0}: Error finding container a92a4b93e343a6d1a055f4c0336ac7e4556aed213b9b8ed66e0e5b821d2487d1: Status 404 returned error can't find the container with id a92a4b93e343a6d1a055f4c0336ac7e4556aed213b9b8ed66e0e5b821d2487d1
Jul 07 12:49:46.082991 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:46.082870    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5"]
Jul 07 12:49:46.626272 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:46.626242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-488bd"
Jul 07 12:49:46.669949 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:46.669915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ncl78" event={"ID":"dab55708-4582-42f7-8a56-4e44eb93ba79","Type":"ContainerStarted","Data":"30e3901ef8ea617379ad959da4d065fb6c643dc36863ab141dff34a252117a8e"}
Jul 07 12:49:46.671245 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:46.671204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5" event={"ID":"cb46ce5b-8153-47d7-9492-ef7f3e49afdc","Type":"ContainerStarted","Data":"a92a4b93e343a6d1a055f4c0336ac7e4556aed213b9b8ed66e0e5b821d2487d1"}
Jul 07 12:49:47.676350 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:47.676323    2580 generic.go:356] "Generic (PLEG): container finished" podID="dab55708-4582-42f7-8a56-4e44eb93ba79" containerID="cec1a2097655497343c2b83129c3ed8f826d9633373a3a270331ac0d3a09251f" exitCode=0
Jul 07 12:49:47.676703 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:47.676401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ncl78" event={"ID":"dab55708-4582-42f7-8a56-4e44eb93ba79","Type":"ContainerDied","Data":"cec1a2097655497343c2b83129c3ed8f826d9633373a3a270331ac0d3a09251f"}
Jul 07 12:49:47.678125 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:47.678096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5" event={"ID":"cb46ce5b-8153-47d7-9492-ef7f3e49afdc","Type":"ContainerStarted","Data":"6e5160ff300dc056aff143faedfa0271b0749eb2c45a39e8691b8e19ef76466b"}
Jul 07 12:49:48.683657 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:48.683619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ncl78" event={"ID":"dab55708-4582-42f7-8a56-4e44eb93ba79","Type":"ContainerStarted","Data":"b6469f731eda84b7bd95d573fcd3615d32516974021c3e4305204f356ef05bec"}
Jul 07 12:49:48.684069 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:48.683690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ncl78" event={"ID":"dab55708-4582-42f7-8a56-4e44eb93ba79","Type":"ContainerStarted","Data":"6749c5a560f6c3085e556164a475c840464aa0ecce1c7ead78408ccc5703f957"}
Jul 07 12:49:48.685645 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:48.685622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5" event={"ID":"cb46ce5b-8153-47d7-9492-ef7f3e49afdc","Type":"ContainerStarted","Data":"8d070e68dd5b2ccec7c62681b1d3c875295736418fb1398c3867f3eff6595a2f"}
Jul 07 12:49:48.685763 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:48.685666    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5" event={"ID":"cb46ce5b-8153-47d7-9492-ef7f3e49afdc","Type":"ContainerStarted","Data":"afc8ba3fae2be1eb9d87669942b43671dc9a07132313894206ba47cb7f796bee"}
Jul 07 12:49:48.748597 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:48.748553    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-thgh5" podStartSLOduration=2.21491229 podStartE2EDuration="3.748534953s" totalImagesPullingTime="1.533622663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:48.748177645 +0000 UTC m=+77.011354116" watchObservedRunningTime="2026-07-07 12:49:48.748534953 +0000 UTC m=+77.011711419"
Jul 07 12:49:48.749537 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:48.749487    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ncl78" podStartSLOduration=2.551379523 podStartE2EDuration="3.749478114s" totalImagesPullingTime="1.128410431s" totalInitContainerRuntime="69.68816ms" isStatefulPod=true podCreationTimestamp="2026-07-07 12:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:48.720405328 +0000 UTC m=+76.983581811" watchObservedRunningTime="2026-07-07 12:49:48.749478114 +0000 UTC m=+77.012654584"
Jul 07 12:49:49.569742 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:49.569711    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:49.573384 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:49.573362    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:49:49.585055 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:49.585029    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d75c4c488-zpqc2"
Jul 07 12:49:50.172095 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.172065    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"]
Jul 07 12:49:50.175146 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.175129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.178936 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.178917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 12:49:50.179040 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.179026    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jrd4p\""
Jul 07 12:49:50.196803 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.196771    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"]
Jul 07 12:49:50.282126 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.282092    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-659c6f478b-8djcx"]
Jul 07 12:49:50.285087 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.285071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.288202 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.288166    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 12:49:50.288443 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.288422    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 12:49:50.288694 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.288663    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 12:49:50.288694 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.288683    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bpwth\""
Jul 07 12:49:50.288839 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.288669    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 12:49:50.288839 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.288666    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-51472dhfcipja\""
Jul 07 12:49:50.300813 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.300790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2eca0ba-f989-4983-ab6a-6163b6f4da24-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-888mx\" (UID: \"b2eca0ba-f989-4983-ab6a-6163b6f4da24\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.300894 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.300820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlnh5\" (UniqueName: \"kubernetes.io/projected/b2eca0ba-f989-4983-ab6a-6163b6f4da24-kube-api-access-rlnh5\") pod \"monitoring-plugin-d5dcff7cf-888mx\" (UID: \"b2eca0ba-f989-4983-ab6a-6163b6f4da24\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.309790 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.309769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-659c6f478b-8djcx"]
Jul 07 12:49:50.402026 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.401988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-client-ca-bundle\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.402026 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-secret-metrics-server-client-certs\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.402270 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-secret-metrics-server-tls\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.402270 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876d0840-c024-4524-9f3a-c3c96d4f32ff-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.402270 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/876d0840-c024-4524-9f3a-c3c96d4f32ff-audit-log\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.402270 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2eca0ba-f989-4983-ab6a-6163b6f4da24-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-888mx\" (UID: \"b2eca0ba-f989-4983-ab6a-6163b6f4da24\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.402270 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlnh5\" (UniqueName: \"kubernetes.io/projected/b2eca0ba-f989-4983-ab6a-6163b6f4da24-kube-api-access-rlnh5\") pod \"monitoring-plugin-d5dcff7cf-888mx\" (UID: \"b2eca0ba-f989-4983-ab6a-6163b6f4da24\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.402596 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/876d0840-c024-4524-9f3a-c3c96d4f32ff-metrics-server-audit-profiles\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.402596 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.402299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htrs7\" (UniqueName: \"kubernetes.io/projected/876d0840-c024-4524-9f3a-c3c96d4f32ff-kube-api-access-htrs7\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.404738 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.404716    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b2eca0ba-f989-4983-ab6a-6163b6f4da24-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-888mx\" (UID: \"b2eca0ba-f989-4983-ab6a-6163b6f4da24\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.410155 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.410136    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlnh5\" (UniqueName: \"kubernetes.io/projected/b2eca0ba-f989-4983-ab6a-6163b6f4da24-kube-api-access-rlnh5\") pod \"monitoring-plugin-d5dcff7cf-888mx\" (UID: \"b2eca0ba-f989-4983-ab6a-6163b6f4da24\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.484184 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.484090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:50.502932 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.502907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876d0840-c024-4524-9f3a-c3c96d4f32ff-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503042 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.502944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/876d0840-c024-4524-9f3a-c3c96d4f32ff-audit-log\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503042 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.502976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/876d0840-c024-4524-9f3a-c3c96d4f32ff-metrics-server-audit-profiles\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503042 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.502997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htrs7\" (UniqueName: \"kubernetes.io/projected/876d0840-c024-4524-9f3a-c3c96d4f32ff-kube-api-access-htrs7\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503042 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.503030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-client-ca-bundle\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503243 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.503064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-secret-metrics-server-client-certs\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503243 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.503089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-secret-metrics-server-tls\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503349 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.503323    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/876d0840-c024-4524-9f3a-c3c96d4f32ff-audit-log\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.503696 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.503645    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876d0840-c024-4524-9f3a-c3c96d4f32ff-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.504102 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.504082    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/876d0840-c024-4524-9f3a-c3c96d4f32ff-metrics-server-audit-profiles\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.505837 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.505810    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-secret-metrics-server-tls\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.505977 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.505958    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-client-ca-bundle\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.506031 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.506016    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/876d0840-c024-4524-9f3a-c3c96d4f32ff-secret-metrics-server-client-certs\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.511896 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.511876    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htrs7\" (UniqueName: \"kubernetes.io/projected/876d0840-c024-4524-9f3a-c3c96d4f32ff-kube-api-access-htrs7\") pod \"metrics-server-659c6f478b-8djcx\" (UID: \"876d0840-c024-4524-9f3a-c3c96d4f32ff\") " pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.593890 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.593858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:49:50.611675 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.611649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"]
Jul 07 12:49:50.615368 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:50.615343    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2eca0ba_f989_4983_ab6a_6163b6f4da24.slice/crio-fb616e339c810d5a33076214444dae036c0d76f5f74d1c6e19d5c719449dc605 WatchSource:0}: Error finding container fb616e339c810d5a33076214444dae036c0d76f5f74d1c6e19d5c719449dc605: Status 404 returned error can't find the container with id fb616e339c810d5a33076214444dae036c0d76f5f74d1c6e19d5c719449dc605
Jul 07 12:49:50.694138 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.694104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx" event={"ID":"b2eca0ba-f989-4983-ab6a-6163b6f4da24","Type":"ContainerStarted","Data":"fb616e339c810d5a33076214444dae036c0d76f5f74d1c6e19d5c719449dc605"}
Jul 07 12:49:50.703489 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.703465    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7766c79568-m7cm7"]
Jul 07 12:49:50.707711 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.707692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.715377 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.715357    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 12:49:50.742576 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.742489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7766c79568-m7cm7"]
Jul 07 12:49:50.747264 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.747238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-659c6f478b-8djcx"]
Jul 07 12:49:50.751292 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:50.751265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876d0840_c024_4524_9f3a_c3c96d4f32ff.slice/crio-0612a0df8dac4138130adad2878cbaeb761d20a19c714963cd496962d79270b3 WatchSource:0}: Error finding container 0612a0df8dac4138130adad2878cbaeb761d20a19c714963cd496962d79270b3: Status 404 returned error can't find the container with id 0612a0df8dac4138130adad2878cbaeb761d20a19c714963cd496962d79270b3
Jul 07 12:49:50.805785 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.805749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-oauth-serving-cert\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.805785 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.805786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz59w\" (UniqueName: \"kubernetes.io/projected/7947dc89-63da-431b-9743-88237e6504ae-kube-api-access-bz59w\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.806004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.805823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-serving-cert\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.806004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.805889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-console-config\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.806004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.805915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-oauth-config\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.806004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.805940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-trusted-ca-bundle\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.806134 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.806052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-service-ca\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.907097 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-console-config\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.907097 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-oauth-config\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.907357 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-trusted-ca-bundle\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.907357 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-service-ca\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.907357 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-oauth-serving-cert\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.907357 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz59w\" (UniqueName: \"kubernetes.io/projected/7947dc89-63da-431b-9743-88237e6504ae-kube-api-access-bz59w\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.907357 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-serving-cert\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.908008 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907981    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-oauth-serving-cert\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.908108 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.907981    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-console-config\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.908108 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.908033    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-service-ca\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.908193 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.908112    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-trusted-ca-bundle\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.910033 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.910004    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-oauth-config\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.910033 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.910008    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-serving-cert\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:50.917389 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:50.917371    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz59w\" (UniqueName: \"kubernetes.io/projected/7947dc89-63da-431b-9743-88237e6504ae-kube-api-access-bz59w\") pod \"console-7766c79568-m7cm7\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") " pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:51.018231 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:51.018146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:49:51.144687 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:51.144655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7766c79568-m7cm7"]
Jul 07 12:49:51.147211 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:49:51.147189    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7947dc89_63da_431b_9743_88237e6504ae.slice/crio-919a4394c1889c83bb2a9dcca301b1c8986c790e7da19cf494db18f45534d711 WatchSource:0}: Error finding container 919a4394c1889c83bb2a9dcca301b1c8986c790e7da19cf494db18f45534d711: Status 404 returned error can't find the container with id 919a4394c1889c83bb2a9dcca301b1c8986c790e7da19cf494db18f45534d711
Jul 07 12:49:51.699974 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:51.699937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7766c79568-m7cm7" event={"ID":"7947dc89-63da-431b-9743-88237e6504ae","Type":"ContainerStarted","Data":"38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc"}
Jul 07 12:49:51.700410 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:51.700006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7766c79568-m7cm7" event={"ID":"7947dc89-63da-431b-9743-88237e6504ae","Type":"ContainerStarted","Data":"919a4394c1889c83bb2a9dcca301b1c8986c790e7da19cf494db18f45534d711"}
Jul 07 12:49:51.701909 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:51.701878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx" event={"ID":"876d0840-c024-4524-9f3a-c3c96d4f32ff","Type":"ContainerStarted","Data":"0612a0df8dac4138130adad2878cbaeb761d20a19c714963cd496962d79270b3"}
Jul 07 12:49:51.722787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:51.722736    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7766c79568-m7cm7" podStartSLOduration=1.722718889 podStartE2EDuration="1.722718889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:51.72099862 +0000 UTC m=+79.984175092" watchObservedRunningTime="2026-07-07 12:49:51.722718889 +0000 UTC m=+79.985895361"
Jul 07 12:49:52.710290 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:52.710195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx" event={"ID":"b2eca0ba-f989-4983-ab6a-6163b6f4da24","Type":"ContainerStarted","Data":"2eed57bc92fb024d38f2e11ba958e02a802d5618f6455a6c65538485ce6cbe52"}
Jul 07 12:49:52.710756 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:52.710348    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:52.711968 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:52.711943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx" event={"ID":"876d0840-c024-4524-9f3a-c3c96d4f32ff","Type":"ContainerStarted","Data":"75c72f1a6f6aa695be75e9e36dc7843efb342f258fb2c2b159b22fef513cf3ce"}
Jul 07 12:49:52.715777 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:52.715753    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx"
Jul 07 12:49:52.728916 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:52.728879    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-888mx" podStartSLOduration=1.28287526 podStartE2EDuration="2.728866901s" totalImagesPullingTime="1.445991641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:52.727124391 +0000 UTC m=+80.990300857" watchObservedRunningTime="2026-07-07 12:49:52.728866901 +0000 UTC m=+80.992043372"
Jul 07 12:49:52.747167 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:49:52.747118    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx" podStartSLOduration=1.014212309 podStartE2EDuration="2.747102753s" totalImagesPullingTime="1.732890444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:52.746340089 +0000 UTC m=+81.009516569" watchObservedRunningTime="2026-07-07 12:49:52.747102753 +0000 UTC m=+81.010279230"
Jul 07 12:50:01.018739 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:01.018705    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:50:01.019141 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:01.018807    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:50:01.023433 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:01.023412    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:50:01.748473 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:01.748445    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:50:01.858796 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:01.858766    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7fd85cbb-c6cs5"]
Jul 07 12:50:10.594709 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:10.594665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:50:10.595169 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:10.594724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:50:15.666198 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:15.666166    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zsclv"
Jul 07 12:50:26.877758 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:26.877695    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d7fd85cbb-c6cs5" podUID="47a96cf1-69a4-4ff8-9723-061c681184ea" containerName="console" containerID="cri-o://dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254" gracePeriod=15
Jul 07 12:50:27.129745 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.129694    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:50:27.169393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.169364    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-oauth-serving-cert\") pod \"47a96cf1-69a4-4ff8-9723-061c681184ea\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") "
Jul 07 12:50:27.169581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.169407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-service-ca\") pod \"47a96cf1-69a4-4ff8-9723-061c681184ea\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") "
Jul 07 12:50:27.169581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.169451    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-console-config\") pod \"47a96cf1-69a4-4ff8-9723-061c681184ea\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") "
Jul 07 12:50:27.169581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.169498    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-serving-cert\") pod \"47a96cf1-69a4-4ff8-9723-061c681184ea\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") "
Jul 07 12:50:27.169581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.169553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-oauth-config\") pod \"47a96cf1-69a4-4ff8-9723-061c681184ea\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") "
Jul 07 12:50:27.169884 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.169584    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldxpf\" (UniqueName: \"kubernetes.io/projected/47a96cf1-69a4-4ff8-9723-061c681184ea-kube-api-access-ldxpf\") pod \"47a96cf1-69a4-4ff8-9723-061c681184ea\" (UID: \"47a96cf1-69a4-4ff8-9723-061c681184ea\") "
Jul 07 12:50:27.170364 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.170155    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47a96cf1-69a4-4ff8-9723-061c681184ea" (UID: "47a96cf1-69a4-4ff8-9723-061c681184ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:50:27.170637 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.170611    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-console-config" (OuterVolumeSpecName: "console-config") pod "47a96cf1-69a4-4ff8-9723-061c681184ea" (UID: "47a96cf1-69a4-4ff8-9723-061c681184ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:50:27.170637 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.170621    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "47a96cf1-69a4-4ff8-9723-061c681184ea" (UID: "47a96cf1-69a4-4ff8-9723-061c681184ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:50:27.172611 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.172581    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47a96cf1-69a4-4ff8-9723-061c681184ea" (UID: "47a96cf1-69a4-4ff8-9723-061c681184ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:50:27.172699 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.172675    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a96cf1-69a4-4ff8-9723-061c681184ea-kube-api-access-ldxpf" (OuterVolumeSpecName: "kube-api-access-ldxpf") pod "47a96cf1-69a4-4ff8-9723-061c681184ea" (UID: "47a96cf1-69a4-4ff8-9723-061c681184ea"). InnerVolumeSpecName "kube-api-access-ldxpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:50:27.172751 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.172689    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47a96cf1-69a4-4ff8-9723-061c681184ea" (UID: "47a96cf1-69a4-4ff8-9723-061c681184ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:50:27.270268 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.270243    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-oauth-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:50:27.270268 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.270265    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-service-ca\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:50:27.270393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.270350    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47a96cf1-69a4-4ff8-9723-061c681184ea-console-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:50:27.270393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.270368    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:50:27.270393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.270377    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47a96cf1-69a4-4ff8-9723-061c681184ea-console-oauth-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:50:27.270393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.270385    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldxpf\" (UniqueName: \"kubernetes.io/projected/47a96cf1-69a4-4ff8-9723-061c681184ea-kube-api-access-ldxpf\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:50:27.831425 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.831394    2580 generic.go:356] "Generic (PLEG): container finished" podID="47a96cf1-69a4-4ff8-9723-061c681184ea" containerID="dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254" exitCode=0
Jul 07 12:50:27.831612 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.831442    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7fd85cbb-c6cs5"
Jul 07 12:50:27.831612 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.831487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7fd85cbb-c6cs5" event={"ID":"47a96cf1-69a4-4ff8-9723-061c681184ea","Type":"ContainerDied","Data":"dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254"}
Jul 07 12:50:27.831612 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.831565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7fd85cbb-c6cs5" event={"ID":"47a96cf1-69a4-4ff8-9723-061c681184ea","Type":"ContainerDied","Data":"472160962bc9d2101e1044771d805921a78553f1687beb7036b5d596e4554202"}
Jul 07 12:50:27.831612 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.831587    2580 scope.go:117] "RemoveContainer" containerID="dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254"
Jul 07 12:50:27.840982 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.840967    2580 scope.go:117] "RemoveContainer" containerID="dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254"
Jul 07 12:50:27.841231 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:50:27.841212    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254\": container with ID starting with dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254 not found: ID does not exist" containerID="dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254"
Jul 07 12:50:27.841300 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.841243    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254"} err="failed to get container status \"dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254\": rpc error: code = NotFound desc = could not find container \"dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254\": container with ID starting with dce0c55aaaf09c7bcf7b7355301078839f9de1c47bcef2b0804cd27c99eb9254 not found: ID does not exist"
Jul 07 12:50:27.866368 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.866340    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7fd85cbb-c6cs5"]
Jul 07 12:50:27.874068 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:27.874049    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d7fd85cbb-c6cs5"]
Jul 07 12:50:28.170093 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:28.170063    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47a96cf1-69a4-4ff8-9723-061c681184ea" path="/var/lib/kubelet/pods/47a96cf1-69a4-4ff8-9723-061c681184ea/volumes"
Jul 07 12:50:29.236486 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:29.236455    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dzrbn_509b383c-7239-400e-b928-6f56b9127712/serve-healthcheck-canary/0.log"
Jul 07 12:50:30.599649 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:30.599620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:50:30.603314 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:50:30.603296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-659c6f478b-8djcx"
Jul 07 12:51:10.290694 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.290660    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74db64d585-q8mhq"]
Jul 07 12:51:10.291167 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.290905    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a96cf1-69a4-4ff8-9723-061c681184ea" containerName="console"
Jul 07 12:51:10.291167 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.290915    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a96cf1-69a4-4ff8-9723-061c681184ea" containerName="console"
Jul 07 12:51:10.291167 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.290956    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47a96cf1-69a4-4ff8-9723-061c681184ea" containerName="console"
Jul 07 12:51:10.294032 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.294009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.297278 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.297254    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 12:51:10.297546 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.297491    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 12:51:10.297681 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.297552    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 12:51:10.297681 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.297554    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 12:51:10.297984 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.297966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7f7bw\""
Jul 07 12:51:10.298064 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.297993    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 12:51:10.306791 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.306769    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 12:51:10.314610 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.314589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74db64d585-q8mhq"]
Jul 07 12:51:10.384358 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/68969550-028d-4845-80b4-0fc62ea6e0a3-kube-api-access-kss7p\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.384358 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-telemeter-client-tls\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.384591 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.384591 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-serving-certs-ca-bundle\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.384591 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-federate-client-tls\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.384591 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-metrics-client-ca\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.384591 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-secret-telemeter-client\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.384757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.384601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485690 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-metrics-client-ca\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485690 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-secret-telemeter-client\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485903 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485903 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/68969550-028d-4845-80b4-0fc62ea6e0a3-kube-api-access-kss7p\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485903 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-telemeter-client-tls\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485903 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485903 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-serving-certs-ca-bundle\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.485903 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.485871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-federate-client-tls\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.486558 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.486532    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-metrics-client-ca\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.486678 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.486630    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-serving-certs-ca-bundle\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.486923 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.486904    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68969550-028d-4845-80b4-0fc62ea6e0a3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.488314 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.488294    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.488314 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.488303    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-secret-telemeter-client\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.488742 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.488719    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-federate-client-tls\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.488785 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.488723    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/68969550-028d-4845-80b4-0fc62ea6e0a3-telemeter-client-tls\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.497221 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.497198    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kss7p\" (UniqueName: \"kubernetes.io/projected/68969550-028d-4845-80b4-0fc62ea6e0a3-kube-api-access-kss7p\") pod \"telemeter-client-74db64d585-q8mhq\" (UID: \"68969550-028d-4845-80b4-0fc62ea6e0a3\") " pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.603328 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.603247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq"
Jul 07 12:51:10.736082 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.736050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74db64d585-q8mhq"]
Jul 07 12:51:10.739416 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:51:10.739385    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68969550_028d_4845_80b4_0fc62ea6e0a3.slice/crio-198ae7ab515b3b5fe7aff3b51cbd19d50f2a2d499c392385f4fe01c1d81534a8 WatchSource:0}: Error finding container 198ae7ab515b3b5fe7aff3b51cbd19d50f2a2d499c392385f4fe01c1d81534a8: Status 404 returned error can't find the container with id 198ae7ab515b3b5fe7aff3b51cbd19d50f2a2d499c392385f4fe01c1d81534a8
Jul 07 12:51:10.977364 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:10.977327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq" event={"ID":"68969550-028d-4845-80b4-0fc62ea6e0a3","Type":"ContainerStarted","Data":"198ae7ab515b3b5fe7aff3b51cbd19d50f2a2d499c392385f4fe01c1d81534a8"}
Jul 07 12:51:12.985235 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:12.985197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq" event={"ID":"68969550-028d-4845-80b4-0fc62ea6e0a3","Type":"ContainerStarted","Data":"b5a48be2232737c3c0478c48f0ee9203dd89440826c7a7b3d089793c2be065ac"}
Jul 07 12:51:14.995142 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:14.995107    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq" event={"ID":"68969550-028d-4845-80b4-0fc62ea6e0a3","Type":"ContainerStarted","Data":"655a019a00504f455d21524c9a98e9f7cf0ccbcf685fb3a6fed6f5ce159bcb5a"}
Jul 07 12:51:14.995537 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:14.995163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq" event={"ID":"68969550-028d-4845-80b4-0fc62ea6e0a3","Type":"ContainerStarted","Data":"89ae96f01417cd0afe7121bba1985829b95117e46b47397b4351aceec996d1fb"}
Jul 07 12:51:15.018352 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:15.018108    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74db64d585-q8mhq" podStartSLOduration=1.725215587 podStartE2EDuration="5.018093306s" totalImagesPullingTime="3.292877719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:51:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:51:15.017662359 +0000 UTC m=+163.280838825" watchObservedRunningTime="2026-07-07 12:51:15.018093306 +0000 UTC m=+163.281269778"
Jul 07 12:51:16.332078 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.332038    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568854cc9d-82hgq"]
Jul 07 12:51:16.335414 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.335390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.394747 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.394723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568854cc9d-82hgq"]
Jul 07 12:51:16.433260 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.432822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-service-ca\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.433391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.433339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-oauth-serving-cert\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.433499 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.433473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-serving-cert\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.433586 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.433557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-trusted-ca-bundle\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.433637 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.433593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fxhc\" (UniqueName: \"kubernetes.io/projected/6e51d811-5968-430a-ab29-78d1592d4b14-kube-api-access-4fxhc\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.433637 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.433630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-oauth-config\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.433736 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.433659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-console-config\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534058 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-oauth-serving-cert\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-serving-cert\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-trusted-ca-bundle\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fxhc\" (UniqueName: \"kubernetes.io/projected/6e51d811-5968-430a-ab29-78d1592d4b14-kube-api-access-4fxhc\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-oauth-config\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-console-config\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534441 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-service-ca\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.534879 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-oauth-serving-cert\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.535002 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.534971    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-console-config\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.535133 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.535113    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-trusted-ca-bundle\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.535430 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.535415    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-service-ca\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.536983 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.536960    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-serving-cert\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.537062 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.536987    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-oauth-config\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.542470 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.542452    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fxhc\" (UniqueName: \"kubernetes.io/projected/6e51d811-5968-430a-ab29-78d1592d4b14-kube-api-access-4fxhc\") pod \"console-568854cc9d-82hgq\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") " pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.643784 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.643758    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:16.775018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:16.774994    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568854cc9d-82hgq"]
Jul 07 12:51:16.777358 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:51:16.777333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e51d811_5968_430a_ab29_78d1592d4b14.slice/crio-8280754d0212e50636c8cf81bb3e313184001e9270bc38eeb89118077a98c2fa WatchSource:0}: Error finding container 8280754d0212e50636c8cf81bb3e313184001e9270bc38eeb89118077a98c2fa: Status 404 returned error can't find the container with id 8280754d0212e50636c8cf81bb3e313184001e9270bc38eeb89118077a98c2fa
Jul 07 12:51:17.004111 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:17.004034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568854cc9d-82hgq" event={"ID":"6e51d811-5968-430a-ab29-78d1592d4b14","Type":"ContainerStarted","Data":"3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d"}
Jul 07 12:51:17.004111 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:17.004087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568854cc9d-82hgq" event={"ID":"6e51d811-5968-430a-ab29-78d1592d4b14","Type":"ContainerStarted","Data":"8280754d0212e50636c8cf81bb3e313184001e9270bc38eeb89118077a98c2fa"}
Jul 07 12:51:26.644931 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:26.644842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:26.644931 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:26.644908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:26.649338 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:26.649316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:26.673924 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:26.673886    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568854cc9d-82hgq" podStartSLOduration=10.67387309 podStartE2EDuration="10.67387309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:51:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:51:17.034704073 +0000 UTC m=+165.297880545" watchObservedRunningTime="2026-07-07 12:51:26.67387309 +0000 UTC m=+174.937049562"
Jul 07 12:51:27.044139 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:27.044057    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:51:27.100228 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:27.100193    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7766c79568-m7cm7"]
Jul 07 12:51:52.125093 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.125054    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7766c79568-m7cm7" podUID="7947dc89-63da-431b-9743-88237e6504ae" containerName="console" containerID="cri-o://38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc" gracePeriod=15
Jul 07 12:51:52.360056 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.360030    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:51:52.389195 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389135    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-serving-cert\") pod \"7947dc89-63da-431b-9743-88237e6504ae\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") "
Jul 07 12:51:52.389195 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-console-config\") pod \"7947dc89-63da-431b-9743-88237e6504ae\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") "
Jul 07 12:51:52.389378 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-oauth-serving-cert\") pod \"7947dc89-63da-431b-9743-88237e6504ae\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") "
Jul 07 12:51:52.389378 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz59w\" (UniqueName: \"kubernetes.io/projected/7947dc89-63da-431b-9743-88237e6504ae-kube-api-access-bz59w\") pod \"7947dc89-63da-431b-9743-88237e6504ae\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") "
Jul 07 12:51:52.389378 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389267    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-service-ca\") pod \"7947dc89-63da-431b-9743-88237e6504ae\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") "
Jul 07 12:51:52.389564 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-trusted-ca-bundle\") pod \"7947dc89-63da-431b-9743-88237e6504ae\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") "
Jul 07 12:51:52.389564 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-oauth-config\") pod \"7947dc89-63da-431b-9743-88237e6504ae\" (UID: \"7947dc89-63da-431b-9743-88237e6504ae\") "
Jul 07 12:51:52.389674 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389653    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7947dc89-63da-431b-9743-88237e6504ae" (UID: "7947dc89-63da-431b-9743-88237e6504ae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:51:52.389730 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389677    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "7947dc89-63da-431b-9743-88237e6504ae" (UID: "7947dc89-63da-431b-9743-88237e6504ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:51:52.389806 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389683    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-console-config" (OuterVolumeSpecName: "console-config") pod "7947dc89-63da-431b-9743-88237e6504ae" (UID: "7947dc89-63da-431b-9743-88237e6504ae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:51:52.389909 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.389881    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7947dc89-63da-431b-9743-88237e6504ae" (UID: "7947dc89-63da-431b-9743-88237e6504ae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:51:52.391412 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.391389    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7947dc89-63da-431b-9743-88237e6504ae" (UID: "7947dc89-63da-431b-9743-88237e6504ae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:51:52.391495 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.391407    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7947dc89-63da-431b-9743-88237e6504ae-kube-api-access-bz59w" (OuterVolumeSpecName: "kube-api-access-bz59w") pod "7947dc89-63da-431b-9743-88237e6504ae" (UID: "7947dc89-63da-431b-9743-88237e6504ae"). InnerVolumeSpecName "kube-api-access-bz59w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:51:52.391495 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.391458    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7947dc89-63da-431b-9743-88237e6504ae" (UID: "7947dc89-63da-431b-9743-88237e6504ae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:51:52.490523 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.490485    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-console-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:51:52.490523 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.490521    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-oauth-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:51:52.490643 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.490531    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz59w\" (UniqueName: \"kubernetes.io/projected/7947dc89-63da-431b-9743-88237e6504ae-kube-api-access-bz59w\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:51:52.490643 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.490541    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-service-ca\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:51:52.490643 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.490551    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7947dc89-63da-431b-9743-88237e6504ae-trusted-ca-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:51:52.490643 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.490560    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-oauth-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:51:52.490643 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:52.490568    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7947dc89-63da-431b-9743-88237e6504ae-console-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:51:53.136248 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.136211    2580 generic.go:356] "Generic (PLEG): container finished" podID="7947dc89-63da-431b-9743-88237e6504ae" containerID="38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc" exitCode=0
Jul 07 12:51:53.136655 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.136262    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7766c79568-m7cm7"
Jul 07 12:51:53.136655 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.136285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7766c79568-m7cm7" event={"ID":"7947dc89-63da-431b-9743-88237e6504ae","Type":"ContainerDied","Data":"38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc"}
Jul 07 12:51:53.136655 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.136355    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7766c79568-m7cm7" event={"ID":"7947dc89-63da-431b-9743-88237e6504ae","Type":"ContainerDied","Data":"919a4394c1889c83bb2a9dcca301b1c8986c790e7da19cf494db18f45534d711"}
Jul 07 12:51:53.136655 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.136376    2580 scope.go:117] "RemoveContainer" containerID="38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc"
Jul 07 12:51:53.144795 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.144780    2580 scope.go:117] "RemoveContainer" containerID="38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc"
Jul 07 12:51:53.145024 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:51:53.145004    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc\": container with ID starting with 38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc not found: ID does not exist" containerID="38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc"
Jul 07 12:51:53.145087 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.145031    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc"} err="failed to get container status \"38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc\": rpc error: code = NotFound desc = could not find container \"38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc\": container with ID starting with 38dd962af077f2744f0dd08a8de0451d84c307249c738b2c5d838854a5885ccc not found: ID does not exist"
Jul 07 12:51:53.159131 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.159114    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7766c79568-m7cm7"]
Jul 07 12:51:53.163777 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:53.163757    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7766c79568-m7cm7"]
Jul 07 12:51:54.171014 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:51:54.170983    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7947dc89-63da-431b-9743-88237e6504ae" path="/var/lib/kubelet/pods/7947dc89-63da-431b-9743-88237e6504ae/volumes"
Jul 07 12:52:23.695693 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.693703    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f447b9b5d-vwmkx"]
Jul 07 12:52:23.695693 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.694323    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7947dc89-63da-431b-9743-88237e6504ae" containerName="console"
Jul 07 12:52:23.695693 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.694344    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7947dc89-63da-431b-9743-88237e6504ae" containerName="console"
Jul 07 12:52:23.695693 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.694445    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7947dc89-63da-431b-9743-88237e6504ae" containerName="console"
Jul 07 12:52:23.699140 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.699112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.713082 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.713058    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f447b9b5d-vwmkx"]
Jul 07 12:52:23.811491 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.811453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-console-config\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.811491 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.811490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-serving-cert\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.811716 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.811553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-trusted-ca-bundle\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.811716 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.811581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pqn2\" (UniqueName: \"kubernetes.io/projected/f899d953-b82b-49cb-81d4-86a88b3534c1-kube-api-access-4pqn2\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.811716 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.811627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-oauth-serving-cert\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.811716 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.811646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-service-ca\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.811716 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.811677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-oauth-config\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.912838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.912795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-console-config\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.912838 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.912841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-serving-cert\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913041 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.912869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-trusted-ca-bundle\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913041 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.912928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pqn2\" (UniqueName: \"kubernetes.io/projected/f899d953-b82b-49cb-81d4-86a88b3534c1-kube-api-access-4pqn2\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913041 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.912977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-oauth-serving-cert\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913041 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.913008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-service-ca\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913232 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.913072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-oauth-config\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913593 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.913563    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-console-config\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913724 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.913703    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-trusted-ca-bundle\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913784 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.913726    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-oauth-serving-cert\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.913784 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.913740    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-service-ca\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.915391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.915369    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-oauth-config\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.915599 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.915581    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-serving-cert\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:23.922073 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:23.922048    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pqn2\" (UniqueName: \"kubernetes.io/projected/f899d953-b82b-49cb-81d4-86a88b3534c1-kube-api-access-4pqn2\") pod \"console-7f447b9b5d-vwmkx\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") " pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:24.007537 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:24.007429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:24.138325 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:52:24.138299    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf899d953_b82b_49cb_81d4_86a88b3534c1.slice/crio-b1105db1f225d9614a253d94e31d0e12a1d4086dc117caa1d6bae8567c0e7052 WatchSource:0}: Error finding container b1105db1f225d9614a253d94e31d0e12a1d4086dc117caa1d6bae8567c0e7052: Status 404 returned error can't find the container with id b1105db1f225d9614a253d94e31d0e12a1d4086dc117caa1d6bae8567c0e7052
Jul 07 12:52:24.171042 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:24.171017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f447b9b5d-vwmkx"]
Jul 07 12:52:24.241017 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:24.240982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f447b9b5d-vwmkx" event={"ID":"f899d953-b82b-49cb-81d4-86a88b3534c1","Type":"ContainerStarted","Data":"44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e"}
Jul 07 12:52:24.241172 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:24.241039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f447b9b5d-vwmkx" event={"ID":"f899d953-b82b-49cb-81d4-86a88b3534c1","Type":"ContainerStarted","Data":"b1105db1f225d9614a253d94e31d0e12a1d4086dc117caa1d6bae8567c0e7052"}
Jul 07 12:52:24.265062 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:24.264969    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f447b9b5d-vwmkx" podStartSLOduration=1.264955612 podStartE2EDuration="1.264955612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:52:24.264130672 +0000 UTC m=+232.527307147" watchObservedRunningTime="2026-07-07 12:52:24.264955612 +0000 UTC m=+232.528132084"
Jul 07 12:52:34.007953 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:34.007911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:34.008453 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:34.008016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:34.012647 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:34.012626    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:34.286078 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:34.285997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:52:34.341976 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:34.341947    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568854cc9d-82hgq"]
Jul 07 12:52:59.368160 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.368114    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-568854cc9d-82hgq" podUID="6e51d811-5968-430a-ab29-78d1592d4b14" containerName="console" containerID="cri-o://3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d" gracePeriod=15
Jul 07 12:52:59.611239 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.611218    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:52:59.694373 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694343    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-serving-cert\") pod \"6e51d811-5968-430a-ab29-78d1592d4b14\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") "
Jul 07 12:52:59.694565 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694382    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-oauth-serving-cert\") pod \"6e51d811-5968-430a-ab29-78d1592d4b14\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") "
Jul 07 12:52:59.694565 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694400    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-oauth-config\") pod \"6e51d811-5968-430a-ab29-78d1592d4b14\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") "
Jul 07 12:52:59.694565 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694420    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fxhc\" (UniqueName: \"kubernetes.io/projected/6e51d811-5968-430a-ab29-78d1592d4b14-kube-api-access-4fxhc\") pod \"6e51d811-5968-430a-ab29-78d1592d4b14\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") "
Jul 07 12:52:59.694565 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694461    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-console-config\") pod \"6e51d811-5968-430a-ab29-78d1592d4b14\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") "
Jul 07 12:52:59.694565 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-trusted-ca-bundle\") pod \"6e51d811-5968-430a-ab29-78d1592d4b14\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") "
Jul 07 12:52:59.694565 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694524    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-service-ca\") pod \"6e51d811-5968-430a-ab29-78d1592d4b14\" (UID: \"6e51d811-5968-430a-ab29-78d1592d4b14\") "
Jul 07 12:52:59.694991 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694944    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e51d811-5968-430a-ab29-78d1592d4b14" (UID: "6e51d811-5968-430a-ab29-78d1592d4b14"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:52:59.694991 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694966    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e51d811-5968-430a-ab29-78d1592d4b14" (UID: "6e51d811-5968-430a-ab29-78d1592d4b14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:52:59.695134 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694986    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e51d811-5968-430a-ab29-78d1592d4b14" (UID: "6e51d811-5968-430a-ab29-78d1592d4b14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:52:59.695134 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.694993    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-console-config" (OuterVolumeSpecName: "console-config") pod "6e51d811-5968-430a-ab29-78d1592d4b14" (UID: "6e51d811-5968-430a-ab29-78d1592d4b14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:52:59.696671 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.696651    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e51d811-5968-430a-ab29-78d1592d4b14" (UID: "6e51d811-5968-430a-ab29-78d1592d4b14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:52:59.696968 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.696942    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e51d811-5968-430a-ab29-78d1592d4b14" (UID: "6e51d811-5968-430a-ab29-78d1592d4b14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:52:59.697043 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.696966    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e51d811-5968-430a-ab29-78d1592d4b14-kube-api-access-4fxhc" (OuterVolumeSpecName: "kube-api-access-4fxhc") pod "6e51d811-5968-430a-ab29-78d1592d4b14" (UID: "6e51d811-5968-430a-ab29-78d1592d4b14"). InnerVolumeSpecName "kube-api-access-4fxhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:52:59.795533 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.795493    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:52:59.795533 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.795529    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-oauth-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:52:59.795533 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.795539    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e51d811-5968-430a-ab29-78d1592d4b14-console-oauth-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:52:59.795748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.795548    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fxhc\" (UniqueName: \"kubernetes.io/projected/6e51d811-5968-430a-ab29-78d1592d4b14-kube-api-access-4fxhc\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:52:59.795748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.795557    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-console-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:52:59.795748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.795565    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-trusted-ca-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:52:59.795748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:52:59.795574    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e51d811-5968-430a-ab29-78d1592d4b14-service-ca\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:53:00.375862 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.375829    2580 generic.go:356] "Generic (PLEG): container finished" podID="6e51d811-5968-430a-ab29-78d1592d4b14" containerID="3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d" exitCode=0
Jul 07 12:53:00.376259 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.375878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568854cc9d-82hgq" event={"ID":"6e51d811-5968-430a-ab29-78d1592d4b14","Type":"ContainerDied","Data":"3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d"}
Jul 07 12:53:00.376259 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.375914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568854cc9d-82hgq" event={"ID":"6e51d811-5968-430a-ab29-78d1592d4b14","Type":"ContainerDied","Data":"8280754d0212e50636c8cf81bb3e313184001e9270bc38eeb89118077a98c2fa"}
Jul 07 12:53:00.376259 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.375933    2580 scope.go:117] "RemoveContainer" containerID="3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d"
Jul 07 12:53:00.376259 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.375878    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568854cc9d-82hgq"
Jul 07 12:53:00.383726 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.383708    2580 scope.go:117] "RemoveContainer" containerID="3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d"
Jul 07 12:53:00.384017 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:53:00.383981    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d\": container with ID starting with 3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d not found: ID does not exist" containerID="3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d"
Jul 07 12:53:00.384061 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.384017    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d"} err="failed to get container status \"3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d\": rpc error: code = NotFound desc = could not find container \"3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d\": container with ID starting with 3d6d2995e7fc4bd783d9f81cb9507256dc7cfa06e3141e8156a50a575ef8955d not found: ID does not exist"
Jul 07 12:53:00.394241 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.394222    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568854cc9d-82hgq"]
Jul 07 12:53:00.399879 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:00.399860    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568854cc9d-82hgq"]
Jul 07 12:53:02.171807 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:02.171775    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e51d811-5968-430a-ab29-78d1592d4b14" path="/var/lib/kubelet/pods/6e51d811-5968-430a-ab29-78d1592d4b14/volumes"
Jul 07 12:53:17.135153 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.135120    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"]
Jul 07 12:53:17.135522 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.135356    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e51d811-5968-430a-ab29-78d1592d4b14" containerName="console"
Jul 07 12:53:17.135522 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.135366    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e51d811-5968-430a-ab29-78d1592d4b14" containerName="console"
Jul 07 12:53:17.135522 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.135436    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e51d811-5968-430a-ab29-78d1592d4b14" containerName="console"
Jul 07 12:53:17.139730 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.139713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.141966 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.141944    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 12:53:17.141966 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.141956    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 12:53:17.142630 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.142613    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vlg\""
Jul 07 12:53:17.148846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.148825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"]
Jul 07 12:53:17.215835 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.215812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbtf\" (UniqueName: \"kubernetes.io/projected/23e60de8-d9c5-4627-af70-5cab133cb91d-kube-api-access-2kbtf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.215937 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.215839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.215937 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.215908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.316196 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.316171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.316298 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.316214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbtf\" (UniqueName: \"kubernetes.io/projected/23e60de8-d9c5-4627-af70-5cab133cb91d-kube-api-access-2kbtf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.316298 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.316233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.316501 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.316485    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.316591 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.316577    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.324803 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.324787    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbtf\" (UniqueName: \"kubernetes.io/projected/23e60de8-d9c5-4627-af70-5cab133cb91d-kube-api-access-2kbtf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.448720 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.448653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:17.572167 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:17.572018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"]
Jul 07 12:53:17.574687 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:53:17.574659    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e60de8_d9c5_4627_af70_5cab133cb91d.slice/crio-f9cb70d7a118bd7a74eed0ba48c4158132211fce474859df6f24ab9911688baf WatchSource:0}: Error finding container f9cb70d7a118bd7a74eed0ba48c4158132211fce474859df6f24ab9911688baf: Status 404 returned error can't find the container with id f9cb70d7a118bd7a74eed0ba48c4158132211fce474859df6f24ab9911688baf
Jul 07 12:53:18.441381 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:18.441339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh" event={"ID":"23e60de8-d9c5-4627-af70-5cab133cb91d","Type":"ContainerStarted","Data":"f9cb70d7a118bd7a74eed0ba48c4158132211fce474859df6f24ab9911688baf"}
Jul 07 12:53:25.470244 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:25.470210    2580 generic.go:356] "Generic (PLEG): container finished" podID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerID="86739d6fae6f3f9581568f66af84e6ca7aec43ecee7d74cef32fd437b7393938" exitCode=0
Jul 07 12:53:25.470664 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:25.470295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh" event={"ID":"23e60de8-d9c5-4627-af70-5cab133cb91d","Type":"ContainerDied","Data":"86739d6fae6f3f9581568f66af84e6ca7aec43ecee7d74cef32fd437b7393938"}
Jul 07 12:53:32.087043 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:32.087015    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 12:53:32.500285 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:32.500257    2580 generic.go:356] "Generic (PLEG): container finished" podID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerID="97733104e20eb85807b623b1691c72ac56fb232bc71b479b4bbf58782aa36985" exitCode=0
Jul 07 12:53:32.502413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:32.500302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh" event={"ID":"23e60de8-d9c5-4627-af70-5cab133cb91d","Type":"ContainerDied","Data":"97733104e20eb85807b623b1691c72ac56fb232bc71b479b4bbf58782aa36985"}
Jul 07 12:53:40.534049 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:40.533976    2580 generic.go:356] "Generic (PLEG): container finished" podID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerID="7aa3a7e1e08c51da7f2de4e43c208e645cd7bc316abe5596ffbe2a4dc3f18ca3" exitCode=0
Jul 07 12:53:40.534049 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:40.534028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh" event={"ID":"23e60de8-d9c5-4627-af70-5cab133cb91d","Type":"ContainerDied","Data":"7aa3a7e1e08c51da7f2de4e43c208e645cd7bc316abe5596ffbe2a4dc3f18ca3"}
Jul 07 12:53:41.654432 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.654411    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:41.804642 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.804568    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-util\") pod \"23e60de8-d9c5-4627-af70-5cab133cb91d\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") "
Jul 07 12:53:41.804642 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.804600    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-bundle\") pod \"23e60de8-d9c5-4627-af70-5cab133cb91d\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") "
Jul 07 12:53:41.804642 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.804632    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kbtf\" (UniqueName: \"kubernetes.io/projected/23e60de8-d9c5-4627-af70-5cab133cb91d-kube-api-access-2kbtf\") pod \"23e60de8-d9c5-4627-af70-5cab133cb91d\" (UID: \"23e60de8-d9c5-4627-af70-5cab133cb91d\") "
Jul 07 12:53:41.805311 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.805290    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-bundle" (OuterVolumeSpecName: "bundle") pod "23e60de8-d9c5-4627-af70-5cab133cb91d" (UID: "23e60de8-d9c5-4627-af70-5cab133cb91d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:53:41.806813 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.806793    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e60de8-d9c5-4627-af70-5cab133cb91d-kube-api-access-2kbtf" (OuterVolumeSpecName: "kube-api-access-2kbtf") pod "23e60de8-d9c5-4627-af70-5cab133cb91d" (UID: "23e60de8-d9c5-4627-af70-5cab133cb91d"). InnerVolumeSpecName "kube-api-access-2kbtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:53:41.809524 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.809482    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-util" (OuterVolumeSpecName: "util") pod "23e60de8-d9c5-4627-af70-5cab133cb91d" (UID: "23e60de8-d9c5-4627-af70-5cab133cb91d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:53:41.905217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.905182    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-util\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:53:41.905217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.905213    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e60de8-d9c5-4627-af70-5cab133cb91d-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:53:41.905217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:41.905223    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kbtf\" (UniqueName: \"kubernetes.io/projected/23e60de8-d9c5-4627-af70-5cab133cb91d-kube-api-access-2kbtf\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:53:42.542275 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:42.542206    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh"
Jul 07 12:53:42.542398 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:42.542200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407vlbh" event={"ID":"23e60de8-d9c5-4627-af70-5cab133cb91d","Type":"ContainerDied","Data":"f9cb70d7a118bd7a74eed0ba48c4158132211fce474859df6f24ab9911688baf"}
Jul 07 12:53:42.542398 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:42.542326    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9cb70d7a118bd7a74eed0ba48c4158132211fce474859df6f24ab9911688baf"
Jul 07 12:53:50.548213 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548180    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"]
Jul 07 12:53:50.548624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548428    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerName="pull"
Jul 07 12:53:50.548624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548439    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerName="pull"
Jul 07 12:53:50.548624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548449    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerName="extract"
Jul 07 12:53:50.548624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548464    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerName="extract"
Jul 07 12:53:50.548624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548478    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerName="util"
Jul 07 12:53:50.548624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548484    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerName="util"
Jul 07 12:53:50.548624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.548542    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="23e60de8-d9c5-4627-af70-5cab133cb91d" containerName="extract"
Jul 07 12:53:50.551544 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.551528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.553892 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.553870    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 12:53:50.554017 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.553871    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 12:53:50.554017 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.553908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fdnx5\""
Jul 07 12:53:50.564547 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.564525    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"]
Jul 07 12:53:50.666423 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.666397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9vwr\" (UniqueName: \"kubernetes.io/projected/27383158-a840-4b56-98a3-baf47af402b3-kube-api-access-w9vwr\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzfnp\" (UID: \"27383158-a840-4b56-98a3-baf47af402b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.666598 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.666450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27383158-a840-4b56-98a3-baf47af402b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzfnp\" (UID: \"27383158-a840-4b56-98a3-baf47af402b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.767243 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.767209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9vwr\" (UniqueName: \"kubernetes.io/projected/27383158-a840-4b56-98a3-baf47af402b3-kube-api-access-w9vwr\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzfnp\" (UID: \"27383158-a840-4b56-98a3-baf47af402b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.767398 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.767278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27383158-a840-4b56-98a3-baf47af402b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzfnp\" (UID: \"27383158-a840-4b56-98a3-baf47af402b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.767670 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.767653    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27383158-a840-4b56-98a3-baf47af402b3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzfnp\" (UID: \"27383158-a840-4b56-98a3-baf47af402b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.776650 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.776602    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9vwr\" (UniqueName: \"kubernetes.io/projected/27383158-a840-4b56-98a3-baf47af402b3-kube-api-access-w9vwr\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzfnp\" (UID: \"27383158-a840-4b56-98a3-baf47af402b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.860119 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.860052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"
Jul 07 12:53:50.998147 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:50.998112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp"]
Jul 07 12:53:51.001922 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:53:51.001899    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27383158_a840_4b56_98a3_baf47af402b3.slice/crio-8ebb2aa40e254f60963c3998be8474826515d0a6dd9437f263734b8924ed3f19 WatchSource:0}: Error finding container 8ebb2aa40e254f60963c3998be8474826515d0a6dd9437f263734b8924ed3f19: Status 404 returned error can't find the container with id 8ebb2aa40e254f60963c3998be8474826515d0a6dd9437f263734b8924ed3f19
Jul 07 12:53:51.004583 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:51.004567    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 12:53:51.574183 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:51.574153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp" event={"ID":"27383158-a840-4b56-98a3-baf47af402b3","Type":"ContainerStarted","Data":"8ebb2aa40e254f60963c3998be8474826515d0a6dd9437f263734b8924ed3f19"}
Jul 07 12:53:52.579953 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:52.579915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp" event={"ID":"27383158-a840-4b56-98a3-baf47af402b3","Type":"ContainerStarted","Data":"07131c645da0839658d8995a938af5936350457e4cd64099425130ac93d71430"}
Jul 07 12:53:52.650800 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:52.650748    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzfnp" podStartSLOduration=1.238522755 podStartE2EDuration="2.650729281s" totalImagesPullingTime="1.412206526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:53:52.649222106 +0000 UTC m=+320.912398579" watchObservedRunningTime="2026-07-07 12:53:52.650729281 +0000 UTC m=+320.913905753"
Jul 07 12:53:54.000543 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.000495    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"]
Jul 07 12:53:54.003861 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.003842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.006409 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.006383    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 12:53:54.006548 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.006383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vlg\""
Jul 07 12:53:54.007233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.007214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 12:53:54.015035 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.015005    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"]
Jul 07 12:53:54.096703 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.096672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsm5\" (UniqueName: \"kubernetes.io/projected/e85237cf-1f93-4f81-a6d1-8c99064a9604-kube-api-access-hdsm5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.096853 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.096716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.096853 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.096804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.197819 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.197791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsm5\" (UniqueName: \"kubernetes.io/projected/e85237cf-1f93-4f81-a6d1-8c99064a9604-kube-api-access-hdsm5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.197977 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.197831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.197977 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.197872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.198209 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.198193    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.198246 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.198224    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.215577 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.215556    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsm5\" (UniqueName: \"kubernetes.io/projected/e85237cf-1f93-4f81-a6d1-8c99064a9604-kube-api-access-hdsm5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.313776 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.313698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:54.455760 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.455727    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"]
Jul 07 12:53:54.458408 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:53:54.458380    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85237cf_1f93_4f81_a6d1_8c99064a9604.slice/crio-df1fd07835de6b60eab424e7ae935a63f712b0742382651fcab972649d979c3c WatchSource:0}: Error finding container df1fd07835de6b60eab424e7ae935a63f712b0742382651fcab972649d979c3c: Status 404 returned error can't find the container with id df1fd07835de6b60eab424e7ae935a63f712b0742382651fcab972649d979c3c
Jul 07 12:53:54.588541 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.588467    2580 generic.go:356] "Generic (PLEG): container finished" podID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerID="06f6bff95c6572c69fa76571358e2f0174cad24e1e70f508c54aa65b7fb457a8" exitCode=0
Jul 07 12:53:54.588636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.588545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9" event={"ID":"e85237cf-1f93-4f81-a6d1-8c99064a9604","Type":"ContainerDied","Data":"06f6bff95c6572c69fa76571358e2f0174cad24e1e70f508c54aa65b7fb457a8"}
Jul 07 12:53:54.588636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:54.588603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9" event={"ID":"e85237cf-1f93-4f81-a6d1-8c99064a9604","Type":"ContainerStarted","Data":"df1fd07835de6b60eab424e7ae935a63f712b0742382651fcab972649d979c3c"}
Jul 07 12:53:55.975811 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:55.975781    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"]
Jul 07 12:53:55.984114 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:55.984086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:55.988266 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:55.988238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"]
Jul 07 12:53:55.990748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:55.990640    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-m6zrk\""
Jul 07 12:53:55.990748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:55.990696    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 12:53:55.990940 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:55.990702    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 12:53:56.112746 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.112701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f071771-d3ec-4a47-9358-af9478112f4c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bhzgc\" (UID: \"4f071771-d3ec-4a47-9358-af9478112f4c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:56.112746 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.112751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dhx\" (UniqueName: \"kubernetes.io/projected/4f071771-d3ec-4a47-9358-af9478112f4c-kube-api-access-q7dhx\") pod \"cert-manager-cainjector-559cdd8c87-bhzgc\" (UID: \"4f071771-d3ec-4a47-9358-af9478112f4c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:56.213221 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.213191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dhx\" (UniqueName: \"kubernetes.io/projected/4f071771-d3ec-4a47-9358-af9478112f4c-kube-api-access-q7dhx\") pod \"cert-manager-cainjector-559cdd8c87-bhzgc\" (UID: \"4f071771-d3ec-4a47-9358-af9478112f4c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:56.213396 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.213291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f071771-d3ec-4a47-9358-af9478112f4c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bhzgc\" (UID: \"4f071771-d3ec-4a47-9358-af9478112f4c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:56.222006 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.221978    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dhx\" (UniqueName: \"kubernetes.io/projected/4f071771-d3ec-4a47-9358-af9478112f4c-kube-api-access-q7dhx\") pod \"cert-manager-cainjector-559cdd8c87-bhzgc\" (UID: \"4f071771-d3ec-4a47-9358-af9478112f4c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:56.222405 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.222372    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f071771-d3ec-4a47-9358-af9478112f4c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bhzgc\" (UID: \"4f071771-d3ec-4a47-9358-af9478112f4c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:56.303731 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.303659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"
Jul 07 12:53:56.552210 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.552071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc"]
Jul 07 12:53:56.554258 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:53:56.554209    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f071771_d3ec_4a47_9358_af9478112f4c.slice/crio-4f390c34e61c69bdb8efaac6ef19cf5f51227ce2a702e67f31faf8f3d0cb993e WatchSource:0}: Error finding container 4f390c34e61c69bdb8efaac6ef19cf5f51227ce2a702e67f31faf8f3d0cb993e: Status 404 returned error can't find the container with id 4f390c34e61c69bdb8efaac6ef19cf5f51227ce2a702e67f31faf8f3d0cb993e
Jul 07 12:53:56.602182 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.602150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9" event={"ID":"e85237cf-1f93-4f81-a6d1-8c99064a9604","Type":"ContainerStarted","Data":"46da0a5ae00d313c5d41d5e8926eda0ab0825522466a38d139a277180c60030e"}
Jul 07 12:53:56.603621 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:56.603597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc" event={"ID":"4f071771-d3ec-4a47-9358-af9478112f4c","Type":"ContainerStarted","Data":"4f390c34e61c69bdb8efaac6ef19cf5f51227ce2a702e67f31faf8f3d0cb993e"}
Jul 07 12:53:57.609783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:57.609690    2580 generic.go:356] "Generic (PLEG): container finished" podID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerID="46da0a5ae00d313c5d41d5e8926eda0ab0825522466a38d139a277180c60030e" exitCode=0
Jul 07 12:53:57.609783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:57.609766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9" event={"ID":"e85237cf-1f93-4f81-a6d1-8c99064a9604","Type":"ContainerDied","Data":"46da0a5ae00d313c5d41d5e8926eda0ab0825522466a38d139a277180c60030e"}
Jul 07 12:53:58.615868 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:58.615829    2580 generic.go:356] "Generic (PLEG): container finished" podID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerID="afc5cc9febb23a55c5d9c0b8ef6b0b56d39080f905a8a6e1800c8007ac7df8ed" exitCode=0
Jul 07 12:53:58.616211 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:58.615917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9" event={"ID":"e85237cf-1f93-4f81-a6d1-8c99064a9604","Type":"ContainerDied","Data":"afc5cc9febb23a55c5d9c0b8ef6b0b56d39080f905a8a6e1800c8007ac7df8ed"}
Jul 07 12:53:59.748176 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.748154    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:53:59.842460 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.842430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdsm5\" (UniqueName: \"kubernetes.io/projected/e85237cf-1f93-4f81-a6d1-8c99064a9604-kube-api-access-hdsm5\") pod \"e85237cf-1f93-4f81-a6d1-8c99064a9604\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") "
Jul 07 12:53:59.842460 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.842466    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-bundle\") pod \"e85237cf-1f93-4f81-a6d1-8c99064a9604\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") "
Jul 07 12:53:59.842708 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.842551    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-util\") pod \"e85237cf-1f93-4f81-a6d1-8c99064a9604\" (UID: \"e85237cf-1f93-4f81-a6d1-8c99064a9604\") "
Jul 07 12:53:59.842926 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.842897    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-bundle" (OuterVolumeSpecName: "bundle") pod "e85237cf-1f93-4f81-a6d1-8c99064a9604" (UID: "e85237cf-1f93-4f81-a6d1-8c99064a9604"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:53:59.844546 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.844486    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e85237cf-1f93-4f81-a6d1-8c99064a9604-kube-api-access-hdsm5" (OuterVolumeSpecName: "kube-api-access-hdsm5") pod "e85237cf-1f93-4f81-a6d1-8c99064a9604" (UID: "e85237cf-1f93-4f81-a6d1-8c99064a9604"). InnerVolumeSpecName "kube-api-access-hdsm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:53:59.847989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.847966    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-util" (OuterVolumeSpecName: "util") pod "e85237cf-1f93-4f81-a6d1-8c99064a9604" (UID: "e85237cf-1f93-4f81-a6d1-8c99064a9604"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:53:59.943582 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.943554    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-util\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:53:59.943582 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.943578    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdsm5\" (UniqueName: \"kubernetes.io/projected/e85237cf-1f93-4f81-a6d1-8c99064a9604-kube-api-access-hdsm5\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:53:59.943582 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:53:59.943588    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e85237cf-1f93-4f81-a6d1-8c99064a9604-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:54:00.134858 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.134823    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x4m59"]
Jul 07 12:54:00.135087 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.135075    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerName="util"
Jul 07 12:54:00.135129 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.135089    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerName="util"
Jul 07 12:54:00.135129 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.135097    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerName="extract"
Jul 07 12:54:00.135129 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.135104    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerName="extract"
Jul 07 12:54:00.135129 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.135118    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerName="pull"
Jul 07 12:54:00.135129 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.135125    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerName="pull"
Jul 07 12:54:00.135279 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.135187    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e85237cf-1f93-4f81-a6d1-8c99064a9604" containerName="extract"
Jul 07 12:54:00.138079 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.138061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.141741 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.141725    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xscwj\""
Jul 07 12:54:00.152207 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.152182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x4m59"]
Jul 07 12:54:00.245961 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.245895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5kq9\" (UniqueName: \"kubernetes.io/projected/f74bb699-1b4b-4b5d-8493-94b39dff01ac-kube-api-access-g5kq9\") pod \"cert-manager-webhook-6486ffd997-x4m59\" (UID: \"f74bb699-1b4b-4b5d-8493-94b39dff01ac\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.246071 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.246039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f74bb699-1b4b-4b5d-8493-94b39dff01ac-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x4m59\" (UID: \"f74bb699-1b4b-4b5d-8493-94b39dff01ac\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.347141 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.347107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f74bb699-1b4b-4b5d-8493-94b39dff01ac-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x4m59\" (UID: \"f74bb699-1b4b-4b5d-8493-94b39dff01ac\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.347266 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.347151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5kq9\" (UniqueName: \"kubernetes.io/projected/f74bb699-1b4b-4b5d-8493-94b39dff01ac-kube-api-access-g5kq9\") pod \"cert-manager-webhook-6486ffd997-x4m59\" (UID: \"f74bb699-1b4b-4b5d-8493-94b39dff01ac\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.356979 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.356947    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f74bb699-1b4b-4b5d-8493-94b39dff01ac-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x4m59\" (UID: \"f74bb699-1b4b-4b5d-8493-94b39dff01ac\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.357106 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.357084    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5kq9\" (UniqueName: \"kubernetes.io/projected/f74bb699-1b4b-4b5d-8493-94b39dff01ac-kube-api-access-g5kq9\") pod \"cert-manager-webhook-6486ffd997-x4m59\" (UID: \"f74bb699-1b4b-4b5d-8493-94b39dff01ac\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.446822 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.446795    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.566585 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.566557    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x4m59"]
Jul 07 12:54:00.568931 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:54:00.568908    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf74bb699_1b4b_4b5d_8493_94b39dff01ac.slice/crio-c7195b6528baec13df202905a80bc13696cf2a8a36879c862a3ffe89e355af04 WatchSource:0}: Error finding container c7195b6528baec13df202905a80bc13696cf2a8a36879c862a3ffe89e355af04: Status 404 returned error can't find the container with id c7195b6528baec13df202905a80bc13696cf2a8a36879c862a3ffe89e355af04
Jul 07 12:54:00.625999 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.625977    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9"
Jul 07 12:54:00.626117 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.625976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mcs9" event={"ID":"e85237cf-1f93-4f81-a6d1-8c99064a9604","Type":"ContainerDied","Data":"df1fd07835de6b60eab424e7ae935a63f712b0742382651fcab972649d979c3c"}
Jul 07 12:54:00.626117 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.626104    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df1fd07835de6b60eab424e7ae935a63f712b0742382651fcab972649d979c3c"
Jul 07 12:54:00.627697 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.627650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc" event={"ID":"4f071771-d3ec-4a47-9358-af9478112f4c","Type":"ContainerStarted","Data":"5ab40756858a7cf80c520510657176138d7ccbad32971a8b3e5fec1c496ded46"}
Jul 07 12:54:00.629539 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.629518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59" event={"ID":"f74bb699-1b4b-4b5d-8493-94b39dff01ac","Type":"ContainerStarted","Data":"7470d00c95244c815438fcaa1bb4cac24bbd1300402a43e458e034dbab38e15c"}
Jul 07 12:54:00.629637 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.629549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59" event={"ID":"f74bb699-1b4b-4b5d-8493-94b39dff01ac","Type":"ContainerStarted","Data":"c7195b6528baec13df202905a80bc13696cf2a8a36879c862a3ffe89e355af04"}
Jul 07 12:54:00.629700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.629630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:00.666993 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.666950    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bhzgc" podStartSLOduration=2.601243247 podStartE2EDuration="5.666935743s" totalImagesPullingTime="3.065692496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:00.665275436 +0000 UTC m=+328.928451908" watchObservedRunningTime="2026-07-07 12:54:00.666935743 +0000 UTC m=+328.930112214"
Jul 07 12:54:00.711007 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:00.710965    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59" podStartSLOduration=0.710950327 podStartE2EDuration="710.950327ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:00.709881683 +0000 UTC m=+328.973058155" watchObservedRunningTime="2026-07-07 12:54:00.710950327 +0000 UTC m=+328.974126798"
Jul 07 12:54:06.635483 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:06.635453    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x4m59"
Jul 07 12:54:16.875407 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.875372    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"]
Jul 07 12:54:16.882458 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.882431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:16.884897 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.884869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"]
Jul 07 12:54:16.885020 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.884925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6vlg\""
Jul 07 12:54:16.885020 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.884925    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 12:54:16.885818 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.885795    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 12:54:16.955386 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.955361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnwl\" (UniqueName: \"kubernetes.io/projected/0e605ca9-25ba-4582-a421-6cb2fed8e645-kube-api-access-wqnwl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:16.955484 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.955415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:16.955484 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:16.955457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.055785 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.055749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.055895 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.055796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.055895 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.055844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnwl\" (UniqueName: \"kubernetes.io/projected/0e605ca9-25ba-4582-a421-6cb2fed8e645-kube-api-access-wqnwl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.056111 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.056092    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.056176 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.056131    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.067687 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.067662    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnwl\" (UniqueName: \"kubernetes.io/projected/0e605ca9-25ba-4582-a421-6cb2fed8e645-kube-api-access-wqnwl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.192931 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.192871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:17.320298 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.320274    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"]
Jul 07 12:54:17.321987 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:54:17.321962    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e605ca9_25ba_4582_a421_6cb2fed8e645.slice/crio-bff839154d97c29e92f27dddef46457e12964d7148654c8e619330cc0749e673 WatchSource:0}: Error finding container bff839154d97c29e92f27dddef46457e12964d7148654c8e619330cc0749e673: Status 404 returned error can't find the container with id bff839154d97c29e92f27dddef46457e12964d7148654c8e619330cc0749e673
Jul 07 12:54:17.698776 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.698740    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerID="eb66f7b44ae42d40e68febc01890f3187b4328921c55329f8aeb23e20e974200" exitCode=0
Jul 07 12:54:17.698927 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.698831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n" event={"ID":"0e605ca9-25ba-4582-a421-6cb2fed8e645","Type":"ContainerDied","Data":"eb66f7b44ae42d40e68febc01890f3187b4328921c55329f8aeb23e20e974200"}
Jul 07 12:54:17.698927 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:17.698891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n" event={"ID":"0e605ca9-25ba-4582-a421-6cb2fed8e645","Type":"ContainerStarted","Data":"bff839154d97c29e92f27dddef46457e12964d7148654c8e619330cc0749e673"}
Jul 07 12:54:18.705502 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:18.705469    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerID="4a8b756319a556820f162e4b9e5b1f9008a87aaae8e54e33cd440cfc788eeb03" exitCode=0
Jul 07 12:54:18.705887 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:18.705534    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n" event={"ID":"0e605ca9-25ba-4582-a421-6cb2fed8e645","Type":"ContainerDied","Data":"4a8b756319a556820f162e4b9e5b1f9008a87aaae8e54e33cd440cfc788eeb03"}
Jul 07 12:54:19.711582 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:19.711552    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerID="c08407ee3171a19ea868cef7870e2fc8fc553231a4e3f4519232e7498ed78e06" exitCode=0
Jul 07 12:54:19.711929 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:19.711625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n" event={"ID":"0e605ca9-25ba-4582-a421-6cb2fed8e645","Type":"ContainerDied","Data":"c08407ee3171a19ea868cef7870e2fc8fc553231a4e3f4519232e7498ed78e06"}
Jul 07 12:54:20.838288 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.838265    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:20.878319 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.878296    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-bundle\") pod \"0e605ca9-25ba-4582-a421-6cb2fed8e645\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") "
Jul 07 12:54:20.878430 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.878375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqnwl\" (UniqueName: \"kubernetes.io/projected/0e605ca9-25ba-4582-a421-6cb2fed8e645-kube-api-access-wqnwl\") pod \"0e605ca9-25ba-4582-a421-6cb2fed8e645\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") "
Jul 07 12:54:20.878430 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.878402    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-util\") pod \"0e605ca9-25ba-4582-a421-6cb2fed8e645\" (UID: \"0e605ca9-25ba-4582-a421-6cb2fed8e645\") "
Jul 07 12:54:20.879043 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.879020    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-bundle" (OuterVolumeSpecName: "bundle") pod "0e605ca9-25ba-4582-a421-6cb2fed8e645" (UID: "0e605ca9-25ba-4582-a421-6cb2fed8e645"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:54:20.880367 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.880333    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e605ca9-25ba-4582-a421-6cb2fed8e645-kube-api-access-wqnwl" (OuterVolumeSpecName: "kube-api-access-wqnwl") pod "0e605ca9-25ba-4582-a421-6cb2fed8e645" (UID: "0e605ca9-25ba-4582-a421-6cb2fed8e645"). InnerVolumeSpecName "kube-api-access-wqnwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:54:20.884009 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.883990    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-util" (OuterVolumeSpecName: "util") pod "0e605ca9-25ba-4582-a421-6cb2fed8e645" (UID: "0e605ca9-25ba-4582-a421-6cb2fed8e645"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:54:20.979666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.979619    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqnwl\" (UniqueName: \"kubernetes.io/projected/0e605ca9-25ba-4582-a421-6cb2fed8e645-kube-api-access-wqnwl\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:54:20.979666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.979638    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-util\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:54:20.979666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:20.979647    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e605ca9-25ba-4582-a421-6cb2fed8e645-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:54:21.720639 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:21.720609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n" event={"ID":"0e605ca9-25ba-4582-a421-6cb2fed8e645","Type":"ContainerDied","Data":"bff839154d97c29e92f27dddef46457e12964d7148654c8e619330cc0749e673"}
Jul 07 12:54:21.720789 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:21.720652    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bff839154d97c29e92f27dddef46457e12964d7148654c8e619330cc0749e673"
Jul 07 12:54:21.720789 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:21.720656    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxwg5n"
Jul 07 12:54:28.596742 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.596669    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"]
Jul 07 12:54:28.597094 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.596976    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerName="util"
Jul 07 12:54:28.597094 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.596988    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerName="util"
Jul 07 12:54:28.597094 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.596997    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerName="pull"
Jul 07 12:54:28.597094 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.597003    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerName="pull"
Jul 07 12:54:28.597094 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.597013    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerName="extract"
Jul 07 12:54:28.597094 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.597019    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerName="extract"
Jul 07 12:54:28.597094 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.597070    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e605ca9-25ba-4582-a421-6cb2fed8e645" containerName="extract"
Jul 07 12:54:28.600032 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.600016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.602824 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.602801    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 12:54:28.602824 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.602818    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gknqs\""
Jul 07 12:54:28.603004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.602806    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 12:54:28.603004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.602843    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 12:54:28.603093 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.603080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 12:54:28.633307 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.633286    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"]
Jul 07 12:54:28.637020 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.637000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c430c94d-a536-458d-b3ae-0fd460749c8d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.637110 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.637038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c430c94d-a536-458d-b3ae-0fd460749c8d-tmp\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.637110 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.637067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c430c94d-a536-458d-b3ae-0fd460749c8d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.637190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.637118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c430c94d-a536-458d-b3ae-0fd460749c8d-manifests\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.637190 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.637137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5hhn\" (UniqueName: \"kubernetes.io/projected/c430c94d-a536-458d-b3ae-0fd460749c8d-kube-api-access-t5hhn\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.738411 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.738381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c430c94d-a536-458d-b3ae-0fd460749c8d-manifests\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.738532 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.738415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5hhn\" (UniqueName: \"kubernetes.io/projected/c430c94d-a536-458d-b3ae-0fd460749c8d-kube-api-access-t5hhn\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.738532 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.738437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c430c94d-a536-458d-b3ae-0fd460749c8d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.738532 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.738472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c430c94d-a536-458d-b3ae-0fd460749c8d-tmp\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.738532 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.738524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c430c94d-a536-458d-b3ae-0fd460749c8d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.738818 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.738800    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c430c94d-a536-458d-b3ae-0fd460749c8d-manifests\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.740783 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.740756    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c430c94d-a536-458d-b3ae-0fd460749c8d-tmp\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.740925 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.740907    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c430c94d-a536-458d-b3ae-0fd460749c8d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.740974 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.740954    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c430c94d-a536-458d-b3ae-0fd460749c8d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.754379 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.754353    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5hhn\" (UniqueName: \"kubernetes.io/projected/c430c94d-a536-458d-b3ae-0fd460749c8d-kube-api-access-t5hhn\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-mth9t\" (UID: \"c430c94d-a536-458d-b3ae-0fd460749c8d\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:28.909673 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:28.909638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:29.043149 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:29.043124    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"]
Jul 07 12:54:29.045071 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:54:29.045050    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc430c94d_a536_458d_b3ae_0fd460749c8d.slice/crio-ee33ba9597df7f25e3867037051cdd42efa3a251d8a130e534c9c43fe38831db WatchSource:0}: Error finding container ee33ba9597df7f25e3867037051cdd42efa3a251d8a130e534c9c43fe38831db: Status 404 returned error can't find the container with id ee33ba9597df7f25e3867037051cdd42efa3a251d8a130e534c9c43fe38831db
Jul 07 12:54:29.759269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:29.759230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t" event={"ID":"c430c94d-a536-458d-b3ae-0fd460749c8d","Type":"ContainerStarted","Data":"ee33ba9597df7f25e3867037051cdd42efa3a251d8a130e534c9c43fe38831db"}
Jul 07 12:54:32.773825 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:32.773789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t" event={"ID":"c430c94d-a536-458d-b3ae-0fd460749c8d","Type":"ContainerStarted","Data":"a84a3cab5d94b0cc983a71410f729c0b55886b438c5e38ab31e7552098158e94"}
Jul 07 12:54:33.779246 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:33.779211    2580 generic.go:356] "Generic (PLEG): container finished" podID="c430c94d-a536-458d-b3ae-0fd460749c8d" containerID="a84a3cab5d94b0cc983a71410f729c0b55886b438c5e38ab31e7552098158e94" exitCode=0
Jul 07 12:54:33.779685 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:33.779293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t" event={"ID":"c430c94d-a536-458d-b3ae-0fd460749c8d","Type":"ContainerDied","Data":"a84a3cab5d94b0cc983a71410f729c0b55886b438c5e38ab31e7552098158e94"}
Jul 07 12:54:34.784967 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:34.784936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t" event={"ID":"c430c94d-a536-458d-b3ae-0fd460749c8d","Type":"ContainerStarted","Data":"3dd1ba2f226e2df4675754a33f5c05ab6b94c6477d8d0fde14b65840273a7120"}
Jul 07 12:54:34.785426 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:34.785046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:34.806084 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:34.806040    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t" podStartSLOduration=2.157753383 podStartE2EDuration="6.806026576s" totalImagesPullingTime="3.575190308s" totalInitContainerRuntime="1.073082885s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:34.80356007 +0000 UTC m=+363.066736542" watchObservedRunningTime="2026-07-07 12:54:34.806026576 +0000 UTC m=+363.069203047"
Jul 07 12:54:45.791977 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:45.791945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-mth9t"
Jul 07 12:54:48.555910 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.555874    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"]
Jul 07 12:54:48.563824 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.563802    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.571775 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.571755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 12:54:48.571897 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.571858    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 12:54:48.572071 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.572059    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 12:54:48.573821 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.573799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 12:54:48.585946 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.585924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"]
Jul 07 12:54:48.688323 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.688294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-tls-certs\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.688599 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.688357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-tmp\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.688599 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.688399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gnq8\" (UniqueName: \"kubernetes.io/projected/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-kube-api-access-5gnq8\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.789601 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.789572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-tls-certs\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.789865 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.789836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-tmp\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.789967 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.789902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gnq8\" (UniqueName: \"kubernetes.io/projected/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-kube-api-access-5gnq8\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.792599 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.792580    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-tmp\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.792918 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.792896    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-tls-certs\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.836744 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.836684    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gnq8\" (UniqueName: \"kubernetes.io/projected/ebd638d4-d966-4d0d-a7d3-2d20ba15cd95-kube-api-access-5gnq8\") pod \"kube-auth-proxy-677fdffd75-27hnl\" (UID: \"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95\") " pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:48.872669 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:48.872639    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"
Jul 07 12:54:49.046619 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.046584    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-677fdffd75-27hnl"]
Jul 07 12:54:49.049410 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.049387    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f2jdg"]
Jul 07 12:54:49.052556 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:54:49.052494    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd638d4_d966_4d0d_a7d3_2d20ba15cd95.slice/crio-3899d081bf3461ba8b996a6e3b41c4cf4126228d541e3720fb739836b0e90986 WatchSource:0}: Error finding container 3899d081bf3461ba8b996a6e3b41c4cf4126228d541e3720fb739836b0e90986: Status 404 returned error can't find the container with id 3899d081bf3461ba8b996a6e3b41c4cf4126228d541e3720fb739836b0e90986
Jul 07 12:54:49.053876 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.053857    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.059011 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.058993    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rkdct\""
Jul 07 12:54:49.059626 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.059608    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 12:54:49.092852 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.092795    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f2jdg"]
Jul 07 12:54:49.093131 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.093106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smknw\" (UniqueName: \"kubernetes.io/projected/08d1da7e-db0c-4fa6-9958-bb2ca1171378-kube-api-access-smknw\") pod \"odh-model-controller-7998c67dc4-f2jdg\" (UID: \"08d1da7e-db0c-4fa6-9958-bb2ca1171378\") " pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.093236 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.093151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08d1da7e-db0c-4fa6-9958-bb2ca1171378-cert\") pod \"odh-model-controller-7998c67dc4-f2jdg\" (UID: \"08d1da7e-db0c-4fa6-9958-bb2ca1171378\") " pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.193809 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.193775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smknw\" (UniqueName: \"kubernetes.io/projected/08d1da7e-db0c-4fa6-9958-bb2ca1171378-kube-api-access-smknw\") pod \"odh-model-controller-7998c67dc4-f2jdg\" (UID: \"08d1da7e-db0c-4fa6-9958-bb2ca1171378\") " pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.193809 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.193812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08d1da7e-db0c-4fa6-9958-bb2ca1171378-cert\") pod \"odh-model-controller-7998c67dc4-f2jdg\" (UID: \"08d1da7e-db0c-4fa6-9958-bb2ca1171378\") " pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.194018 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:54:49.193913    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 12:54:49.194018 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:54:49.193965    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d1da7e-db0c-4fa6-9958-bb2ca1171378-cert podName:08d1da7e-db0c-4fa6-9958-bb2ca1171378 nodeName:}" failed. No retries permitted until 2026-07-07 12:54:49.693947763 +0000 UTC m=+377.957124212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/08d1da7e-db0c-4fa6-9958-bb2ca1171378-cert") pod "odh-model-controller-7998c67dc4-f2jdg" (UID: "08d1da7e-db0c-4fa6-9958-bb2ca1171378") : secret "odh-model-controller-webhook-cert" not found
Jul 07 12:54:49.213314 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.213280    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smknw\" (UniqueName: \"kubernetes.io/projected/08d1da7e-db0c-4fa6-9958-bb2ca1171378-kube-api-access-smknw\") pod \"odh-model-controller-7998c67dc4-f2jdg\" (UID: \"08d1da7e-db0c-4fa6-9958-bb2ca1171378\") " pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.698532 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.698477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08d1da7e-db0c-4fa6-9958-bb2ca1171378-cert\") pod \"odh-model-controller-7998c67dc4-f2jdg\" (UID: \"08d1da7e-db0c-4fa6-9958-bb2ca1171378\") " pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.700803 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.700784    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08d1da7e-db0c-4fa6-9958-bb2ca1171378-cert\") pod \"odh-model-controller-7998c67dc4-f2jdg\" (UID: \"08d1da7e-db0c-4fa6-9958-bb2ca1171378\") " pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.847637 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.847605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl" event={"ID":"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95","Type":"ContainerStarted","Data":"3899d081bf3461ba8b996a6e3b41c4cf4126228d541e3720fb739836b0e90986"}
Jul 07 12:54:49.961702 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.961625    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xbqh6"]
Jul 07 12:54:49.964803 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.964777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:49.965098 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.965081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:49.967861 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.967839    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 12:54:49.986168 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:49.986138    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xbqh6"]
Jul 07 12:54:50.001438 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.001408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-tls-certs\") pod \"model-serving-api-54d89bd5fc-xbqh6\" (UID: \"1f39845f-3c61-4a75-8dfe-0b3d6416f43a\") " pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:50.001616 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.001441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwkt\" (UniqueName: \"kubernetes.io/projected/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-kube-api-access-lgwkt\") pod \"model-serving-api-54d89bd5fc-xbqh6\" (UID: \"1f39845f-3c61-4a75-8dfe-0b3d6416f43a\") " pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:50.102399 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.102357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-tls-certs\") pod \"model-serving-api-54d89bd5fc-xbqh6\" (UID: \"1f39845f-3c61-4a75-8dfe-0b3d6416f43a\") " pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:50.102399 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.102396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwkt\" (UniqueName: \"kubernetes.io/projected/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-kube-api-access-lgwkt\") pod \"model-serving-api-54d89bd5fc-xbqh6\" (UID: \"1f39845f-3c61-4a75-8dfe-0b3d6416f43a\") " pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:50.102639 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:54:50.102532    2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 07 12:54:50.102639 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:54:50.102599    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-tls-certs podName:1f39845f-3c61-4a75-8dfe-0b3d6416f43a nodeName:}" failed. No retries permitted until 2026-07-07 12:54:50.602581606 +0000 UTC m=+378.865758055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-tls-certs") pod "model-serving-api-54d89bd5fc-xbqh6" (UID: "1f39845f-3c61-4a75-8dfe-0b3d6416f43a") : secret "model-serving-api-tls" not found
Jul 07 12:54:50.121132 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.121044    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwkt\" (UniqueName: \"kubernetes.io/projected/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-kube-api-access-lgwkt\") pod \"model-serving-api-54d89bd5fc-xbqh6\" (UID: \"1f39845f-3c61-4a75-8dfe-0b3d6416f43a\") " pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:50.123072 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.123051    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f2jdg"]
Jul 07 12:54:50.124982 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:54:50.124954    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d1da7e_db0c_4fa6_9958_bb2ca1171378.slice/crio-ad8e4113361b89582901f211d842d8cc8b00473aabf2b3063a9d79b78fb3919c WatchSource:0}: Error finding container ad8e4113361b89582901f211d842d8cc8b00473aabf2b3063a9d79b78fb3919c: Status 404 returned error can't find the container with id ad8e4113361b89582901f211d842d8cc8b00473aabf2b3063a9d79b78fb3919c
Jul 07 12:54:50.385541 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.385498    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"]
Jul 07 12:54:50.390002 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.389977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.392194 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.392173    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 12:54:50.392324 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.392295    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-twjc8\""
Jul 07 12:54:50.392413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.392397    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 12:54:50.392486 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.392395    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 12:54:50.392721 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.392705    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 12:54:50.407479 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.407459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"]
Jul 07 12:54:50.506391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.506366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpkdg\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-kube-api-access-jpkdg\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.506533 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.506405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da4e162-d784-4cce-985f-9ecf365920ea-local-certs\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.506533 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.506424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.506533 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.506440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.506708 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.506580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-istio-token\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.506708 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.506615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.506708 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.506682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-cacerts\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.607435 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpkdg\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-kube-api-access-jpkdg\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.607580 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-tls-certs\") pod \"model-serving-api-54d89bd5fc-xbqh6\" (UID: \"1f39845f-3c61-4a75-8dfe-0b3d6416f43a\") " pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:50.607580 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da4e162-d784-4cce-985f-9ecf365920ea-local-certs\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.607580 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.607580 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.607787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-istio-token\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.607787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.607787 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.607700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-cacerts\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.608206 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.608180    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.609882 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.609857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da4e162-d784-4cce-985f-9ecf365920ea-local-certs\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.609975 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.609898    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.610028 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.609992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.610243 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.610225    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-cacerts\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.610353 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.610334    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f39845f-3c61-4a75-8dfe-0b3d6416f43a-tls-certs\") pod \"model-serving-api-54d89bd5fc-xbqh6\" (UID: \"1f39845f-3c61-4a75-8dfe-0b3d6416f43a\") " pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:50.615664 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.615636    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpkdg\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-kube-api-access-jpkdg\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.615738 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.615693    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-istio-token\") pod \"istiod-openshift-gateway-7574459656-xzmp4\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.701351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.701297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:50.856261 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.856194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg" event={"ID":"08d1da7e-db0c-4fa6-9958-bb2ca1171378","Type":"ContainerStarted","Data":"ad8e4113361b89582901f211d842d8cc8b00473aabf2b3063a9d79b78fb3919c"}
Jul 07 12:54:50.869577 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.868375    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"]
Jul 07 12:54:50.892130 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:50.891908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:51.074124 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:51.073898    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xbqh6"]
Jul 07 12:54:51.079199 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:54:51.079152    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f39845f_3c61_4a75_8dfe_0b3d6416f43a.slice/crio-05b8d29388e7d423da5ccae57a1c3485396d4cabc60bea306b9b948f49ea7da1 WatchSource:0}: Error finding container 05b8d29388e7d423da5ccae57a1c3485396d4cabc60bea306b9b948f49ea7da1: Status 404 returned error can't find the container with id 05b8d29388e7d423da5ccae57a1c3485396d4cabc60bea306b9b948f49ea7da1
Jul 07 12:54:51.862851 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:51.862810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6" event={"ID":"1f39845f-3c61-4a75-8dfe-0b3d6416f43a","Type":"ContainerStarted","Data":"05b8d29388e7d423da5ccae57a1c3485396d4cabc60bea306b9b948f49ea7da1"}
Jul 07 12:54:51.864283 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:51.864234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4" event={"ID":"4da4e162-d784-4cce-985f-9ecf365920ea","Type":"ContainerStarted","Data":"f2f76ecf5d112ba3ca134cf2337c5428d72b1f0c36d0734c2f00b1106534db54"}
Jul 07 12:54:55.180367 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.180338    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 12:54:55.180766 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.180412    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 12:54:55.888031 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.887996    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6" event={"ID":"1f39845f-3c61-4a75-8dfe-0b3d6416f43a","Type":"ContainerStarted","Data":"55194fc66654580582df61204061e0cbd3283c4d5bff42997a1b3aa110fb7ff1"}
Jul 07 12:54:55.888422 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.888079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:54:55.889624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.889603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl" event={"ID":"ebd638d4-d966-4d0d-a7d3-2d20ba15cd95","Type":"ContainerStarted","Data":"ff0bce8c7d21b5cd70e8ddbd86d87a035dc642866b52bfe9c7c9c52391066307"}
Jul 07 12:54:55.891343 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.891319    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg" event={"ID":"08d1da7e-db0c-4fa6-9958-bb2ca1171378","Type":"ContainerStarted","Data":"cd4a3de52e675d3341e6c6ad7366e6f8f445f233b5bd60aeec7e15a690baf11c"}
Jul 07 12:54:55.891432 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.891381    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:54:55.893120 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.893096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4" event={"ID":"4da4e162-d784-4cce-985f-9ecf365920ea","Type":"ContainerStarted","Data":"b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f"}
Jul 07 12:54:55.893222 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.893142    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:55.926600 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.926549    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6" podStartSLOduration=2.894917377 podStartE2EDuration="6.926531114s" totalImagesPullingTime="4.031613737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:55.924441312 +0000 UTC m=+384.187617783" watchObservedRunningTime="2026-07-07 12:54:55.926531114 +0000 UTC m=+384.189707585"
Jul 07 12:54:55.949443 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.949400    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-677fdffd75-27hnl" podStartSLOduration=1.890980165 podStartE2EDuration="7.949388319s" totalImagesPullingTime="6.058408154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:55.948930058 +0000 UTC m=+384.212106531" watchObservedRunningTime="2026-07-07 12:54:55.949388319 +0000 UTC m=+384.212564790"
Jul 07 12:54:55.972284 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.972242    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg" podStartSLOduration=1.97591671 podStartE2EDuration="6.972228385s" totalImagesPullingTime="4.996311675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:55.970546164 +0000 UTC m=+384.233722636" watchObservedRunningTime="2026-07-07 12:54:55.972228385 +0000 UTC m=+384.235404855"
Jul 07 12:54:55.996812 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:55.996772    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4" podStartSLOduration=1.690957099 podStartE2EDuration="5.996762688s" totalImagesPullingTime="4.305805589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:55.996202648 +0000 UTC m=+384.259379120" watchObservedRunningTime="2026-07-07 12:54:55.996762688 +0000 UTC m=+384.259939159"
Jul 07 12:54:56.899482 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:56.899445    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xzmp4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 12:54:56.899933 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:56.899586    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4" podUID="4da4e162-d784-4cce-985f-9ecf365920ea" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 12:54:59.898586 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.898559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:54:59.910687 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.910662    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"]
Jul 07 12:54:59.913973 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.913957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:54:59.917589 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.917575    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-msdsp\""
Jul 07 12:54:59.917652 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.917640    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 12:54:59.930567 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.930548    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"]
Jul 07 12:54:59.933600 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.933581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:54:59.939873 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.939851    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-txxcb\""
Jul 07 12:54:59.939976 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.939888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 12:54:59.957856 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.957833    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"]
Jul 07 12:54:59.964286 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.964263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"]
Jul 07 12:54:59.988128 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.988088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhbf2\" (UniqueName: \"kubernetes.io/projected/7872cef6-9d09-4c83-a4eb-8caee18484e3-kube-api-access-zhbf2\") pod \"llmisvc-controller-manager-777c6bd7d5-s9k92\" (UID: \"7872cef6-9d09-4c83-a4eb-8caee18484e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:54:59.988350 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:54:59.988322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7872cef6-9d09-4c83-a4eb-8caee18484e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9k92\" (UID: \"7872cef6-9d09-4c83-a4eb-8caee18484e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:00.089576 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.089537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7872cef6-9d09-4c83-a4eb-8caee18484e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9k92\" (UID: \"7872cef6-9d09-4c83-a4eb-8caee18484e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:00.089745 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.089594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhz8g\" (UniqueName: \"kubernetes.io/projected/5dd309ff-90e1-4443-96a2-7262a0e48539-kube-api-access-mhz8g\") pod \"kserve-controller-manager-d6f4b65b8-mf86z\" (UID: \"5dd309ff-90e1-4443-96a2-7262a0e48539\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:00.089745 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.089670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dd309ff-90e1-4443-96a2-7262a0e48539-cert\") pod \"kserve-controller-manager-d6f4b65b8-mf86z\" (UID: \"5dd309ff-90e1-4443-96a2-7262a0e48539\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:00.089745 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:55:00.089688    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 12:55:00.089745 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.089733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhbf2\" (UniqueName: \"kubernetes.io/projected/7872cef6-9d09-4c83-a4eb-8caee18484e3-kube-api-access-zhbf2\") pod \"llmisvc-controller-manager-777c6bd7d5-s9k92\" (UID: \"7872cef6-9d09-4c83-a4eb-8caee18484e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:00.089955 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:55:00.089752    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7872cef6-9d09-4c83-a4eb-8caee18484e3-cert podName:7872cef6-9d09-4c83-a4eb-8caee18484e3 nodeName:}" failed. No retries permitted until 2026-07-07 12:55:00.589733178 +0000 UTC m=+388.852909628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7872cef6-9d09-4c83-a4eb-8caee18484e3-cert") pod "llmisvc-controller-manager-777c6bd7d5-s9k92" (UID: "7872cef6-9d09-4c83-a4eb-8caee18484e3") : secret "llmisvc-webhook-server-cert" not found
Jul 07 12:55:00.116900 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.116871    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhbf2\" (UniqueName: \"kubernetes.io/projected/7872cef6-9d09-4c83-a4eb-8caee18484e3-kube-api-access-zhbf2\") pod \"llmisvc-controller-manager-777c6bd7d5-s9k92\" (UID: \"7872cef6-9d09-4c83-a4eb-8caee18484e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:00.190757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.190681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhz8g\" (UniqueName: \"kubernetes.io/projected/5dd309ff-90e1-4443-96a2-7262a0e48539-kube-api-access-mhz8g\") pod \"kserve-controller-manager-d6f4b65b8-mf86z\" (UID: \"5dd309ff-90e1-4443-96a2-7262a0e48539\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:00.190757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.190735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dd309ff-90e1-4443-96a2-7262a0e48539-cert\") pod \"kserve-controller-manager-d6f4b65b8-mf86z\" (UID: \"5dd309ff-90e1-4443-96a2-7262a0e48539\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:00.193309 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.193285    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dd309ff-90e1-4443-96a2-7262a0e48539-cert\") pod \"kserve-controller-manager-d6f4b65b8-mf86z\" (UID: \"5dd309ff-90e1-4443-96a2-7262a0e48539\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:00.215168 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.215148    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhz8g\" (UniqueName: \"kubernetes.io/projected/5dd309ff-90e1-4443-96a2-7262a0e48539-kube-api-access-mhz8g\") pod \"kserve-controller-manager-d6f4b65b8-mf86z\" (UID: \"5dd309ff-90e1-4443-96a2-7262a0e48539\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:00.243115 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.243093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:00.339404 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.339369    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"]
Jul 07 12:55:00.339624 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.339595    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4" podUID="4da4e162-d784-4cce-985f-9ecf365920ea" containerName="discovery" containerID="cri-o://b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f" gracePeriod=30
Jul 07 12:55:00.411198 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.411170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"]
Jul 07 12:55:00.449351 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:55:00.449299    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd309ff_90e1_4443_96a2_7262a0e48539.slice/crio-545c320aae14340b30d15e546a73d8eb9b264229c0ebc18da2bd66b9ccc93fc3 WatchSource:0}: Error finding container 545c320aae14340b30d15e546a73d8eb9b264229c0ebc18da2bd66b9ccc93fc3: Status 404 returned error can't find the container with id 545c320aae14340b30d15e546a73d8eb9b264229c0ebc18da2bd66b9ccc93fc3
Jul 07 12:55:00.562640 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.562615    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:55:00.594362 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.594336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7872cef6-9d09-4c83-a4eb-8caee18484e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9k92\" (UID: \"7872cef6-9d09-4c83-a4eb-8caee18484e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:00.596592 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.596574    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7872cef6-9d09-4c83-a4eb-8caee18484e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9k92\" (UID: \"7872cef6-9d09-4c83-a4eb-8caee18484e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:00.694691 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.694661    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpkdg\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-kube-api-access-jpkdg\") pod \"4da4e162-d784-4cce-985f-9ecf365920ea\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") "
Jul 07 12:55:00.694882 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.694701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-dns-cert\") pod \"4da4e162-d784-4cce-985f-9ecf365920ea\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") "
Jul 07 12:55:00.694882 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.694769    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-kubeconfig\") pod \"4da4e162-d784-4cce-985f-9ecf365920ea\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") "
Jul 07 12:55:00.694882 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.694802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-ca-configmap\") pod \"4da4e162-d784-4cce-985f-9ecf365920ea\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") "
Jul 07 12:55:00.694882 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.694832    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-istio-token\") pod \"4da4e162-d784-4cce-985f-9ecf365920ea\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") "
Jul 07 12:55:00.694882 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.694855    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da4e162-d784-4cce-985f-9ecf365920ea-local-certs\") pod \"4da4e162-d784-4cce-985f-9ecf365920ea\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") "
Jul 07 12:55:00.695175 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.694895    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-cacerts\") pod \"4da4e162-d784-4cce-985f-9ecf365920ea\" (UID: \"4da4e162-d784-4cce-985f-9ecf365920ea\") "
Jul 07 12:55:00.695285 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.695256    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4da4e162-d784-4cce-985f-9ecf365920ea" (UID: "4da4e162-d784-4cce-985f-9ecf365920ea"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:55:00.697155 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.697124    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "4da4e162-d784-4cce-985f-9ecf365920ea" (UID: "4da4e162-d784-4cce-985f-9ecf365920ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:55:00.697155 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.697148    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-kube-api-access-jpkdg" (OuterVolumeSpecName: "kube-api-access-jpkdg") pod "4da4e162-d784-4cce-985f-9ecf365920ea" (UID: "4da4e162-d784-4cce-985f-9ecf365920ea"). InnerVolumeSpecName "kube-api-access-jpkdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:55:00.697301 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.697269    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4da4e162-d784-4cce-985f-9ecf365920ea" (UID: "4da4e162-d784-4cce-985f-9ecf365920ea"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:55:00.697343 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.697318    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da4e162-d784-4cce-985f-9ecf365920ea-local-certs" (OuterVolumeSpecName: "local-certs") pod "4da4e162-d784-4cce-985f-9ecf365920ea" (UID: "4da4e162-d784-4cce-985f-9ecf365920ea"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:55:00.697343 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.697325    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4da4e162-d784-4cce-985f-9ecf365920ea" (UID: "4da4e162-d784-4cce-985f-9ecf365920ea"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:55:00.697406 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.697367    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-cacerts" (OuterVolumeSpecName: "cacerts") pod "4da4e162-d784-4cce-985f-9ecf365920ea" (UID: "4da4e162-d784-4cce-985f-9ecf365920ea"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:55:00.795964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.795897    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpkdg\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-kube-api-access-jpkdg\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:00.795964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.795920    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-dns-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:00.795964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.795929    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-istio-kubeconfig\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:00.795964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.795938    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4da4e162-d784-4cce-985f-9ecf365920ea-istio-csr-ca-configmap\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:00.795964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.795947    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4da4e162-d784-4cce-985f-9ecf365920ea-istio-token\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:00.795964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.795955    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4da4e162-d784-4cce-985f-9ecf365920ea-local-certs\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:00.795964 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.795963    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4da4e162-d784-4cce-985f-9ecf365920ea-cacerts\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:00.823630 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.823608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:00.918194 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.918162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z" event={"ID":"5dd309ff-90e1-4443-96a2-7262a0e48539","Type":"ContainerStarted","Data":"545c320aae14340b30d15e546a73d8eb9b264229c0ebc18da2bd66b9ccc93fc3"}
Jul 07 12:55:00.919619 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.919589    2580 generic.go:356] "Generic (PLEG): container finished" podID="4da4e162-d784-4cce-985f-9ecf365920ea" containerID="b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f" exitCode=0
Jul 07 12:55:00.919740 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.919645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4" event={"ID":"4da4e162-d784-4cce-985f-9ecf365920ea","Type":"ContainerDied","Data":"b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f"}
Jul 07 12:55:00.919740 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.919665    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"
Jul 07 12:55:00.919740 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.919687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4" event={"ID":"4da4e162-d784-4cce-985f-9ecf365920ea","Type":"ContainerDied","Data":"f2f76ecf5d112ba3ca134cf2337c5428d72b1f0c36d0734c2f00b1106534db54"}
Jul 07 12:55:00.919740 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.919714    2580 scope.go:117] "RemoveContainer" containerID="b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f"
Jul 07 12:55:00.928927 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.928902    2580 scope.go:117] "RemoveContainer" containerID="b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f"
Jul 07 12:55:00.929274 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:55:00.929245    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f\": container with ID starting with b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f not found: ID does not exist" containerID="b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f"
Jul 07 12:55:00.929352 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.929296    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f"} err="failed to get container status \"b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f\": rpc error: code = NotFound desc = could not find container \"b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f\": container with ID starting with b866582737a70c29b5521a862563ed781ca419c41b32ab6c9fbbe7117e6b177f not found: ID does not exist"
Jul 07 12:55:00.945235 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.945210    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"]
Jul 07 12:55:00.950024 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.950005    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xzmp4"]
Jul 07 12:55:00.956244 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:00.956226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"]
Jul 07 12:55:00.957857 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:55:00.957837    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7872cef6_9d09_4c83_a4eb_8caee18484e3.slice/crio-20631ce1e53a7fbf426eb990bb8d9eddf168a20faa529468680d22942f51bfbc WatchSource:0}: Error finding container 20631ce1e53a7fbf426eb990bb8d9eddf168a20faa529468680d22942f51bfbc: Status 404 returned error can't find the container with id 20631ce1e53a7fbf426eb990bb8d9eddf168a20faa529468680d22942f51bfbc
Jul 07 12:55:01.926727 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:01.926687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92" event={"ID":"7872cef6-9d09-4c83-a4eb-8caee18484e3","Type":"ContainerStarted","Data":"20631ce1e53a7fbf426eb990bb8d9eddf168a20faa529468680d22942f51bfbc"}
Jul 07 12:55:02.172836 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:02.172793    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4da4e162-d784-4cce-985f-9ecf365920ea" path="/var/lib/kubelet/pods/4da4e162-d784-4cce-985f-9ecf365920ea/volumes"
Jul 07 12:55:04.945980 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:04.945937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z" event={"ID":"5dd309ff-90e1-4443-96a2-7262a0e48539","Type":"ContainerStarted","Data":"490f68a3e4df768d4a2a5c880dc1feef11ae5d10bde5e628376fc5b6e2f3ad2e"}
Jul 07 12:55:04.946438 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:04.946003    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:04.947447 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:04.947423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92" event={"ID":"7872cef6-9d09-4c83-a4eb-8caee18484e3","Type":"ContainerStarted","Data":"bdfe3c60f0e8960333f4be4920d24726768607b04dce8ce774b0f8a27d1ff0e2"}
Jul 07 12:55:04.947571 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:04.947470    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:04.966748 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:04.966704    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z" podStartSLOduration=2.355073955 podStartE2EDuration="5.966690661s" totalImagesPullingTime="3.611616706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:55:04.964771907 +0000 UTC m=+393.227948382" watchObservedRunningTime="2026-07-07 12:55:04.966690661 +0000 UTC m=+393.229867133"
Jul 07 12:55:04.985365 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:04.985325    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92" podStartSLOduration=2.879013794 podStartE2EDuration="5.985312805s" totalImagesPullingTime="3.106299011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:55:04.984423256 +0000 UTC m=+393.247599729" watchObservedRunningTime="2026-07-07 12:55:04.985312805 +0000 UTC m=+393.248489279"
Jul 07 12:55:06.900453 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:06.900417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-f2jdg"
Jul 07 12:55:06.902413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:06.902391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xbqh6"
Jul 07 12:55:35.954529 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:35.954485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9k92"
Jul 07 12:55:35.957598 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:35.957575    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mf86z"
Jul 07 12:55:49.561249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.561215    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6j9ln"]
Jul 07 12:55:49.561687 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.561527    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da4e162-d784-4cce-985f-9ecf365920ea" containerName="discovery"
Jul 07 12:55:49.561687 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.561539    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da4e162-d784-4cce-985f-9ecf365920ea" containerName="discovery"
Jul 07 12:55:49.561687 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.561600    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da4e162-d784-4cce-985f-9ecf365920ea" containerName="discovery"
Jul 07 12:55:49.573203 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.573178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln"
Jul 07 12:55:49.576434 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.576408    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ck8kz\""
Jul 07 12:55:49.576605 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.576438    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 12:55:49.577297 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.577273    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 12:55:49.578404 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.578377    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6j9ln"]
Jul 07 12:55:49.671035 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.671006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6njr\" (UniqueName: \"kubernetes.io/projected/886698ae-53f4-4c2f-a491-6c670745a7c2-kube-api-access-z6njr\") pod \"kuadrant-operator-catalog-6j9ln\" (UID: \"886698ae-53f4-4c2f-a491-6c670745a7c2\") " pod="kuadrant-system/kuadrant-operator-catalog-6j9ln"
Jul 07 12:55:49.777997 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.777961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6njr\" (UniqueName: \"kubernetes.io/projected/886698ae-53f4-4c2f-a491-6c670745a7c2-kube-api-access-z6njr\") pod \"kuadrant-operator-catalog-6j9ln\" (UID: \"886698ae-53f4-4c2f-a491-6c670745a7c2\") " pod="kuadrant-system/kuadrant-operator-catalog-6j9ln"
Jul 07 12:55:49.787218 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.787194    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6njr\" (UniqueName: \"kubernetes.io/projected/886698ae-53f4-4c2f-a491-6c670745a7c2-kube-api-access-z6njr\") pod \"kuadrant-operator-catalog-6j9ln\" (UID: \"886698ae-53f4-4c2f-a491-6c670745a7c2\") " pod="kuadrant-system/kuadrant-operator-catalog-6j9ln"
Jul 07 12:55:49.885743 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.885712    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln"
Jul 07 12:55:49.916947 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:49.916907    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6j9ln"]
Jul 07 12:55:50.012660 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.012638    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6j9ln"]
Jul 07 12:55:50.014553 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:55:50.014525    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886698ae_53f4_4c2f_a491_6c670745a7c2.slice/crio-831e86ff03f028e2f8045020fa82feeba9b73965b8f69c7023b6ba2ec0e41399 WatchSource:0}: Error finding container 831e86ff03f028e2f8045020fa82feeba9b73965b8f69c7023b6ba2ec0e41399: Status 404 returned error can't find the container with id 831e86ff03f028e2f8045020fa82feeba9b73965b8f69c7023b6ba2ec0e41399
Jul 07 12:55:50.127529 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.127483    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hql5t"]
Jul 07 12:55:50.132250 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.132231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:55:50.138691 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.138607    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hql5t"]
Jul 07 12:55:50.144379 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.144346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln" event={"ID":"886698ae-53f4-4c2f-a491-6c670745a7c2","Type":"ContainerStarted","Data":"831e86ff03f028e2f8045020fa82feeba9b73965b8f69c7023b6ba2ec0e41399"}
Jul 07 12:55:50.181701 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.181674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq46n\" (UniqueName: \"kubernetes.io/projected/2e7323d7-fe70-42d7-af3b-3c947eca59c1-kube-api-access-lq46n\") pod \"kuadrant-operator-catalog-hql5t\" (UID: \"2e7323d7-fe70-42d7-af3b-3c947eca59c1\") " pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:55:50.283014 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.282988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq46n\" (UniqueName: \"kubernetes.io/projected/2e7323d7-fe70-42d7-af3b-3c947eca59c1-kube-api-access-lq46n\") pod \"kuadrant-operator-catalog-hql5t\" (UID: \"2e7323d7-fe70-42d7-af3b-3c947eca59c1\") " pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:55:50.291465 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.291439    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq46n\" (UniqueName: \"kubernetes.io/projected/2e7323d7-fe70-42d7-af3b-3c947eca59c1-kube-api-access-lq46n\") pod \"kuadrant-operator-catalog-hql5t\" (UID: \"2e7323d7-fe70-42d7-af3b-3c947eca59c1\") " pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:55:50.442464 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.442383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:55:50.581450 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:50.581425    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hql5t"]
Jul 07 12:55:50.582852 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:55:50.582827    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7323d7_fe70_42d7_af3b_3c947eca59c1.slice/crio-b907d59cdf190af0c76676b40ca40a0e027f0450563955a587d1fca0bc8bebab WatchSource:0}: Error finding container b907d59cdf190af0c76676b40ca40a0e027f0450563955a587d1fca0bc8bebab: Status 404 returned error can't find the container with id b907d59cdf190af0c76676b40ca40a0e027f0450563955a587d1fca0bc8bebab
Jul 07 12:55:51.152572 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:51.152537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hql5t" event={"ID":"2e7323d7-fe70-42d7-af3b-3c947eca59c1","Type":"ContainerStarted","Data":"b907d59cdf190af0c76676b40ca40a0e027f0450563955a587d1fca0bc8bebab"}
Jul 07 12:55:53.165963 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.165919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln" event={"ID":"886698ae-53f4-4c2f-a491-6c670745a7c2","Type":"ContainerStarted","Data":"f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3"}
Jul 07 12:55:53.165963 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.165948    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln" podUID="886698ae-53f4-4c2f-a491-6c670745a7c2" containerName="registry-server" containerID="cri-o://f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3" gracePeriod=2
Jul 07 12:55:53.167459 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.167431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hql5t" event={"ID":"2e7323d7-fe70-42d7-af3b-3c947eca59c1","Type":"ContainerStarted","Data":"4b94cb35df3ddd93d2b5d60c3585ad920ac71091337bcb67c766c28186b8f78c"}
Jul 07 12:55:53.182271 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.182227    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln" podStartSLOduration=2.06140501 podStartE2EDuration="4.182211843s" totalImagesPullingTime="2.120806833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:55:53.18055488 +0000 UTC m=+441.443731353" watchObservedRunningTime="2026-07-07 12:55:53.182211843 +0000 UTC m=+441.445388344"
Jul 07 12:55:53.196992 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.196950    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hql5t" podStartSLOduration=1.64068181 podStartE2EDuration="3.196935446s" totalImagesPullingTime="1.556253636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:55:53.195477922 +0000 UTC m=+441.458654396" watchObservedRunningTime="2026-07-07 12:55:53.196935446 +0000 UTC m=+441.460111914"
Jul 07 12:55:53.409881 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.409857    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln"
Jul 07 12:55:53.509122 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.509062    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6njr\" (UniqueName: \"kubernetes.io/projected/886698ae-53f4-4c2f-a491-6c670745a7c2-kube-api-access-z6njr\") pod \"886698ae-53f4-4c2f-a491-6c670745a7c2\" (UID: \"886698ae-53f4-4c2f-a491-6c670745a7c2\") "
Jul 07 12:55:53.511101 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.511077    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886698ae-53f4-4c2f-a491-6c670745a7c2-kube-api-access-z6njr" (OuterVolumeSpecName: "kube-api-access-z6njr") pod "886698ae-53f4-4c2f-a491-6c670745a7c2" (UID: "886698ae-53f4-4c2f-a491-6c670745a7c2"). InnerVolumeSpecName "kube-api-access-z6njr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:55:53.610376 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:53.610352    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6njr\" (UniqueName: \"kubernetes.io/projected/886698ae-53f4-4c2f-a491-6c670745a7c2-kube-api-access-z6njr\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:55:54.172959 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.172874    2580 generic.go:356] "Generic (PLEG): container finished" podID="886698ae-53f4-4c2f-a491-6c670745a7c2" containerID="f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3" exitCode=0
Jul 07 12:55:54.172959 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.172934    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln"
Jul 07 12:55:54.172959 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.172939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln" event={"ID":"886698ae-53f4-4c2f-a491-6c670745a7c2","Type":"ContainerDied","Data":"f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3"}
Jul 07 12:55:54.173491 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.172998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6j9ln" event={"ID":"886698ae-53f4-4c2f-a491-6c670745a7c2","Type":"ContainerDied","Data":"831e86ff03f028e2f8045020fa82feeba9b73965b8f69c7023b6ba2ec0e41399"}
Jul 07 12:55:54.173491 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.173019    2580 scope.go:117] "RemoveContainer" containerID="f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3"
Jul 07 12:55:54.181902 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.181882    2580 scope.go:117] "RemoveContainer" containerID="f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3"
Jul 07 12:55:54.182169 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:55:54.182152    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3\": container with ID starting with f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3 not found: ID does not exist" containerID="f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3"
Jul 07 12:55:54.182219 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.182178    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3"} err="failed to get container status \"f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3\": rpc error: code = NotFound desc = could not find container \"f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3\": container with ID starting with f1be9717b92da953f01056df48646f43f463f839c8eacc83c9f666d3d33b5dc3 not found: ID does not exist"
Jul 07 12:55:54.195788 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.195767    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6j9ln"]
Jul 07 12:55:54.199588 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:54.199567    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6j9ln"]
Jul 07 12:55:56.172032 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:55:56.172002    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="886698ae-53f4-4c2f-a491-6c670745a7c2" path="/var/lib/kubelet/pods/886698ae-53f4-4c2f-a491-6c670745a7c2/volumes"
Jul 07 12:56:00.443323 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:00.443288    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:56:00.443762 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:00.443569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:56:00.465890 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:00.465863    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:56:01.225623 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:01.225596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hql5t"
Jul 07 12:56:04.926042 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:04.926003    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"]
Jul 07 12:56:04.926545 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:04.926465    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886698ae-53f4-4c2f-a491-6c670745a7c2" containerName="registry-server"
Jul 07 12:56:04.926545 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:04.926483    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="886698ae-53f4-4c2f-a491-6c670745a7c2" containerName="registry-server"
Jul 07 12:56:04.926670 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:04.926592    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="886698ae-53f4-4c2f-a491-6c670745a7c2" containerName="registry-server"
Jul 07 12:56:04.933429 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:04.933402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:04.936669 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:04.936651    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-254pd\""
Jul 07 12:56:04.944233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:04.944211    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"]
Jul 07 12:56:05.003064 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.003036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp2s7\" (UniqueName: \"kubernetes.io/projected/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-kube-api-access-pp2s7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.003187 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.003086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.003267 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.003202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.104324 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.104277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.104324 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.104336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp2s7\" (UniqueName: \"kubernetes.io/projected/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-kube-api-access-pp2s7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.104573 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.104381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.104777 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.104753    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.104841 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.104764    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.114046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.114026    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp2s7\" (UniqueName: \"kubernetes.io/projected/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-kube-api-access-pp2s7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.242927 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.242846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:05.376232 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.376201    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"]
Jul 07 12:56:05.377403 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:05.377379    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2a10c7_a96c_49a5_a3c5_0b47b1d9ffad.slice/crio-3e2e7fac4abef6120e8746ae5e3bceeacc7a9e62340cbab3f573058ae98fccb6 WatchSource:0}: Error finding container 3e2e7fac4abef6120e8746ae5e3bceeacc7a9e62340cbab3f573058ae98fccb6: Status 404 returned error can't find the container with id 3e2e7fac4abef6120e8746ae5e3bceeacc7a9e62340cbab3f573058ae98fccb6
Jul 07 12:56:05.737596 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.737564    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"]
Jul 07 12:56:05.741189 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.741147    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.754397 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.754373    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"]
Jul 07 12:56:05.808836 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.808807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4mhb\" (UniqueName: \"kubernetes.io/projected/60de5b33-ec77-493d-96fb-4234fe81197b-kube-api-access-v4mhb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.808974 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.808850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.808974 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.808922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.909829 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.909787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.910026 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.909849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.910026 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.909897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4mhb\" (UniqueName: \"kubernetes.io/projected/60de5b33-ec77-493d-96fb-4234fe81197b-kube-api-access-v4mhb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.910274 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.910248    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.910274 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.910266    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:05.919128 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:05.919104    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4mhb\" (UniqueName: \"kubernetes.io/projected/60de5b33-ec77-493d-96fb-4234fe81197b-kube-api-access-v4mhb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:06.050990 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.050902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:06.123416 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.123389    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"]
Jul 07 12:56:06.127195 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.127174    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.146532 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.146020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"]
Jul 07 12:56:06.211353 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.211326    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"]
Jul 07 12:56:06.212272 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.212233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dqnb\" (UniqueName: \"kubernetes.io/projected/e2d7319f-4b02-4329-a8bf-689cc1f75e54-kube-api-access-6dqnb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.212393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.212294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.212393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.212330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.213382 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:06.213358    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60de5b33_ec77_493d_96fb_4234fe81197b.slice/crio-117dd3cc522209580fcceeff853fe0b4a933f04c9b827391cc4a5ed4f1f8cbe7 WatchSource:0}: Error finding container 117dd3cc522209580fcceeff853fe0b4a933f04c9b827391cc4a5ed4f1f8cbe7: Status 404 returned error can't find the container with id 117dd3cc522209580fcceeff853fe0b4a933f04c9b827391cc4a5ed4f1f8cbe7
Jul 07 12:56:06.226953 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.226922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886" event={"ID":"60de5b33-ec77-493d-96fb-4234fe81197b","Type":"ContainerStarted","Data":"117dd3cc522209580fcceeff853fe0b4a933f04c9b827391cc4a5ed4f1f8cbe7"}
Jul 07 12:56:06.228639 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.228606    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerID="27e281bf16ea41c792f5c14bca227c6651e1761ffbe3b44a69d2f99a5f000604" exitCode=0
Jul 07 12:56:06.228751 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.228641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4" event={"ID":"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad","Type":"ContainerDied","Data":"27e281bf16ea41c792f5c14bca227c6651e1761ffbe3b44a69d2f99a5f000604"}
Jul 07 12:56:06.228751 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.228679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4" event={"ID":"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad","Type":"ContainerStarted","Data":"3e2e7fac4abef6120e8746ae5e3bceeacc7a9e62340cbab3f573058ae98fccb6"}
Jul 07 12:56:06.313058 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.313025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dqnb\" (UniqueName: \"kubernetes.io/projected/e2d7319f-4b02-4329-a8bf-689cc1f75e54-kube-api-access-6dqnb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.313172 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.313098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.313172 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.313133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.313536 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.313500    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.313611 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.313559    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.322261 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.322232    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dqnb\" (UniqueName: \"kubernetes.io/projected/e2d7319f-4b02-4329-a8bf-689cc1f75e54-kube-api-access-6dqnb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.461851 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.461815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:06.528919 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.528888    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"]
Jul 07 12:56:06.533560 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.533539    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.545275 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.545250    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"]
Jul 07 12:56:06.596946 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.596918    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"]
Jul 07 12:56:06.598868 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:06.598839    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d7319f_4b02_4329_a8bf_689cc1f75e54.slice/crio-09890fa191aae8c9ba8a7d225b78b574fed79c39a10622d26becb689adac9d79 WatchSource:0}: Error finding container 09890fa191aae8c9ba8a7d225b78b574fed79c39a10622d26becb689adac9d79: Status 404 returned error can't find the container with id 09890fa191aae8c9ba8a7d225b78b574fed79c39a10622d26becb689adac9d79
Jul 07 12:56:06.616652 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.616623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9z5\" (UniqueName: \"kubernetes.io/projected/323a3974-b009-4aed-96ba-779ada503712-kube-api-access-rl9z5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.616756 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.616703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.616756 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.616749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.717555 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.717490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9z5\" (UniqueName: \"kubernetes.io/projected/323a3974-b009-4aed-96ba-779ada503712-kube-api-access-rl9z5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.717699 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.717604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.717699 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.717645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.717968 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.717950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.718011 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.717979    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.726691 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.726664    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9z5\" (UniqueName: \"kubernetes.io/projected/323a3974-b009-4aed-96ba-779ada503712-kube-api-access-rl9z5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.843950 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.843912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:06.976226 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:06.976199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"]
Jul 07 12:56:06.977835 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:06.977810    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323a3974_b009_4aed_96ba_779ada503712.slice/crio-b30425e08b32fa3ea21f2be3e042e3829608b5344c51ee4965982820cba4478d WatchSource:0}: Error finding container b30425e08b32fa3ea21f2be3e042e3829608b5344c51ee4965982820cba4478d: Status 404 returned error can't find the container with id b30425e08b32fa3ea21f2be3e042e3829608b5344c51ee4965982820cba4478d
Jul 07 12:56:07.236773 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.236737    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerID="4cd6c69dbc1564dc84995115a36e002634583519137c13b80bd90638ab6c944b" exitCode=0
Jul 07 12:56:07.237220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.236818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj" event={"ID":"e2d7319f-4b02-4329-a8bf-689cc1f75e54","Type":"ContainerDied","Data":"4cd6c69dbc1564dc84995115a36e002634583519137c13b80bd90638ab6c944b"}
Jul 07 12:56:07.237220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.236868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj" event={"ID":"e2d7319f-4b02-4329-a8bf-689cc1f75e54","Type":"ContainerStarted","Data":"09890fa191aae8c9ba8a7d225b78b574fed79c39a10622d26becb689adac9d79"}
Jul 07 12:56:07.239018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.238872    2580 generic.go:356] "Generic (PLEG): container finished" podID="323a3974-b009-4aed-96ba-779ada503712" containerID="4ad86d0d03a8858fd99839191c3a4f3b472f147ef1efc661d287f30d88d53497" exitCode=0
Jul 07 12:56:07.239018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.238956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s" event={"ID":"323a3974-b009-4aed-96ba-779ada503712","Type":"ContainerDied","Data":"4ad86d0d03a8858fd99839191c3a4f3b472f147ef1efc661d287f30d88d53497"}
Jul 07 12:56:07.239018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.239014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s" event={"ID":"323a3974-b009-4aed-96ba-779ada503712","Type":"ContainerStarted","Data":"b30425e08b32fa3ea21f2be3e042e3829608b5344c51ee4965982820cba4478d"}
Jul 07 12:56:07.240802 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.240778    2580 generic.go:356] "Generic (PLEG): container finished" podID="60de5b33-ec77-493d-96fb-4234fe81197b" containerID="b522892f3d763681908d8c2af4bdbbdcb9e4503c3ef3c2df0d75e2aa11caf053" exitCode=0
Jul 07 12:56:07.240802 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.240800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886" event={"ID":"60de5b33-ec77-493d-96fb-4234fe81197b","Type":"ContainerDied","Data":"b522892f3d763681908d8c2af4bdbbdcb9e4503c3ef3c2df0d75e2aa11caf053"}
Jul 07 12:56:07.242896 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:07.242868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4" event={"ID":"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad","Type":"ContainerStarted","Data":"866a613bfe8dd9d9a8f7724e6705fd6742c313e80f5682a5b31fced42f9dfc3d"}
Jul 07 12:56:08.257661 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:08.257630    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerID="866a613bfe8dd9d9a8f7724e6705fd6742c313e80f5682a5b31fced42f9dfc3d" exitCode=0
Jul 07 12:56:08.257661 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:08.257659    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerID="02789c2d4aaa34909ced06fc32f2353601d103bb940644131f50df47b0b86cf9" exitCode=0
Jul 07 12:56:08.258055 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:08.257713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4" event={"ID":"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad","Type":"ContainerDied","Data":"866a613bfe8dd9d9a8f7724e6705fd6742c313e80f5682a5b31fced42f9dfc3d"}
Jul 07 12:56:08.258055 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:08.257790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4" event={"ID":"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad","Type":"ContainerDied","Data":"02789c2d4aaa34909ced06fc32f2353601d103bb940644131f50df47b0b86cf9"}
Jul 07 12:56:09.264031 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.263998    2580 generic.go:356] "Generic (PLEG): container finished" podID="60de5b33-ec77-493d-96fb-4234fe81197b" containerID="0931d176cbce0f3810328bf4a551a5c562cdc9093f81183746ab08e9c0e0c09d" exitCode=0
Jul 07 12:56:09.264456 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.264074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886" event={"ID":"60de5b33-ec77-493d-96fb-4234fe81197b","Type":"ContainerDied","Data":"0931d176cbce0f3810328bf4a551a5c562cdc9093f81183746ab08e9c0e0c09d"}
Jul 07 12:56:09.265941 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.265914    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerID="47e89f62e5b6ad3bc693263e3a2f24c7d04bcd109f786ac0fa4db31de4d0e0e2" exitCode=0
Jul 07 12:56:09.266050 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.265981    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj" event={"ID":"e2d7319f-4b02-4329-a8bf-689cc1f75e54","Type":"ContainerDied","Data":"47e89f62e5b6ad3bc693263e3a2f24c7d04bcd109f786ac0fa4db31de4d0e0e2"}
Jul 07 12:56:09.267989 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.267972    2580 generic.go:356] "Generic (PLEG): container finished" podID="323a3974-b009-4aed-96ba-779ada503712" containerID="e15e6630c46add88ae2b013c0fd9594d082c17dab226a2d214e42163b35ae4c7" exitCode=0
Jul 07 12:56:09.268065 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.268040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s" event={"ID":"323a3974-b009-4aed-96ba-779ada503712","Type":"ContainerDied","Data":"e15e6630c46add88ae2b013c0fd9594d082c17dab226a2d214e42163b35ae4c7"}
Jul 07 12:56:09.420178 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.420154    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:09.541870 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.541845    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-util\") pod \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") "
Jul 07 12:56:09.542018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.541912    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp2s7\" (UniqueName: \"kubernetes.io/projected/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-kube-api-access-pp2s7\") pod \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") "
Jul 07 12:56:09.542018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.541939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-bundle\") pod \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\" (UID: \"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad\") "
Jul 07 12:56:09.542585 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.542559    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-bundle" (OuterVolumeSpecName: "bundle") pod "1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" (UID: "1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:09.543767 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.543737    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-kube-api-access-pp2s7" (OuterVolumeSpecName: "kube-api-access-pp2s7") pod "1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" (UID: "1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad"). InnerVolumeSpecName "kube-api-access-pp2s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:56:09.547172 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.547151    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-util" (OuterVolumeSpecName: "util") pod "1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" (UID: "1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:09.643336 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.643304    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp2s7\" (UniqueName: \"kubernetes.io/projected/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-kube-api-access-pp2s7\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:09.643336 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.643330    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:09.643336 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:09.643341    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad-util\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:10.274692 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.274656    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerID="fc0626399a1181d7bc379164e47ee1701b7dcd07258bfe47d286cfd52a6ce212" exitCode=0
Jul 07 12:56:10.275113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.274738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj" event={"ID":"e2d7319f-4b02-4329-a8bf-689cc1f75e54","Type":"ContainerDied","Data":"fc0626399a1181d7bc379164e47ee1701b7dcd07258bfe47d286cfd52a6ce212"}
Jul 07 12:56:10.276660 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.276641    2580 generic.go:356] "Generic (PLEG): container finished" podID="323a3974-b009-4aed-96ba-779ada503712" containerID="0f8c3b05dec935b53e3d59a0b126a2fe5914fbf920bfc6de0e12d3d05f773e46" exitCode=0
Jul 07 12:56:10.276779 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.276714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s" event={"ID":"323a3974-b009-4aed-96ba-779ada503712","Type":"ContainerDied","Data":"0f8c3b05dec935b53e3d59a0b126a2fe5914fbf920bfc6de0e12d3d05f773e46"}
Jul 07 12:56:10.278668 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.278649    2580 generic.go:356] "Generic (PLEG): container finished" podID="60de5b33-ec77-493d-96fb-4234fe81197b" containerID="998d4a694fa2c6ee6858497f8a60167bfd0e68d5a5ad42c0650c078aa0354dfc" exitCode=0
Jul 07 12:56:10.278756 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.278714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886" event={"ID":"60de5b33-ec77-493d-96fb-4234fe81197b","Type":"ContainerDied","Data":"998d4a694fa2c6ee6858497f8a60167bfd0e68d5a5ad42c0650c078aa0354dfc"}
Jul 07 12:56:10.280485 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.280454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4" event={"ID":"1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad","Type":"ContainerDied","Data":"3e2e7fac4abef6120e8746ae5e3bceeacc7a9e62340cbab3f573058ae98fccb6"}
Jul 07 12:56:10.280485 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.280483    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4"
Jul 07 12:56:10.280604 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:10.280493    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e2e7fac4abef6120e8746ae5e3bceeacc7a9e62340cbab3f573058ae98fccb6"
Jul 07 12:56:11.423785 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.423758    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:11.470087 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.470059    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:11.473043 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.473026    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:11.558081 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558010    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dqnb\" (UniqueName: \"kubernetes.io/projected/e2d7319f-4b02-4329-a8bf-689cc1f75e54-kube-api-access-6dqnb\") pod \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") "
Jul 07 12:56:11.558081 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558061    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-bundle\") pod \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") "
Jul 07 12:56:11.558263 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl9z5\" (UniqueName: \"kubernetes.io/projected/323a3974-b009-4aed-96ba-779ada503712-kube-api-access-rl9z5\") pod \"323a3974-b009-4aed-96ba-779ada503712\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") "
Jul 07 12:56:11.558263 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-util\") pod \"60de5b33-ec77-493d-96fb-4234fe81197b\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") "
Jul 07 12:56:11.558263 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-util\") pod \"323a3974-b009-4aed-96ba-779ada503712\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") "
Jul 07 12:56:11.558423 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-util\") pod \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\" (UID: \"e2d7319f-4b02-4329-a8bf-689cc1f75e54\") "
Jul 07 12:56:11.558423 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4mhb\" (UniqueName: \"kubernetes.io/projected/60de5b33-ec77-493d-96fb-4234fe81197b-kube-api-access-v4mhb\") pod \"60de5b33-ec77-493d-96fb-4234fe81197b\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") "
Jul 07 12:56:11.558423 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558413    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-bundle\") pod \"323a3974-b009-4aed-96ba-779ada503712\" (UID: \"323a3974-b009-4aed-96ba-779ada503712\") "
Jul 07 12:56:11.558587 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.558449    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-bundle\") pod \"60de5b33-ec77-493d-96fb-4234fe81197b\" (UID: \"60de5b33-ec77-493d-96fb-4234fe81197b\") "
Jul 07 12:56:11.559479 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.559076    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-bundle" (OuterVolumeSpecName: "bundle") pod "e2d7319f-4b02-4329-a8bf-689cc1f75e54" (UID: "e2d7319f-4b02-4329-a8bf-689cc1f75e54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:11.559479 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.559333    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-bundle" (OuterVolumeSpecName: "bundle") pod "60de5b33-ec77-493d-96fb-4234fe81197b" (UID: "60de5b33-ec77-493d-96fb-4234fe81197b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:11.559925 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.559891    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-bundle" (OuterVolumeSpecName: "bundle") pod "323a3974-b009-4aed-96ba-779ada503712" (UID: "323a3974-b009-4aed-96ba-779ada503712"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:11.560499 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.560451    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d7319f-4b02-4329-a8bf-689cc1f75e54-kube-api-access-6dqnb" (OuterVolumeSpecName: "kube-api-access-6dqnb") pod "e2d7319f-4b02-4329-a8bf-689cc1f75e54" (UID: "e2d7319f-4b02-4329-a8bf-689cc1f75e54"). InnerVolumeSpecName "kube-api-access-6dqnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:56:11.560611 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.560575    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323a3974-b009-4aed-96ba-779ada503712-kube-api-access-rl9z5" (OuterVolumeSpecName: "kube-api-access-rl9z5") pod "323a3974-b009-4aed-96ba-779ada503712" (UID: "323a3974-b009-4aed-96ba-779ada503712"). InnerVolumeSpecName "kube-api-access-rl9z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:56:11.561312 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.561281    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60de5b33-ec77-493d-96fb-4234fe81197b-kube-api-access-v4mhb" (OuterVolumeSpecName: "kube-api-access-v4mhb") pod "60de5b33-ec77-493d-96fb-4234fe81197b" (UID: "60de5b33-ec77-493d-96fb-4234fe81197b"). InnerVolumeSpecName "kube-api-access-v4mhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:56:11.564926 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.564705    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-util" (OuterVolumeSpecName: "util") pod "323a3974-b009-4aed-96ba-779ada503712" (UID: "323a3974-b009-4aed-96ba-779ada503712"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:11.565046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.564931    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-util" (OuterVolumeSpecName: "util") pod "60de5b33-ec77-493d-96fb-4234fe81197b" (UID: "60de5b33-ec77-493d-96fb-4234fe81197b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:11.565340 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.565312    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-util" (OuterVolumeSpecName: "util") pod "e2d7319f-4b02-4329-a8bf-689cc1f75e54" (UID: "e2d7319f-4b02-4329-a8bf-689cc1f75e54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:56:11.659696 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659659    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dqnb\" (UniqueName: \"kubernetes.io/projected/e2d7319f-4b02-4329-a8bf-689cc1f75e54-kube-api-access-6dqnb\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659696 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659694    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659696 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659705    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl9z5\" (UniqueName: \"kubernetes.io/projected/323a3974-b009-4aed-96ba-779ada503712-kube-api-access-rl9z5\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659894 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659714    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-util\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659894 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659722    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-util\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659894 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659730    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d7319f-4b02-4329-a8bf-689cc1f75e54-util\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659894 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659738    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4mhb\" (UniqueName: \"kubernetes.io/projected/60de5b33-ec77-493d-96fb-4234fe81197b-kube-api-access-v4mhb\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659894 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659745    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/323a3974-b009-4aed-96ba-779ada503712-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:11.659894 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:11.659753    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60de5b33-ec77-493d-96fb-4234fe81197b-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:56:12.290820 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.290796    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj"
Jul 07 12:56:12.290949 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.290818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj" event={"ID":"e2d7319f-4b02-4329-a8bf-689cc1f75e54","Type":"ContainerDied","Data":"09890fa191aae8c9ba8a7d225b78b574fed79c39a10622d26becb689adac9d79"}
Jul 07 12:56:12.290949 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.290861    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09890fa191aae8c9ba8a7d225b78b574fed79c39a10622d26becb689adac9d79"
Jul 07 12:56:12.292734 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.292711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s" event={"ID":"323a3974-b009-4aed-96ba-779ada503712","Type":"ContainerDied","Data":"b30425e08b32fa3ea21f2be3e042e3829608b5344c51ee4965982820cba4478d"}
Jul 07 12:56:12.292866 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.292751    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b30425e08b32fa3ea21f2be3e042e3829608b5344c51ee4965982820cba4478d"
Jul 07 12:56:12.292866 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.292722    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s"
Jul 07 12:56:12.294884 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.294852    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886" event={"ID":"60de5b33-ec77-493d-96fb-4234fe81197b","Type":"ContainerDied","Data":"117dd3cc522209580fcceeff853fe0b4a933f04c9b827391cc4a5ed4f1f8cbe7"}
Jul 07 12:56:12.294884 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.294877    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886"
Jul 07 12:56:12.295005 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:12.294891    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="117dd3cc522209580fcceeff853fe0b4a933f04c9b827391cc4a5ed4f1f8cbe7"
Jul 07 12:56:22.370668 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370638    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"]
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370925    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60de5b33-ec77-493d-96fb-4234fe81197b" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370935    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="60de5b33-ec77-493d-96fb-4234fe81197b" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370944    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370949    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370958    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323a3974-b009-4aed-96ba-779ada503712" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370964    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="323a3974-b009-4aed-96ba-779ada503712" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370974    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370980    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370988    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323a3974-b009-4aed-96ba-779ada503712" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370992    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="323a3974-b009-4aed-96ba-779ada503712" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.370998    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371003    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371009    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371013    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerName="util"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371019    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323a3974-b009-4aed-96ba-779ada503712" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371024    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="323a3974-b009-4aed-96ba-779ada503712" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371029    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60de5b33-ec77-493d-96fb-4234fe81197b" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371034    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="60de5b33-ec77-493d-96fb-4234fe81197b" containerName="pull"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371041    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371046    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371050    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371055    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371063    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60de5b33-ec77-493d-96fb-4234fe81197b" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371068    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="60de5b33-ec77-493d-96fb-4234fe81197b" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371112    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d7319f-4b02-4329-a8bf-689cc1f75e54" containerName="extract"
Jul 07 12:56:22.371113 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371120    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad" containerName="extract"
Jul 07 12:56:22.371867 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371127    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="60de5b33-ec77-493d-96fb-4234fe81197b" containerName="extract"
Jul 07 12:56:22.371867 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.371133    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="323a3974-b009-4aed-96ba-779ada503712" containerName="extract"
Jul 07 12:56:22.375832 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.375813    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"
Jul 07 12:56:22.383259 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.383240    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k9gdt\""
Jul 07 12:56:22.402494 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.402471    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"]
Jul 07 12:56:22.541555 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.541528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvrfx\" (UniqueName: \"kubernetes.io/projected/9963014e-3b88-4361-a435-2a6c43205834-kube-api-access-zvrfx\") pod \"authorino-operator-75cc8d5cb7-bv9hx\" (UID: \"9963014e-3b88-4361-a435-2a6c43205834\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"
Jul 07 12:56:22.642175 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.642147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvrfx\" (UniqueName: \"kubernetes.io/projected/9963014e-3b88-4361-a435-2a6c43205834-kube-api-access-zvrfx\") pod \"authorino-operator-75cc8d5cb7-bv9hx\" (UID: \"9963014e-3b88-4361-a435-2a6c43205834\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"
Jul 07 12:56:22.652599 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.652572    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvrfx\" (UniqueName: \"kubernetes.io/projected/9963014e-3b88-4361-a435-2a6c43205834-kube-api-access-zvrfx\") pod \"authorino-operator-75cc8d5cb7-bv9hx\" (UID: \"9963014e-3b88-4361-a435-2a6c43205834\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"
Jul 07 12:56:22.686448 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.686423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"
Jul 07 12:56:22.820616 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:22.820591    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"]
Jul 07 12:56:22.822380 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:22.822358    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9963014e_3b88_4361_a435_2a6c43205834.slice/crio-f6cdaf8d780014a7ff386cc6fae046fcd903b084870bda1752bfb1ad5766ad0f WatchSource:0}: Error finding container f6cdaf8d780014a7ff386cc6fae046fcd903b084870bda1752bfb1ad5766ad0f: Status 404 returned error can't find the container with id f6cdaf8d780014a7ff386cc6fae046fcd903b084870bda1752bfb1ad5766ad0f
Jul 07 12:56:23.350022 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.349992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx" event={"ID":"9963014e-3b88-4361-a435-2a6c43205834","Type":"ContainerStarted","Data":"f6cdaf8d780014a7ff386cc6fae046fcd903b084870bda1752bfb1ad5766ad0f"}
Jul 07 12:56:23.719839 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.719808    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55bddc7476-86vvj"]
Jul 07 12:56:23.723255 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.723228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.742366 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.742344    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bddc7476-86vvj"]
Jul 07 12:56:23.853415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.853256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbbh\" (UniqueName: \"kubernetes.io/projected/1f05bc7d-697d-454a-85a1-597fd3302233-kube-api-access-kpbbh\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.853415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.853303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-service-ca\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.853415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.853339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-oauth-serving-cert\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.853415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.853366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-trusted-ca-bundle\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.853788 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.853481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-console-config\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.853788 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.853580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05bc7d-697d-454a-85a1-597fd3302233-console-serving-cert\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.853788 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.853633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05bc7d-697d-454a-85a1-597fd3302233-console-oauth-config\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.954612 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.954568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-service-ca\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.954612 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.954615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-oauth-serving-cert\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.954852 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.954639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-trusted-ca-bundle\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.954852 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.954682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-console-config\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.954852 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.954747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05bc7d-697d-454a-85a1-597fd3302233-console-serving-cert\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.954852 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.954792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05bc7d-697d-454a-85a1-597fd3302233-console-oauth-config\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.954852 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.954823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbbh\" (UniqueName: \"kubernetes.io/projected/1f05bc7d-697d-454a-85a1-597fd3302233-kube-api-access-kpbbh\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.956124 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.955928    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-oauth-serving-cert\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.956124 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.956079    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-trusted-ca-bundle\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.956397 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.956366    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-service-ca\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.956887 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.956847    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05bc7d-697d-454a-85a1-597fd3302233-console-config\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.958066 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.958036    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05bc7d-697d-454a-85a1-597fd3302233-console-oauth-config\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.959046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.959026    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05bc7d-697d-454a-85a1-597fd3302233-console-serving-cert\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:23.967701 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:23.967652    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbbh\" (UniqueName: \"kubernetes.io/projected/1f05bc7d-697d-454a-85a1-597fd3302233-kube-api-access-kpbbh\") pod \"console-55bddc7476-86vvj\" (UID: \"1f05bc7d-697d-454a-85a1-597fd3302233\") " pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:24.035706 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:24.035612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:24.204119 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:24.204090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bddc7476-86vvj"]
Jul 07 12:56:25.133254 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:25.133221    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f05bc7d_697d_454a_85a1_597fd3302233.slice/crio-997d3653d0f285d9556df0454f319e50c1020ebd9c1df7985606aa95be58b854 WatchSource:0}: Error finding container 997d3653d0f285d9556df0454f319e50c1020ebd9c1df7985606aa95be58b854: Status 404 returned error can't find the container with id 997d3653d0f285d9556df0454f319e50c1020ebd9c1df7985606aa95be58b854
Jul 07 12:56:25.363371 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.363335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bddc7476-86vvj" event={"ID":"1f05bc7d-697d-454a-85a1-597fd3302233","Type":"ContainerStarted","Data":"dd587168217ce30f5fa9c8d7d3acb5d3d143d9c5f97bc355e22b8e2d834cd608"}
Jul 07 12:56:25.363582 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.363395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bddc7476-86vvj" event={"ID":"1f05bc7d-697d-454a-85a1-597fd3302233","Type":"ContainerStarted","Data":"997d3653d0f285d9556df0454f319e50c1020ebd9c1df7985606aa95be58b854"}
Jul 07 12:56:25.364888 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.364862    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx" event={"ID":"9963014e-3b88-4361-a435-2a6c43205834","Type":"ContainerStarted","Data":"0dc49c9fc2a1b16a5eeb02bf09b2e5d14658978d7ae9e8eddb9688e5052bc417"}
Jul 07 12:56:25.365008 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.364991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"
Jul 07 12:56:25.370946 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.370922    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"]
Jul 07 12:56:25.374193 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.374179    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"
Jul 07 12:56:25.376415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.376399    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n982t\""
Jul 07 12:56:25.376679 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.376665    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 12:56:25.385233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.385187    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"]
Jul 07 12:56:25.418540 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.418483    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55bddc7476-86vvj" podStartSLOduration=2.418468741 podStartE2EDuration="2.418468741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:56:25.389780874 +0000 UTC m=+473.652957346" watchObservedRunningTime="2026-07-07 12:56:25.418468741 +0000 UTC m=+473.681645213"
Jul 07 12:56:25.437217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.437174    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx" podStartSLOduration=1.075659963 podStartE2EDuration="3.437156586s" totalImagesPullingTime="2.361496623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:56:25.435753624 +0000 UTC m=+473.698930098" watchObservedRunningTime="2026-07-07 12:56:25.437156586 +0000 UTC m=+473.700333059"
Jul 07 12:56:25.471670 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.471637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxgs6\" (UniqueName: \"kubernetes.io/projected/9cb66e38-cdd4-4df1-bb34-79c29ad40657-kube-api-access-dxgs6\") pod \"dns-operator-controller-manager-864dd78c4c-mgkqq\" (UID: \"9cb66e38-cdd4-4df1-bb34-79c29ad40657\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"
Jul 07 12:56:25.572728 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.572697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxgs6\" (UniqueName: \"kubernetes.io/projected/9cb66e38-cdd4-4df1-bb34-79c29ad40657-kube-api-access-dxgs6\") pod \"dns-operator-controller-manager-864dd78c4c-mgkqq\" (UID: \"9cb66e38-cdd4-4df1-bb34-79c29ad40657\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"
Jul 07 12:56:25.585842 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.585817    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxgs6\" (UniqueName: \"kubernetes.io/projected/9cb66e38-cdd4-4df1-bb34-79c29ad40657-kube-api-access-dxgs6\") pod \"dns-operator-controller-manager-864dd78c4c-mgkqq\" (UID: \"9cb66e38-cdd4-4df1-bb34-79c29ad40657\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"
Jul 07 12:56:25.684890 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.684810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"
Jul 07 12:56:25.827054 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:25.827028    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"]
Jul 07 12:56:25.827160 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:25.827143    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb66e38_cdd4_4df1_bb34_79c29ad40657.slice/crio-7e0f107f203765d81e51baf43bf490b2d39d91a21b792ab6ec8804fa3fad36e0 WatchSource:0}: Error finding container 7e0f107f203765d81e51baf43bf490b2d39d91a21b792ab6ec8804fa3fad36e0: Status 404 returned error can't find the container with id 7e0f107f203765d81e51baf43bf490b2d39d91a21b792ab6ec8804fa3fad36e0
Jul 07 12:56:26.370627 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:26.370591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq" event={"ID":"9cb66e38-cdd4-4df1-bb34-79c29ad40657","Type":"ContainerStarted","Data":"7e0f107f203765d81e51baf43bf490b2d39d91a21b792ab6ec8804fa3fad36e0"}
Jul 07 12:56:28.273789 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.273753    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"]
Jul 07 12:56:28.278414 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.278382    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:28.287212 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.287189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r5pz8\""
Jul 07 12:56:28.318230 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.318196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"]
Jul 07 12:56:28.382424 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.382394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq" event={"ID":"9cb66e38-cdd4-4df1-bb34-79c29ad40657","Type":"ContainerStarted","Data":"9137a034c94f9dc67d4c18bd59a8b2cbd122f0b07bee07ccbe3ed6aa7a5909b8"}
Jul 07 12:56:28.382603 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.382482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"
Jul 07 12:56:28.400575 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.400551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j59fp\" (UniqueName: \"kubernetes.io/projected/d0e83527-e013-445e-80b7-8f26f245278e-kube-api-access-j59fp\") pod \"limitador-operator-controller-manager-859d7b78bd-d22kd\" (UID: \"d0e83527-e013-445e-80b7-8f26f245278e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:28.501899 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.501870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j59fp\" (UniqueName: \"kubernetes.io/projected/d0e83527-e013-445e-80b7-8f26f245278e-kube-api-access-j59fp\") pod \"limitador-operator-controller-manager-859d7b78bd-d22kd\" (UID: \"d0e83527-e013-445e-80b7-8f26f245278e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:28.526266 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.526201    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j59fp\" (UniqueName: \"kubernetes.io/projected/d0e83527-e013-445e-80b7-8f26f245278e-kube-api-access-j59fp\") pod \"limitador-operator-controller-manager-859d7b78bd-d22kd\" (UID: \"d0e83527-e013-445e-80b7-8f26f245278e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:28.588865 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.588842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:28.730922 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.730847    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq" podStartSLOduration=1.894698495 podStartE2EDuration="3.730829207s" totalImagesPullingTime="1.836130712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:56:28.425394861 +0000 UTC m=+476.688571332" watchObservedRunningTime="2026-07-07 12:56:28.730829207 +0000 UTC m=+476.994005679"
Jul 07 12:56:28.733219 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:28.733199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"]
Jul 07 12:56:28.735216 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:28.735194    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e83527_e013_445e_80b7_8f26f245278e.slice/crio-a009d15c071198d464cf1770469a1a765c5a97e42d27568c8d889d9bd18af0e0 WatchSource:0}: Error finding container a009d15c071198d464cf1770469a1a765c5a97e42d27568c8d889d9bd18af0e0: Status 404 returned error can't find the container with id a009d15c071198d464cf1770469a1a765c5a97e42d27568c8d889d9bd18af0e0
Jul 07 12:56:29.389981 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:29.389942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd" event={"ID":"d0e83527-e013-445e-80b7-8f26f245278e","Type":"ContainerStarted","Data":"a009d15c071198d464cf1770469a1a765c5a97e42d27568c8d889d9bd18af0e0"}
Jul 07 12:56:31.402805 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:31.402772    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd" event={"ID":"d0e83527-e013-445e-80b7-8f26f245278e","Type":"ContainerStarted","Data":"1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da"}
Jul 07 12:56:31.403166 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:31.402839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:31.424814 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:31.424769    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd" podStartSLOduration=1.611433099 podStartE2EDuration="3.424754633s" totalImagesPullingTime="1.813321534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:56:31.423778831 +0000 UTC m=+479.686955306" watchObservedRunningTime="2026-07-07 12:56:31.424754633 +0000 UTC m=+479.687931105"
Jul 07 12:56:32.499758 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.499727    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"]
Jul 07 12:56:32.504636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.504612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.507233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.507211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x7f7q\""
Jul 07 12:56:32.517834 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.517812    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"]
Jul 07 12:56:32.638344 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.638310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.638485 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.638379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq4gb\" (UniqueName: \"kubernetes.io/projected/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-kube-api-access-qq4gb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.739262 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.739233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.739391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.739285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq4gb\" (UniqueName: \"kubernetes.io/projected/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-kube-api-access-qq4gb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.739665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.739643    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.747573 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.747552    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq4gb\" (UniqueName: \"kubernetes.io/projected/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-kube-api-access-qq4gb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.815193 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.815137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:32.949763 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:32.949739    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"]
Jul 07 12:56:32.950759 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:32.950728    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9848d6e6_be08_4aaa_ac76_5d3a4ad6d9f5.slice/crio-235d1da133699884af9bb2211d01397b62ee0d60e044a622b0940e9ddc99c401 WatchSource:0}: Error finding container 235d1da133699884af9bb2211d01397b62ee0d60e044a622b0940e9ddc99c401: Status 404 returned error can't find the container with id 235d1da133699884af9bb2211d01397b62ee0d60e044a622b0940e9ddc99c401
Jul 07 12:56:33.413628 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:33.413592    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m" event={"ID":"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5","Type":"ContainerStarted","Data":"235d1da133699884af9bb2211d01397b62ee0d60e044a622b0940e9ddc99c401"}
Jul 07 12:56:34.035802 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:34.035771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:34.036226 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:34.035842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:34.041594 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:34.041571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:34.424433 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:34.424405    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55bddc7476-86vvj"
Jul 07 12:56:34.496583 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:34.496550    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f447b9b5d-vwmkx"]
Jul 07 12:56:36.373245 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:36.373212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bv9hx"
Jul 07 12:56:38.444896 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:38.444856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m" event={"ID":"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5","Type":"ContainerStarted","Data":"b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39"}
Jul 07 12:56:38.445255 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:38.444975    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:38.468665 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:38.468618    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m" podStartSLOduration=1.8559506479999999 podStartE2EDuration="6.468603846s" totalImagesPullingTime="4.612653198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:56:38.465689512 +0000 UTC m=+486.728865996" watchObservedRunningTime="2026-07-07 12:56:38.468603846 +0000 UTC m=+486.731780319"
Jul 07 12:56:39.392366 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:39.392339    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mgkqq"
Jul 07 12:56:40.406544 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.406498    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"]
Jul 07 12:56:40.410046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.410027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.412402 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.412382    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 12:56:40.412580 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.412562    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 12:56:40.412688 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.412671    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-254pd\""
Jul 07 12:56:40.423541 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.423460    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"]
Jul 07 12:56:40.507120 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.507090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f0089e-dc60-41d2-8a58-ef61b3429400-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.507120 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.507121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95kfp\" (UniqueName: \"kubernetes.io/projected/65f0089e-dc60-41d2-8a58-ef61b3429400-kube-api-access-95kfp\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.507305 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.507142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/65f0089e-dc60-41d2-8a58-ef61b3429400-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.607606 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.607578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f0089e-dc60-41d2-8a58-ef61b3429400-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.607734 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.607619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95kfp\" (UniqueName: \"kubernetes.io/projected/65f0089e-dc60-41d2-8a58-ef61b3429400-kube-api-access-95kfp\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.607734 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.607651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/65f0089e-dc60-41d2-8a58-ef61b3429400-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.607734 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:40.607726    2580 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 07 12:56:40.607892 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:40.607792    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65f0089e-dc60-41d2-8a58-ef61b3429400-plugin-serving-cert podName:65f0089e-dc60-41d2-8a58-ef61b3429400 nodeName:}" failed. No retries permitted until 2026-07-07 12:56:41.107777698 +0000 UTC m=+489.370954152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/65f0089e-dc60-41d2-8a58-ef61b3429400-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9tmnb" (UID: "65f0089e-dc60-41d2-8a58-ef61b3429400") : secret "plugin-serving-cert" not found
Jul 07 12:56:40.608264 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.608244    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/65f0089e-dc60-41d2-8a58-ef61b3429400-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:40.622393 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:40.622376    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95kfp\" (UniqueName: \"kubernetes.io/projected/65f0089e-dc60-41d2-8a58-ef61b3429400-kube-api-access-95kfp\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:41.111760 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:41.111732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f0089e-dc60-41d2-8a58-ef61b3429400-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:41.114002 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:41.113982    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f0089e-dc60-41d2-8a58-ef61b3429400-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9tmnb\" (UID: \"65f0089e-dc60-41d2-8a58-ef61b3429400\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:41.319054 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:41.319024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"
Jul 07 12:56:41.448553 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:41.448529    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb"]
Jul 07 12:56:41.450425 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:56:41.450398    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65f0089e_dc60_41d2_8a58_ef61b3429400.slice/crio-2386c36ba65eb0663694836a2525493dd218a33b150971af6064aa6841ccdd71 WatchSource:0}: Error finding container 2386c36ba65eb0663694836a2525493dd218a33b150971af6064aa6841ccdd71: Status 404 returned error can't find the container with id 2386c36ba65eb0663694836a2525493dd218a33b150971af6064aa6841ccdd71
Jul 07 12:56:41.461952 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:41.461928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb" event={"ID":"65f0089e-dc60-41d2-8a58-ef61b3429400","Type":"ContainerStarted","Data":"2386c36ba65eb0663694836a2525493dd218a33b150971af6064aa6841ccdd71"}
Jul 07 12:56:42.409792 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:42.409763    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:49.453565 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:49.453522    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:50.999012 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:50.998981    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"]
Jul 07 12:56:51.017872 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.017845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.033102 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.033079    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"]
Jul 07 12:56:51.093702 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.093667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsp7b\" (UniqueName: \"kubernetes.io/projected/e798b68e-b32e-4707-8a84-ea8452cbe4f5-kube-api-access-fsp7b\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.093867 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.093717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e798b68e-b32e-4707-8a84-ea8452cbe4f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.194518 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.194483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsp7b\" (UniqueName: \"kubernetes.io/projected/e798b68e-b32e-4707-8a84-ea8452cbe4f5-kube-api-access-fsp7b\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.194694 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.194539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e798b68e-b32e-4707-8a84-ea8452cbe4f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.194992 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.194959    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e798b68e-b32e-4707-8a84-ea8452cbe4f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.208237 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.208202    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsp7b\" (UniqueName: \"kubernetes.io/projected/e798b68e-b32e-4707-8a84-ea8452cbe4f5-kube-api-access-fsp7b\") pod \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.329900 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.329808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:56:51.362107 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.362082    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"]
Jul 07 12:56:51.372266 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.372240    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"]
Jul 07 12:56:51.415614 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.415580    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"]
Jul 07 12:56:51.422620 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.422597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.425105 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.425076    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"]
Jul 07 12:56:51.425295 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.425268    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" containerName="manager" containerID="cri-o://b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39" gracePeriod=2
Jul 07 12:56:51.442636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.442609    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"]
Jul 07 12:56:51.452471 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.452445    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"]
Jul 07 12:56:51.466080 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.465825    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"]
Jul 07 12:56:51.466080 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.466029    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd" podUID="d0e83527-e013-445e-80b7-8f26f245278e" containerName="manager" containerID="cri-o://1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da" gracePeriod=2
Jul 07 12:56:51.478321 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.478296    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"]
Jul 07 12:56:51.497328 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.497289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317c0354-786b-4d1a-9802-8882315e2ad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2dds6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.497437 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.497411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77xjp\" (UniqueName: \"kubernetes.io/projected/317c0354-786b-4d1a-9802-8882315e2ad6-kube-api-access-77xjp\") pod \"kuadrant-operator-controller-manager-55467d9f7-2dds6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.502231 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:51.502046    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:51.504819 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:51.504787    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:51.529263 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.528900    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"]
Jul 07 12:56:51.529432 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.529403    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" containerName="manager"
Jul 07 12:56:51.529432 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.529420    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" containerName="manager"
Jul 07 12:56:51.529571 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.529443    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0e83527-e013-445e-80b7-8f26f245278e" containerName="manager"
Jul 07 12:56:51.529571 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.529452    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0e83527-e013-445e-80b7-8f26f245278e" containerName="manager"
Jul 07 12:56:51.529571 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.529556    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" containerName="manager"
Jul 07 12:56:51.529571 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.529569    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0e83527-e013-445e-80b7-8f26f245278e" containerName="manager"
Jul 07 12:56:51.540555 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.540500    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"
Jul 07 12:56:51.550717 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.550583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"]
Jul 07 12:56:51.577363 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:51.577326    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:51.579770 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:51.579734    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:51.598395 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.598337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77xjp\" (UniqueName: \"kubernetes.io/projected/317c0354-786b-4d1a-9802-8882315e2ad6-kube-api-access-77xjp\") pod \"kuadrant-operator-controller-manager-55467d9f7-2dds6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.598483 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.598424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqzcz\" (UniqueName: \"kubernetes.io/projected/a96e730d-68e5-4430-9381-07513dc0bdac-kube-api-access-cqzcz\") pod \"limitador-operator-controller-manager-859d7b78bd-n469c\" (UID: \"a96e730d-68e5-4430-9381-07513dc0bdac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"
Jul 07 12:56:51.598483 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.598462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317c0354-786b-4d1a-9802-8882315e2ad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2dds6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.598865 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.598835    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317c0354-786b-4d1a-9802-8882315e2ad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2dds6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.614468 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.614440    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77xjp\" (UniqueName: \"kubernetes.io/projected/317c0354-786b-4d1a-9802-8882315e2ad6-kube-api-access-77xjp\") pod \"kuadrant-operator-controller-manager-55467d9f7-2dds6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.699423 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.699387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqzcz\" (UniqueName: \"kubernetes.io/projected/a96e730d-68e5-4430-9381-07513dc0bdac-kube-api-access-cqzcz\") pod \"limitador-operator-controller-manager-859d7b78bd-n469c\" (UID: \"a96e730d-68e5-4430-9381-07513dc0bdac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"
Jul 07 12:56:51.736204 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.736145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:56:51.737462 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.737405    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqzcz\" (UniqueName: \"kubernetes.io/projected/a96e730d-68e5-4430-9381-07513dc0bdac-kube-api-access-cqzcz\") pod \"limitador-operator-controller-manager-859d7b78bd-n469c\" (UID: \"a96e730d-68e5-4430-9381-07513dc0bdac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"
Jul 07 12:56:51.855902 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:51.855806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"
Jul 07 12:56:52.171584 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:52.171536    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:56:52.173709 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:56:52.173678    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:56:59.524449 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:56:59.524397    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f447b9b5d-vwmkx" podUID="f899d953-b82b-49cb-81d4-86a88b3534c1" containerName="console" containerID="cri-o://44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e" gracePeriod=15
Jul 07 12:57:03.000132 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.000112    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:57:03.005701 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.005664    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:57:03.013659 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.013637    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:57:03.026451 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.026420    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:57:03.052289 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.052229    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:57:03.054753 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.054733    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:57:03.056725 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.056702    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:57:03.108174 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-extensions-socket-volume\") pod \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") "
Jul 07 12:57:03.108286 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-serving-cert\") pod \"f899d953-b82b-49cb-81d4-86a88b3534c1\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") "
Jul 07 12:57:03.108286 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108202    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-service-ca\") pod \"f899d953-b82b-49cb-81d4-86a88b3534c1\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") "
Jul 07 12:57:03.108286 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-oauth-config\") pod \"f899d953-b82b-49cb-81d4-86a88b3534c1\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") "
Jul 07 12:57:03.108286 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-console-config\") pod \"f899d953-b82b-49cb-81d4-86a88b3534c1\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") "
Jul 07 12:57:03.108286 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108267    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-oauth-serving-cert\") pod \"f899d953-b82b-49cb-81d4-86a88b3534c1\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") "
Jul 07 12:57:03.108628 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108308    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pqn2\" (UniqueName: \"kubernetes.io/projected/f899d953-b82b-49cb-81d4-86a88b3534c1-kube-api-access-4pqn2\") pod \"f899d953-b82b-49cb-81d4-86a88b3534c1\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") "
Jul 07 12:57:03.108628 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108333    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq4gb\" (UniqueName: \"kubernetes.io/projected/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-kube-api-access-qq4gb\") pod \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\" (UID: \"9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5\") "
Jul 07 12:57:03.108628 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-trusted-ca-bundle\") pod \"f899d953-b82b-49cb-81d4-86a88b3534c1\" (UID: \"f899d953-b82b-49cb-81d4-86a88b3534c1\") "
Jul 07 12:57:03.108628 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j59fp\" (UniqueName: \"kubernetes.io/projected/d0e83527-e013-445e-80b7-8f26f245278e-kube-api-access-j59fp\") pod \"d0e83527-e013-445e-80b7-8f26f245278e\" (UID: \"d0e83527-e013-445e-80b7-8f26f245278e\") "
Jul 07 12:57:03.108836 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108652    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "f899d953-b82b-49cb-81d4-86a88b3534c1" (UID: "f899d953-b82b-49cb-81d4-86a88b3534c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:57:03.108932 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108900    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" (UID: "9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:57:03.109054 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108930    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-service-ca\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.109054 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108964    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f899d953-b82b-49cb-81d4-86a88b3534c1" (UID: "f899d953-b82b-49cb-81d4-86a88b3534c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:57:03.109054 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.108973    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-console-config" (OuterVolumeSpecName: "console-config") pod "f899d953-b82b-49cb-81d4-86a88b3534c1" (UID: "f899d953-b82b-49cb-81d4-86a88b3534c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:57:03.109335 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.109313    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f899d953-b82b-49cb-81d4-86a88b3534c1" (UID: "f899d953-b82b-49cb-81d4-86a88b3534c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:57:03.110729 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.110710    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0e83527-e013-445e-80b7-8f26f245278e-kube-api-access-j59fp" (OuterVolumeSpecName: "kube-api-access-j59fp") pod "d0e83527-e013-445e-80b7-8f26f245278e" (UID: "d0e83527-e013-445e-80b7-8f26f245278e"). InnerVolumeSpecName "kube-api-access-j59fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:57:03.111034 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.111008    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f899d953-b82b-49cb-81d4-86a88b3534c1" (UID: "f899d953-b82b-49cb-81d4-86a88b3534c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:57:03.111134 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.111015    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-kube-api-access-qq4gb" (OuterVolumeSpecName: "kube-api-access-qq4gb") pod "9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" (UID: "9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5"). InnerVolumeSpecName "kube-api-access-qq4gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:57:03.111134 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.111104    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f899d953-b82b-49cb-81d4-86a88b3534c1-kube-api-access-4pqn2" (OuterVolumeSpecName: "kube-api-access-4pqn2") pod "f899d953-b82b-49cb-81d4-86a88b3534c1" (UID: "f899d953-b82b-49cb-81d4-86a88b3534c1"). InnerVolumeSpecName "kube-api-access-4pqn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:57:03.111220 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.111185    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f899d953-b82b-49cb-81d4-86a88b3534c1" (UID: "f899d953-b82b-49cb-81d4-86a88b3534c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:57:03.210282 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210255    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pqn2\" (UniqueName: \"kubernetes.io/projected/f899d953-b82b-49cb-81d4-86a88b3534c1-kube-api-access-4pqn2\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210282 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210280    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq4gb\" (UniqueName: \"kubernetes.io/projected/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-kube-api-access-qq4gb\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210282 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210290    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-trusted-ca-bundle\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210299    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j59fp\" (UniqueName: \"kubernetes.io/projected/d0e83527-e013-445e-80b7-8f26f245278e-kube-api-access-j59fp\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210307    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5-extensions-socket-volume\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210315    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210323    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f899d953-b82b-49cb-81d4-86a88b3534c1-console-oauth-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210332    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-console-config\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.210488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.210340    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f899d953-b82b-49cb-81d4-86a88b3534c1-oauth-serving-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:03.239553 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.239529    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"]
Jul 07 12:57:03.242169 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:57:03.242145    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96e730d_68e5_4430_9381_07513dc0bdac.slice/crio-b28eaed61bb2eb4a1073f6d9a51c3d43b483b07bbefa1e024dbfd6503a2ea13c WatchSource:0}: Error finding container b28eaed61bb2eb4a1073f6d9a51c3d43b483b07bbefa1e024dbfd6503a2ea13c: Status 404 returned error can't find the container with id b28eaed61bb2eb4a1073f6d9a51c3d43b483b07bbefa1e024dbfd6503a2ea13c
Jul 07 12:57:03.248468 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.248448    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"]
Jul 07 12:57:03.249081 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:57:03.249056    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317c0354_786b_4d1a_9802_8882315e2ad6.slice/crio-364bf709e1417be7852b98c29a4eb289f460268499838d9c332e1666cd3b8a83 WatchSource:0}: Error finding container 364bf709e1417be7852b98c29a4eb289f460268499838d9c332e1666cd3b8a83: Status 404 returned error can't find the container with id 364bf709e1417be7852b98c29a4eb289f460268499838d9c332e1666cd3b8a83
Jul 07 12:57:03.593967 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.593883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6" event={"ID":"317c0354-786b-4d1a-9802-8882315e2ad6","Type":"ContainerStarted","Data":"f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f"}
Jul 07 12:57:03.593967 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.593940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6" event={"ID":"317c0354-786b-4d1a-9802-8882315e2ad6","Type":"ContainerStarted","Data":"364bf709e1417be7852b98c29a4eb289f460268499838d9c332e1666cd3b8a83"}
Jul 07 12:57:03.594189 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.593999    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:57:03.595279 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.595254    2580 generic.go:356] "Generic (PLEG): container finished" podID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" containerID="b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39" exitCode=0
Jul 07 12:57:03.595384 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.595294    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:57:03.595384 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.595349    2580 scope.go:117] "RemoveContainer" containerID="b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39"
Jul 07 12:57:03.596619 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.596591    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:57:03.597079 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.597050    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c" event={"ID":"a96e730d-68e5-4430-9381-07513dc0bdac","Type":"ContainerStarted","Data":"9cf02efde1415a59947b8edf77935db5487b97cecf43d75ecf5ed0e9147b6e25"}
Jul 07 12:57:03.597182 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.597099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c" event={"ID":"a96e730d-68e5-4430-9381-07513dc0bdac","Type":"ContainerStarted","Data":"b28eaed61bb2eb4a1073f6d9a51c3d43b483b07bbefa1e024dbfd6503a2ea13c"}
Jul 07 12:57:03.597182 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.597165    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"
Jul 07 12:57:03.598906 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.598879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb" event={"ID":"65f0089e-dc60-41d2-8a58-ef61b3429400","Type":"ContainerStarted","Data":"c0c3b0690d81197b21822c4b2f8454e56ac7d9b5ffae13d7bc9dd2f49d06990a"}
Jul 07 12:57:03.599885 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.599828    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:57:03.600275 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.600253    2580 generic.go:356] "Generic (PLEG): container finished" podID="f899d953-b82b-49cb-81d4-86a88b3534c1" containerID="44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e" exitCode=0
Jul 07 12:57:03.600373 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.600317    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f447b9b5d-vwmkx"
Jul 07 12:57:03.600373 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.600329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f447b9b5d-vwmkx" event={"ID":"f899d953-b82b-49cb-81d4-86a88b3534c1","Type":"ContainerDied","Data":"44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e"}
Jul 07 12:57:03.600373 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.600368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f447b9b5d-vwmkx" event={"ID":"f899d953-b82b-49cb-81d4-86a88b3534c1","Type":"ContainerDied","Data":"b1105db1f225d9614a253d94e31d0e12a1d4086dc117caa1d6bae8567c0e7052"}
Jul 07 12:57:03.601923 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.601898    2580 generic.go:356] "Generic (PLEG): container finished" podID="d0e83527-e013-445e-80b7-8f26f245278e" containerID="1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da" exitCode=0
Jul 07 12:57:03.602018 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.601964    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:57:03.607152 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.607130    2580 scope.go:117] "RemoveContainer" containerID="b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39"
Jul 07 12:57:03.607481 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.607461    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39\": container with ID starting with b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39 not found: ID does not exist" containerID="b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39"
Jul 07 12:57:03.607596 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.607490    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39"} err="failed to get container status \"b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39\": rpc error: code = NotFound desc = could not find container \"b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39\": container with ID starting with b540bd82c7cc1bcd0b0be16d23b4792498d66c6a922780d025726b3529328a39 not found: ID does not exist"
Jul 07 12:57:03.607596 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.607532    2580 scope.go:117] "RemoveContainer" containerID="44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e"
Jul 07 12:57:03.617729 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.617714    2580 scope.go:117] "RemoveContainer" containerID="44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e"
Jul 07 12:57:03.617965 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.617945    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e\": container with ID starting with 44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e not found: ID does not exist" containerID="44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e"
Jul 07 12:57:03.618021 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.617971    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e"} err="failed to get container status \"44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e\": rpc error: code = NotFound desc = could not find container \"44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e\": container with ID starting with 44583b2b47c953de43a624e1ddf6f5b1ba19db178cc710c8316ddbdac75b178e not found: ID does not exist"
Jul 07 12:57:03.618021 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.617988    2580 scope.go:117] "RemoveContainer" containerID="1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da"
Jul 07 12:57:03.626657 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.626640    2580 scope.go:117] "RemoveContainer" containerID="1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da"
Jul 07 12:57:03.626963 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.626938    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da\": container with ID starting with 1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da not found: ID does not exist" containerID="1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da"
Jul 07 12:57:03.627056 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.626972    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da"} err="failed to get container status \"1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da\": rpc error: code = NotFound desc = could not find container \"1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da\": container with ID starting with 1c2dac22638c9d782d48eeaafbc753972786fd3bb747d4dbacab99c76d3ad1da not found: ID does not exist"
Jul 07 12:57:03.628325 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.628289    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6" podStartSLOduration=12.62827687 podStartE2EDuration="12.62827687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:03.626192624 +0000 UTC m=+511.889369096" watchObservedRunningTime="2026-07-07 12:57:03.62827687 +0000 UTC m=+511.891453321"
Jul 07 12:57:03.628451 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.628431    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5rl6m\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5rl6m"
Jul 07 12:57:03.637384 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.637357    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9848d6e6_be08_4aaa_ac76_5d3a4ad6d9f5.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e83527_e013_445e_80b7_8f26f245278e.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf899d953_b82b_49cb_81d4_86a88b3534c1.slice/crio-b1105db1f225d9614a253d94e31d0e12a1d4086dc117caa1d6bae8567c0e7052\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf899d953_b82b_49cb_81d4_86a88b3534c1.slice\": RecentStats: unable to find data in memory cache]"
Jul 07 12:57:03.652806 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.652767    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tmnb" podStartSLOduration=2.201039289 podStartE2EDuration="23.65275582s" totalImagesPullingTime="21.451716531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:03.65101745 +0000 UTC m=+511.914193922" watchObservedRunningTime="2026-07-07 12:57:03.65275582 +0000 UTC m=+511.915932292"
Jul 07 12:57:03.676392 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.676364    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f447b9b5d-vwmkx"]
Jul 07 12:57:03.686755 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.686727    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f447b9b5d-vwmkx"]
Jul 07 12:57:03.705940 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:03.705895    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c" podStartSLOduration=12.705880127 podStartE2EDuration="12.705880127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:03.70439272 +0000 UTC m=+511.967569192" watchObservedRunningTime="2026-07-07 12:57:03.705880127 +0000 UTC m=+511.969056599"
Jul 07 12:57:03.709301 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:03.709275    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d22kd\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d0e83527-e013-445e-80b7-8f26f245278e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d22kd"
Jul 07 12:57:04.172638 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:04.172605    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5" path="/var/lib/kubelet/pods/9848d6e6-be08-4aaa-ac76-5d3a4ad6d9f5/volumes"
Jul 07 12:57:04.172977 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:04.172934    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0e83527-e013-445e-80b7-8f26f245278e" path="/var/lib/kubelet/pods/d0e83527-e013-445e-80b7-8f26f245278e/volumes"
Jul 07 12:57:04.173290 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:04.173277    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f899d953-b82b-49cb-81d4-86a88b3534c1" path="/var/lib/kubelet/pods/f899d953-b82b-49cb-81d4-86a88b3534c1/volumes"
Jul 07 12:57:05.349648 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:05.349608    2580 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-v6tnn_kuadrant-system_e798b68e-b32e-4707-8a84-ea8452cbe4f5_0(18e33fe2341eba27dfa5a5ccccab75f306a19e93fe96413b7b6111b0f6426543): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-v6tnn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 07 12:57:05.349899 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:05.349676    2580 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-v6tnn_kuadrant-system_e798b68e-b32e-4707-8a84-ea8452cbe4f5_0(18e33fe2341eba27dfa5a5ccccab75f306a19e93fe96413b7b6111b0f6426543): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-v6tnn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:05.616328 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.616250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:05.619038 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:05.619004    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="e798b68e-b32e-4707-8a84-ea8452cbe4f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:05.624759 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.624738    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:05.626783 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:05.626752    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="e798b68e-b32e-4707-8a84-ea8452cbe4f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:05.731111 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.731085    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e798b68e-b32e-4707-8a84-ea8452cbe4f5-extensions-socket-volume\") pod \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") "
Jul 07 12:57:05.731249 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.731174    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsp7b\" (UniqueName: \"kubernetes.io/projected/e798b68e-b32e-4707-8a84-ea8452cbe4f5-kube-api-access-fsp7b\") pod \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\" (UID: \"e798b68e-b32e-4707-8a84-ea8452cbe4f5\") "
Jul 07 12:57:05.731316 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.731285    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e798b68e-b32e-4707-8a84-ea8452cbe4f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e798b68e-b32e-4707-8a84-ea8452cbe4f5" (UID: "e798b68e-b32e-4707-8a84-ea8452cbe4f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:57:05.731446 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.731431    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e798b68e-b32e-4707-8a84-ea8452cbe4f5-extensions-socket-volume\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:05.733198 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.733175    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e798b68e-b32e-4707-8a84-ea8452cbe4f5-kube-api-access-fsp7b" (OuterVolumeSpecName: "kube-api-access-fsp7b") pod "e798b68e-b32e-4707-8a84-ea8452cbe4f5" (UID: "e798b68e-b32e-4707-8a84-ea8452cbe4f5"). InnerVolumeSpecName "kube-api-access-fsp7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:57:05.832351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:05.832311    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsp7b\" (UniqueName: \"kubernetes.io/projected/e798b68e-b32e-4707-8a84-ea8452cbe4f5-kube-api-access-fsp7b\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:06.172093 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:06.172051    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e798b68e-b32e-4707-8a84-ea8452cbe4f5" path="/var/lib/kubelet/pods/e798b68e-b32e-4707-8a84-ea8452cbe4f5/volumes"
Jul 07 12:57:06.621648 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:06.621569    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:06.623604 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:06.623570    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="e798b68e-b32e-4707-8a84-ea8452cbe4f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:06.625635 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:06.625607    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v6tnn\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="e798b68e-b32e-4707-8a84-ea8452cbe4f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v6tnn"
Jul 07 12:57:14.611887 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:14.611854    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n469c"
Jul 07 12:57:14.612314 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:14.611935    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:57:15.015760 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.015729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"]
Jul 07 12:57:15.016163 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.016145    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f899d953-b82b-49cb-81d4-86a88b3534c1" containerName="console"
Jul 07 12:57:15.016212 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.016165    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f899d953-b82b-49cb-81d4-86a88b3534c1" containerName="console"
Jul 07 12:57:15.016256 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.016235    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f899d953-b82b-49cb-81d4-86a88b3534c1" containerName="console"
Jul 07 12:57:15.020889 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.020869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.034384 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.034363    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"]
Jul 07 12:57:15.108631 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.108603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c49ced59-7db5-4c60-8c75-71715f96480b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j6nth\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.108740 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.108695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztj5f\" (UniqueName: \"kubernetes.io/projected/c49ced59-7db5-4c60-8c75-71715f96480b-kube-api-access-ztj5f\") pod \"kuadrant-operator-controller-manager-86878c769f-j6nth\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.209571 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.209491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztj5f\" (UniqueName: \"kubernetes.io/projected/c49ced59-7db5-4c60-8c75-71715f96480b-kube-api-access-ztj5f\") pod \"kuadrant-operator-controller-manager-86878c769f-j6nth\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.209571 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.209557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c49ced59-7db5-4c60-8c75-71715f96480b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j6nth\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.209876 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.209861    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c49ced59-7db5-4c60-8c75-71715f96480b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j6nth\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.224846 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.224828    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztj5f\" (UniqueName: \"kubernetes.io/projected/c49ced59-7db5-4c60-8c75-71715f96480b-kube-api-access-ztj5f\") pod \"kuadrant-operator-controller-manager-86878c769f-j6nth\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.330428 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.330408    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.478233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.478207    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"]
Jul 07 12:57:15.479671 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:57:15.479642    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49ced59_7db5_4c60_8c75_71715f96480b.slice/crio-1e40567244ac11d07e803abfdfba690d95a0a67907705891185a3a65bdc61700 WatchSource:0}: Error finding container 1e40567244ac11d07e803abfdfba690d95a0a67907705891185a3a65bdc61700: Status 404 returned error can't find the container with id 1e40567244ac11d07e803abfdfba690d95a0a67907705891185a3a65bdc61700
Jul 07 12:57:15.669605 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.669574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth" event={"ID":"c49ced59-7db5-4c60-8c75-71715f96480b","Type":"ContainerStarted","Data":"f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1"}
Jul 07 12:57:15.670014 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.669624    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth" event={"ID":"c49ced59-7db5-4c60-8c75-71715f96480b","Type":"ContainerStarted","Data":"1e40567244ac11d07e803abfdfba690d95a0a67907705891185a3a65bdc61700"}
Jul 07 12:57:15.670014 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.669682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:15.713096 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:15.713046    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth" podStartSLOduration=1.713034497 podStartE2EDuration="1.713034497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:15.711824696 +0000 UTC m=+523.975001180" watchObservedRunningTime="2026-07-07 12:57:15.713034497 +0000 UTC m=+523.976210968"
Jul 07 12:57:26.677606 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:26.677527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 12:57:26.742603 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:26.742572    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"]
Jul 07 12:57:26.742778 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:26.742757    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6" podUID="317c0354-786b-4d1a-9802-8882315e2ad6" containerName="manager" containerID="cri-o://f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f" gracePeriod=10
Jul 07 12:57:27.041970 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.041945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:57:27.205323 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.205296    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317c0354-786b-4d1a-9802-8882315e2ad6-extensions-socket-volume\") pod \"317c0354-786b-4d1a-9802-8882315e2ad6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") "
Jul 07 12:57:27.205488 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.205334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77xjp\" (UniqueName: \"kubernetes.io/projected/317c0354-786b-4d1a-9802-8882315e2ad6-kube-api-access-77xjp\") pod \"317c0354-786b-4d1a-9802-8882315e2ad6\" (UID: \"317c0354-786b-4d1a-9802-8882315e2ad6\") "
Jul 07 12:57:27.205712 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.205690    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317c0354-786b-4d1a-9802-8882315e2ad6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "317c0354-786b-4d1a-9802-8882315e2ad6" (UID: "317c0354-786b-4d1a-9802-8882315e2ad6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:57:27.207463 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.207442    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317c0354-786b-4d1a-9802-8882315e2ad6-kube-api-access-77xjp" (OuterVolumeSpecName: "kube-api-access-77xjp") pod "317c0354-786b-4d1a-9802-8882315e2ad6" (UID: "317c0354-786b-4d1a-9802-8882315e2ad6"). InnerVolumeSpecName "kube-api-access-77xjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:57:27.306309 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.306237    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/317c0354-786b-4d1a-9802-8882315e2ad6-extensions-socket-volume\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:27.306309 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.306270    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77xjp\" (UniqueName: \"kubernetes.io/projected/317c0354-786b-4d1a-9802-8882315e2ad6-kube-api-access-77xjp\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:27.737841 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.737810    2580 generic.go:356] "Generic (PLEG): container finished" podID="317c0354-786b-4d1a-9802-8882315e2ad6" containerID="f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f" exitCode=0
Jul 07 12:57:27.738269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.737855    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"
Jul 07 12:57:27.738269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.737858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6" event={"ID":"317c0354-786b-4d1a-9802-8882315e2ad6","Type":"ContainerDied","Data":"f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f"}
Jul 07 12:57:27.738269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.737991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6" event={"ID":"317c0354-786b-4d1a-9802-8882315e2ad6","Type":"ContainerDied","Data":"364bf709e1417be7852b98c29a4eb289f460268499838d9c332e1666cd3b8a83"}
Jul 07 12:57:27.738269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.738066    2580 scope.go:117] "RemoveContainer" containerID="f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f"
Jul 07 12:57:27.748475 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.748288    2580 scope.go:117] "RemoveContainer" containerID="f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f"
Jul 07 12:57:27.748576 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:27.748557    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f\": container with ID starting with f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f not found: ID does not exist" containerID="f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f"
Jul 07 12:57:27.748616 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.748584    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f"} err="failed to get container status \"f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f\": rpc error: code = NotFound desc = could not find container \"f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f\": container with ID starting with f6e4803633d7deed20ac0a46a6bdc20cdad6e545845066d64ed6cf54ba30a26f not found: ID does not exist"
Jul 07 12:57:27.770154 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.770124    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"]
Jul 07 12:57:27.774445 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:27.774421    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2dds6"]
Jul 07 12:57:28.172154 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:28.172118    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="317c0354-786b-4d1a-9802-8882315e2ad6" path="/var/lib/kubelet/pods/317c0354-786b-4d1a-9802-8882315e2ad6/volumes"
Jul 07 12:57:33.781754 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.781719    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8l74s"]
Jul 07 12:57:33.783014 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.782986    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317c0354-786b-4d1a-9802-8882315e2ad6" containerName="manager"
Jul 07 12:57:33.783173 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.783161    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="317c0354-786b-4d1a-9802-8882315e2ad6" containerName="manager"
Jul 07 12:57:33.783418 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.783404    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="317c0354-786b-4d1a-9802-8882315e2ad6" containerName="manager"
Jul 07 12:57:33.846601 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.846575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8l74s"]
Jul 07 12:57:33.846758 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.846686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:33.849304 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.849276    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 12:57:33.870966 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.870934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8l74s"]
Jul 07 12:57:33.964845 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.964814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-config-file\") pod \"limitador-limitador-64c94fd64f-8l74s\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:33.965011 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:33.964932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9sd\" (UniqueName: \"kubernetes.io/projected/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-kube-api-access-6s9sd\") pod \"limitador-limitador-64c94fd64f-8l74s\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:34.065878 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.065803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-config-file\") pod \"limitador-limitador-64c94fd64f-8l74s\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:34.065878 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.065845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9sd\" (UniqueName: \"kubernetes.io/projected/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-kube-api-access-6s9sd\") pod \"limitador-limitador-64c94fd64f-8l74s\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:34.066413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.066393    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-config-file\") pod \"limitador-limitador-64c94fd64f-8l74s\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:34.075830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.075806    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9sd\" (UniqueName: \"kubernetes.io/projected/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-kube-api-access-6s9sd\") pod \"limitador-limitador-64c94fd64f-8l74s\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:34.157906 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.157877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:34.294929 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.294902    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8l74s"]
Jul 07 12:57:34.295901 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:57:34.295868    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fb8b0d_87c9_41d0_804b_6a9a1ac4f26c.slice/crio-17e9fede57166506d85258e7df8752c6df7e05a8748833ebe2e095467e3bffb7 WatchSource:0}: Error finding container 17e9fede57166506d85258e7df8752c6df7e05a8748833ebe2e095467e3bffb7: Status 404 returned error can't find the container with id 17e9fede57166506d85258e7df8752c6df7e05a8748833ebe2e095467e3bffb7
Jul 07 12:57:34.595065 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.595034    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wqnqb"]
Jul 07 12:57:34.600046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.600026    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqnqb"
Jul 07 12:57:34.602435 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.602414    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z79xl\""
Jul 07 12:57:34.608829 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.608811    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqnqb"]
Jul 07 12:57:34.770370 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.770331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4x29\" (UniqueName: \"kubernetes.io/projected/39c090d2-85e4-40da-8b5d-b2eee7b9b1d4-kube-api-access-f4x29\") pod \"authorino-58cd955675-wqnqb\" (UID: \"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4\") " pod="kuadrant-system/authorino-58cd955675-wqnqb"
Jul 07 12:57:34.775658 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.775633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s" event={"ID":"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c","Type":"ContainerStarted","Data":"17e9fede57166506d85258e7df8752c6df7e05a8748833ebe2e095467e3bffb7"}
Jul 07 12:57:34.859563 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.859484    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lfmbs"]
Jul 07 12:57:34.862806 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.862791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lfmbs"
Jul 07 12:57:34.871132 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.871112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4x29\" (UniqueName: \"kubernetes.io/projected/39c090d2-85e4-40da-8b5d-b2eee7b9b1d4-kube-api-access-f4x29\") pod \"authorino-58cd955675-wqnqb\" (UID: \"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4\") " pod="kuadrant-system/authorino-58cd955675-wqnqb"
Jul 07 12:57:34.877348 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.877325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lfmbs"]
Jul 07 12:57:34.885153 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.885132    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4x29\" (UniqueName: \"kubernetes.io/projected/39c090d2-85e4-40da-8b5d-b2eee7b9b1d4-kube-api-access-f4x29\") pod \"authorino-58cd955675-wqnqb\" (UID: \"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4\") " pod="kuadrant-system/authorino-58cd955675-wqnqb"
Jul 07 12:57:34.910471 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.910441    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqnqb"
Jul 07 12:57:34.971728 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:34.971698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9n4\" (UniqueName: \"kubernetes.io/projected/b64387ec-b857-481e-8245-447ede8005a9-kube-api-access-6m9n4\") pod \"authorino-75d556bd77-lfmbs\" (UID: \"b64387ec-b857-481e-8245-447ede8005a9\") " pod="kuadrant-system/authorino-75d556bd77-lfmbs"
Jul 07 12:57:35.073164 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:35.072244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9n4\" (UniqueName: \"kubernetes.io/projected/b64387ec-b857-481e-8245-447ede8005a9-kube-api-access-6m9n4\") pod \"authorino-75d556bd77-lfmbs\" (UID: \"b64387ec-b857-481e-8245-447ede8005a9\") " pod="kuadrant-system/authorino-75d556bd77-lfmbs"
Jul 07 12:57:35.084225 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:35.084194    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9n4\" (UniqueName: \"kubernetes.io/projected/b64387ec-b857-481e-8245-447ede8005a9-kube-api-access-6m9n4\") pod \"authorino-75d556bd77-lfmbs\" (UID: \"b64387ec-b857-481e-8245-447ede8005a9\") " pod="kuadrant-system/authorino-75d556bd77-lfmbs"
Jul 07 12:57:35.099383 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:35.099119    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqnqb"]
Jul 07 12:57:35.105802 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:57:35.105778    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39c090d2_85e4_40da_8b5d_b2eee7b9b1d4.slice/crio-38ff1487ec0bf295e3ffc25a1b5b3de06150e311088814d0e0ec3727b50ce6f7 WatchSource:0}: Error finding container 38ff1487ec0bf295e3ffc25a1b5b3de06150e311088814d0e0ec3727b50ce6f7: Status 404 returned error can't find the container with id 38ff1487ec0bf295e3ffc25a1b5b3de06150e311088814d0e0ec3727b50ce6f7
Jul 07 12:57:35.172021 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:35.171953    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lfmbs"
Jul 07 12:57:35.344386 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:35.344116    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lfmbs"]
Jul 07 12:57:35.344386 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:57:35.344301    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb64387ec_b857_481e_8245_447ede8005a9.slice/crio-6737f7b56fecf6db8174148b91f54a1fc515a2b2c142f3fdac9fefb96a3fa97f WatchSource:0}: Error finding container 6737f7b56fecf6db8174148b91f54a1fc515a2b2c142f3fdac9fefb96a3fa97f: Status 404 returned error can't find the container with id 6737f7b56fecf6db8174148b91f54a1fc515a2b2c142f3fdac9fefb96a3fa97f
Jul 07 12:57:35.784185 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:35.784146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lfmbs" event={"ID":"b64387ec-b857-481e-8245-447ede8005a9","Type":"ContainerStarted","Data":"6737f7b56fecf6db8174148b91f54a1fc515a2b2c142f3fdac9fefb96a3fa97f"}
Jul 07 12:57:35.785528 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:35.785484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqnqb" event={"ID":"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4","Type":"ContainerStarted","Data":"38ff1487ec0bf295e3ffc25a1b5b3de06150e311088814d0e0ec3727b50ce6f7"}
Jul 07 12:57:37.806727 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:37.806689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s" event={"ID":"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c","Type":"ContainerStarted","Data":"4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87"}
Jul 07 12:57:37.807112 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:37.806789    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:37.831192 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:37.831125    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s" podStartSLOduration=1.912321429 podStartE2EDuration="4.83110355s" totalImagesPullingTime="2.918782121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:37.82706838 +0000 UTC m=+546.090244881" watchObservedRunningTime="2026-07-07 12:57:37.83110355 +0000 UTC m=+546.094280024"
Jul 07 12:57:39.819469 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:39.819382    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lfmbs" event={"ID":"b64387ec-b857-481e-8245-447ede8005a9","Type":"ContainerStarted","Data":"6f245dc116343beef29b52305a78e2e5211e209d6d37a15cadff607ed3094ab4"}
Jul 07 12:57:39.820922 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:39.820891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqnqb" event={"ID":"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4","Type":"ContainerStarted","Data":"bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437"}
Jul 07 12:57:39.838348 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:39.838307    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lfmbs" podStartSLOduration=1.655606642 podStartE2EDuration="5.838292961s" totalImagesPullingTime="4.182686319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:39.837251796 +0000 UTC m=+548.100428269" watchObservedRunningTime="2026-07-07 12:57:39.838292961 +0000 UTC m=+548.101469411"
Jul 07 12:57:39.852330 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:39.852281    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wqnqb" podStartSLOduration=1.44467451 podStartE2EDuration="5.852263976s" totalImagesPullingTime="4.407589466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:39.851925615 +0000 UTC m=+548.115102088" watchObservedRunningTime="2026-07-07 12:57:39.852263976 +0000 UTC m=+548.115440449"
Jul 07 12:57:39.895199 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:39.895174    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqnqb"]
Jul 07 12:57:41.831302 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:41.831264    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wqnqb" podUID="39c090d2-85e4-40da-8b5d-b2eee7b9b1d4" containerName="authorino" containerID="cri-o://bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437" gracePeriod=30
Jul 07 12:57:42.073916 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.073894    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqnqb"
Jul 07 12:57:42.128293 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.128272    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4x29\" (UniqueName: \"kubernetes.io/projected/39c090d2-85e4-40da-8b5d-b2eee7b9b1d4-kube-api-access-f4x29\") pod \"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4\" (UID: \"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4\") "
Jul 07 12:57:42.130196 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.130175    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c090d2-85e4-40da-8b5d-b2eee7b9b1d4-kube-api-access-f4x29" (OuterVolumeSpecName: "kube-api-access-f4x29") pod "39c090d2-85e4-40da-8b5d-b2eee7b9b1d4" (UID: "39c090d2-85e4-40da-8b5d-b2eee7b9b1d4"). InnerVolumeSpecName "kube-api-access-f4x29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:57:42.229496 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.229474    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4x29\" (UniqueName: \"kubernetes.io/projected/39c090d2-85e4-40da-8b5d-b2eee7b9b1d4-kube-api-access-f4x29\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:42.837955 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.837916    2580 generic.go:356] "Generic (PLEG): container finished" podID="39c090d2-85e4-40da-8b5d-b2eee7b9b1d4" containerID="bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437" exitCode=0
Jul 07 12:57:42.838325 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.837967    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wqnqb"
Jul 07 12:57:42.838325 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.837993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqnqb" event={"ID":"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4","Type":"ContainerDied","Data":"bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437"}
Jul 07 12:57:42.838325 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.838034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wqnqb" event={"ID":"39c090d2-85e4-40da-8b5d-b2eee7b9b1d4","Type":"ContainerDied","Data":"38ff1487ec0bf295e3ffc25a1b5b3de06150e311088814d0e0ec3727b50ce6f7"}
Jul 07 12:57:42.838325 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.838051    2580 scope.go:117] "RemoveContainer" containerID="bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437"
Jul 07 12:57:42.847004 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.846989    2580 scope.go:117] "RemoveContainer" containerID="bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437"
Jul 07 12:57:42.847248 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:42.847227    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437\": container with ID starting with bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437 not found: ID does not exist" containerID="bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437"
Jul 07 12:57:42.847312 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.847260    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437"} err="failed to get container status \"bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437\": rpc error: code = NotFound desc = could not find container \"bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437\": container with ID starting with bd25a64f9ef80805f0b4c4f4eb1900c1b965bc4aa5da22b03c3a82183fbb2437 not found: ID does not exist"
Jul 07 12:57:42.854413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.854391    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqnqb"]
Jul 07 12:57:42.856484 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:42.856459    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wqnqb"]
Jul 07 12:57:44.172524 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:44.172466    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39c090d2-85e4-40da-8b5d-b2eee7b9b1d4" path="/var/lib/kubelet/pods/39c090d2-85e4-40da-8b5d-b2eee7b9b1d4/volumes"
Jul 07 12:57:48.309124 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.309090    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8l74s"]
Jul 07 12:57:48.309903 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.309275    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s" podUID="80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" containerName="limitador" containerID="cri-o://4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87" gracePeriod=30
Jul 07 12:57:48.310333 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.310254    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:48.860678 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.860649    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:48.869238 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.869181    2580 generic.go:356] "Generic (PLEG): container finished" podID="80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" containerID="4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87" exitCode=0
Jul 07 12:57:48.869238 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.869214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s" event={"ID":"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c","Type":"ContainerDied","Data":"4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87"}
Jul 07 12:57:48.869406 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.869263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s" event={"ID":"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c","Type":"ContainerDied","Data":"17e9fede57166506d85258e7df8752c6df7e05a8748833ebe2e095467e3bffb7"}
Jul 07 12:57:48.869406 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.869293    2580 scope.go:117] "RemoveContainer" containerID="4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87"
Jul 07 12:57:48.869406 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.869218    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8l74s"
Jul 07 12:57:48.877946 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.877924    2580 scope.go:117] "RemoveContainer" containerID="4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87"
Jul 07 12:57:48.878311 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:57:48.878289    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87\": container with ID starting with 4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87 not found: ID does not exist" containerID="4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87"
Jul 07 12:57:48.878451 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.878423    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87"} err="failed to get container status \"4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87\": rpc error: code = NotFound desc = could not find container \"4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87\": container with ID starting with 4a250589016b6125320cce5213f3db70661ae8934a6329de2643ee3f183bfd87 not found: ID does not exist"
Jul 07 12:57:48.885602 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.881902    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s9sd\" (UniqueName: \"kubernetes.io/projected/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-kube-api-access-6s9sd\") pod \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") "
Jul 07 12:57:48.885602 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.882013    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-config-file\") pod \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\" (UID: \"80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c\") "
Jul 07 12:57:48.885602 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.883681    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-config-file" (OuterVolumeSpecName: "config-file") pod "80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" (UID: "80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:57:48.889495 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.889465    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-kube-api-access-6s9sd" (OuterVolumeSpecName: "kube-api-access-6s9sd") pod "80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" (UID: "80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c"). InnerVolumeSpecName "kube-api-access-6s9sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:57:48.982741 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.982717    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s9sd\" (UniqueName: \"kubernetes.io/projected/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-kube-api-access-6s9sd\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:48.982741 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:48.982740    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c-config-file\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:57:49.192383 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:49.192354    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8l74s"]
Jul 07 12:57:49.197055 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:49.197035    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8l74s"]
Jul 07 12:57:50.171698 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:50.171658    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" path="/var/lib/kubelet/pods/80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c/volumes"
Jul 07 12:57:54.858073 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.858040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-lxlcc"]
Jul 07 12:57:54.858415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.858371    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39c090d2-85e4-40da-8b5d-b2eee7b9b1d4" containerName="authorino"
Jul 07 12:57:54.858415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.858382    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39c090d2-85e4-40da-8b5d-b2eee7b9b1d4" containerName="authorino"
Jul 07 12:57:54.858415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.858394    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" containerName="limitador"
Jul 07 12:57:54.858415 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.858400    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" containerName="limitador"
Jul 07 12:57:54.858581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.858464    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="80fb8b0d-87c9-41d0-804b-6a9a1ac4f26c" containerName="limitador"
Jul 07 12:57:54.858581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.858473    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="39c090d2-85e4-40da-8b5d-b2eee7b9b1d4" containerName="authorino"
Jul 07 12:57:54.862636 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.862620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:54.865013 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.864990    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 12:57:54.865141 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.865094    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rj8ct\""
Jul 07 12:57:54.870749 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.870728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lxlcc"]
Jul 07 12:57:54.924372 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.924341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwxvr\" (UniqueName: \"kubernetes.io/projected/4afa8320-28e9-43cf-b4ce-5a15a32f1552-kube-api-access-xwxvr\") pod \"postgres-69fb4594cf-lxlcc\" (UID: \"4afa8320-28e9-43cf-b4ce-5a15a32f1552\") " pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:54.924528 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:54.924398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4afa8320-28e9-43cf-b4ce-5a15a32f1552-data\") pod \"postgres-69fb4594cf-lxlcc\" (UID: \"4afa8320-28e9-43cf-b4ce-5a15a32f1552\") " pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:55.025053 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:55.025024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwxvr\" (UniqueName: \"kubernetes.io/projected/4afa8320-28e9-43cf-b4ce-5a15a32f1552-kube-api-access-xwxvr\") pod \"postgres-69fb4594cf-lxlcc\" (UID: \"4afa8320-28e9-43cf-b4ce-5a15a32f1552\") " pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:55.025181 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:55.025079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4afa8320-28e9-43cf-b4ce-5a15a32f1552-data\") pod \"postgres-69fb4594cf-lxlcc\" (UID: \"4afa8320-28e9-43cf-b4ce-5a15a32f1552\") " pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:55.025394 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:55.025380    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4afa8320-28e9-43cf-b4ce-5a15a32f1552-data\") pod \"postgres-69fb4594cf-lxlcc\" (UID: \"4afa8320-28e9-43cf-b4ce-5a15a32f1552\") " pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:55.034033 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:55.034000    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwxvr\" (UniqueName: \"kubernetes.io/projected/4afa8320-28e9-43cf-b4ce-5a15a32f1552-kube-api-access-xwxvr\") pod \"postgres-69fb4594cf-lxlcc\" (UID: \"4afa8320-28e9-43cf-b4ce-5a15a32f1552\") " pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:55.173351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:55.173323    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:57:55.310355 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:55.310325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lxlcc"]
Jul 07 12:57:55.312009 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:57:55.311983    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afa8320_28e9_43cf_b4ce_5a15a32f1552.slice/crio-19b434aac813b9bca43e8468d79ba047a3df136008b5c644ec583deda5baeefe WatchSource:0}: Error finding container 19b434aac813b9bca43e8468d79ba047a3df136008b5c644ec583deda5baeefe: Status 404 returned error can't find the container with id 19b434aac813b9bca43e8468d79ba047a3df136008b5c644ec583deda5baeefe
Jul 07 12:57:55.905929 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:57:55.905895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lxlcc" event={"ID":"4afa8320-28e9-43cf-b4ce-5a15a32f1552","Type":"ContainerStarted","Data":"19b434aac813b9bca43e8468d79ba047a3df136008b5c644ec583deda5baeefe"}
Jul 07 12:58:00.939093 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:00.939052    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lxlcc" event={"ID":"4afa8320-28e9-43cf-b4ce-5a15a32f1552","Type":"ContainerStarted","Data":"3e034434afcabe2ed7d0b39d80bccf33b70aaa38c53aa6f8853e23bfed125e66"}
Jul 07 12:58:00.939579 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:00.939131    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:58:00.958767 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:00.958721    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-lxlcc" podStartSLOduration=2.123691613 podStartE2EDuration="6.958706921s" totalImagesPullingTime="4.835015308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:00.956337131 +0000 UTC m=+569.219513604" watchObservedRunningTime="2026-07-07 12:58:00.958706921 +0000 UTC m=+569.221883411"
Jul 07 12:58:06.975344 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:06.975316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-lxlcc"
Jul 07 12:58:07.593099 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.593061    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-blkbf"]
Jul 07 12:58:07.599649 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.599628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-blkbf"
Jul 07 12:58:07.619419 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.619395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-blkbf"]
Jul 07 12:58:07.634876 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.634849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78v4q\" (UniqueName: \"kubernetes.io/projected/7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a-kube-api-access-78v4q\") pod \"authorino-5d4b67c446-blkbf\" (UID: \"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a\") " pod="kuadrant-system/authorino-5d4b67c446-blkbf"
Jul 07 12:58:07.736087 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.736054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78v4q\" (UniqueName: \"kubernetes.io/projected/7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a-kube-api-access-78v4q\") pod \"authorino-5d4b67c446-blkbf\" (UID: \"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a\") " pod="kuadrant-system/authorino-5d4b67c446-blkbf"
Jul 07 12:58:07.745153 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.745131    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78v4q\" (UniqueName: \"kubernetes.io/projected/7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a-kube-api-access-78v4q\") pod \"authorino-5d4b67c446-blkbf\" (UID: \"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a\") " pod="kuadrant-system/authorino-5d4b67c446-blkbf"
Jul 07 12:58:07.826090 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.826058    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-blkbf"]
Jul 07 12:58:07.826300 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.826290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-blkbf"
Jul 07 12:58:07.859561 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.859491    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7c5cbb-vjrjb"]
Jul 07 12:58:07.864550 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.864525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb"
Jul 07 12:58:07.878671 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.878586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7c5cbb-vjrjb"]
Jul 07 12:58:07.937982 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.937958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trf5t\" (UniqueName: \"kubernetes.io/projected/30518353-8681-4918-b771-dabfdd93c340-kube-api-access-trf5t\") pod \"authorino-57f7c5cbb-vjrjb\" (UID: \"30518353-8681-4918-b771-dabfdd93c340\") " pod="kuadrant-system/authorino-57f7c5cbb-vjrjb"
Jul 07 12:58:07.968046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.968022    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-blkbf"]
Jul 07 12:58:07.969241 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:58:07.969209    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7650dd6a_3cd6_4cd0_b2d5_1b74f715bf4a.slice/crio-3751a993dcc0c61fc39e5061e35105d02143fc928bc6edede7217a13c25e1bf0 WatchSource:0}: Error finding container 3751a993dcc0c61fc39e5061e35105d02143fc928bc6edede7217a13c25e1bf0: Status 404 returned error can't find the container with id 3751a993dcc0c61fc39e5061e35105d02143fc928bc6edede7217a13c25e1bf0
Jul 07 12:58:07.979091 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:07.979069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-blkbf" event={"ID":"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a","Type":"ContainerStarted","Data":"3751a993dcc0c61fc39e5061e35105d02143fc928bc6edede7217a13c25e1bf0"}
Jul 07 12:58:08.038587 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.038564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trf5t\" (UniqueName: \"kubernetes.io/projected/30518353-8681-4918-b771-dabfdd93c340-kube-api-access-trf5t\") pod \"authorino-57f7c5cbb-vjrjb\" (UID: \"30518353-8681-4918-b771-dabfdd93c340\") " pod="kuadrant-system/authorino-57f7c5cbb-vjrjb"
Jul 07 12:58:08.050428 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.050403    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trf5t\" (UniqueName: \"kubernetes.io/projected/30518353-8681-4918-b771-dabfdd93c340-kube-api-access-trf5t\") pod \"authorino-57f7c5cbb-vjrjb\" (UID: \"30518353-8681-4918-b771-dabfdd93c340\") " pod="kuadrant-system/authorino-57f7c5cbb-vjrjb"
Jul 07 12:58:08.071364 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.071339    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7c5cbb-vjrjb"]
Jul 07 12:58:08.071600 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.071588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb"
Jul 07 12:58:08.201916 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.201886    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7c5cbb-vjrjb"]
Jul 07 12:58:08.203317 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:58:08.203295    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30518353_8681_4918_b771_dabfdd93c340.slice/crio-04020a5f126841641f6769bb23100316ae2b1e5b5ba37a89dcf80fa7cbcafbe6 WatchSource:0}: Error finding container 04020a5f126841641f6769bb23100316ae2b1e5b5ba37a89dcf80fa7cbcafbe6: Status 404 returned error can't find the container with id 04020a5f126841641f6769bb23100316ae2b1e5b5ba37a89dcf80fa7cbcafbe6
Jul 07 12:58:08.985669 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.985637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb" event={"ID":"30518353-8681-4918-b771-dabfdd93c340","Type":"ContainerStarted","Data":"51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc"}
Jul 07 12:58:08.986145 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.985680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb" event={"ID":"30518353-8681-4918-b771-dabfdd93c340","Type":"ContainerStarted","Data":"04020a5f126841641f6769bb23100316ae2b1e5b5ba37a89dcf80fa7cbcafbe6"}
Jul 07 12:58:08.986145 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.985691    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb" podUID="30518353-8681-4918-b771-dabfdd93c340" containerName="authorino" containerID="cri-o://51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc" gracePeriod=30
Jul 07 12:58:08.987312 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.987288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-blkbf" event={"ID":"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a","Type":"ContainerStarted","Data":"114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56"}
Jul 07 12:58:08.987408 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:08.987340    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-blkbf" podUID="7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a" containerName="authorino" containerID="cri-o://114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56" gracePeriod=30
Jul 07 12:58:09.004206 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.004165    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb" podStartSLOduration=1.620190167 podStartE2EDuration="2.004146619s" totalImagesPullingTime="383.956452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:09.003441258 +0000 UTC m=+577.266617731" watchObservedRunningTime="2026-07-07 12:58:09.004146619 +0000 UTC m=+577.267323094"
Jul 07 12:58:09.025686 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.025651    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-blkbf" podStartSLOduration=1.72046738 podStartE2EDuration="2.025638533s" totalImagesPullingTime="305.171153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:09.024687566 +0000 UTC m=+577.287864039" watchObservedRunningTime="2026-07-07 12:58:09.025638533 +0000 UTC m=+577.288815005"
Jul 07 12:58:09.278703 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.278680    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb"
Jul 07 12:58:09.281781 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.281761    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-blkbf"
Jul 07 12:58:09.350254 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.350224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78v4q\" (UniqueName: \"kubernetes.io/projected/7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a-kube-api-access-78v4q\") pod \"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a\" (UID: \"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a\") "
Jul 07 12:58:09.350399 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.350283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trf5t\" (UniqueName: \"kubernetes.io/projected/30518353-8681-4918-b771-dabfdd93c340-kube-api-access-trf5t\") pod \"30518353-8681-4918-b771-dabfdd93c340\" (UID: \"30518353-8681-4918-b771-dabfdd93c340\") "
Jul 07 12:58:09.352178 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.352147    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a-kube-api-access-78v4q" (OuterVolumeSpecName: "kube-api-access-78v4q") pod "7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a" (UID: "7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a"). InnerVolumeSpecName "kube-api-access-78v4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:58:09.352300 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.352247    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30518353-8681-4918-b771-dabfdd93c340-kube-api-access-trf5t" (OuterVolumeSpecName: "kube-api-access-trf5t") pod "30518353-8681-4918-b771-dabfdd93c340" (UID: "30518353-8681-4918-b771-dabfdd93c340"). InnerVolumeSpecName "kube-api-access-trf5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:58:09.450918 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.450894    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78v4q\" (UniqueName: \"kubernetes.io/projected/7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a-kube-api-access-78v4q\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:58:09.450918 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.450915    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trf5t\" (UniqueName: \"kubernetes.io/projected/30518353-8681-4918-b771-dabfdd93c340-kube-api-access-trf5t\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:58:09.993663 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.993626    2580 generic.go:356] "Generic (PLEG): container finished" podID="30518353-8681-4918-b771-dabfdd93c340" containerID="51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc" exitCode=0
Jul 07 12:58:09.994083 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.993674    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb"
Jul 07 12:58:09.994083 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.993713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb" event={"ID":"30518353-8681-4918-b771-dabfdd93c340","Type":"ContainerDied","Data":"51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc"}
Jul 07 12:58:09.994083 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.993758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7c5cbb-vjrjb" event={"ID":"30518353-8681-4918-b771-dabfdd93c340","Type":"ContainerDied","Data":"04020a5f126841641f6769bb23100316ae2b1e5b5ba37a89dcf80fa7cbcafbe6"}
Jul 07 12:58:09.994083 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.993781    2580 scope.go:117] "RemoveContainer" containerID="51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc"
Jul 07 12:58:09.995140 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.995010    2580 generic.go:356] "Generic (PLEG): container finished" podID="7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a" containerID="114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56" exitCode=0
Jul 07 12:58:09.995140 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.995081    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-blkbf"
Jul 07 12:58:09.995140 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.995130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-blkbf" event={"ID":"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a","Type":"ContainerDied","Data":"114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56"}
Jul 07 12:58:09.995320 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:09.995159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-blkbf" event={"ID":"7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a","Type":"ContainerDied","Data":"3751a993dcc0c61fc39e5061e35105d02143fc928bc6edede7217a13c25e1bf0"}
Jul 07 12:58:10.003896 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.003881    2580 scope.go:117] "RemoveContainer" containerID="51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc"
Jul 07 12:58:10.004154 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:58:10.004135    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc\": container with ID starting with 51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc not found: ID does not exist" containerID="51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc"
Jul 07 12:58:10.004195 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.004164    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc"} err="failed to get container status \"51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc\": rpc error: code = NotFound desc = could not find container \"51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc\": container with ID starting with 51da2ae082609401ef1e52e9b63b2f7c902abd394042162360cc4a1703687bfc not found: ID does not exist"
Jul 07 12:58:10.004195 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.004186    2580 scope.go:117] "RemoveContainer" containerID="114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56"
Jul 07 12:58:10.012102 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.012087    2580 scope.go:117] "RemoveContainer" containerID="114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56"
Jul 07 12:58:10.012352 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:58:10.012335    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56\": container with ID starting with 114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56 not found: ID does not exist" containerID="114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56"
Jul 07 12:58:10.012459 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.012358    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56"} err="failed to get container status \"114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56\": rpc error: code = NotFound desc = could not find container \"114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56\": container with ID starting with 114854918a5fde6aade8a8b7014081aa6977862abe4688e09a504ae80d8e8d56 not found: ID does not exist"
Jul 07 12:58:10.015885 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.015865    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7c5cbb-vjrjb"]
Jul 07 12:58:10.019519 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.019487    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7c5cbb-vjrjb"]
Jul 07 12:58:10.030312 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.030294    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-blkbf"]
Jul 07 12:58:10.034334 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.034315    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-blkbf"]
Jul 07 12:58:10.172121 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.172088    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30518353-8681-4918-b771-dabfdd93c340" path="/var/lib/kubelet/pods/30518353-8681-4918-b771-dabfdd93c340/volumes"
Jul 07 12:58:10.172400 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:10.172387    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a" path="/var/lib/kubelet/pods/7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a/volumes"
Jul 07 12:58:12.525314 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:12.525287    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lfmbs"]
Jul 07 12:58:12.525707 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:12.525450    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lfmbs" podUID="b64387ec-b857-481e-8245-447ede8005a9" containerName="authorino" containerID="cri-o://6f245dc116343beef29b52305a78e2e5211e209d6d37a15cadff607ed3094ab4" gracePeriod=30
Jul 07 12:58:13.014130 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:13.014098    2580 generic.go:356] "Generic (PLEG): container finished" podID="b64387ec-b857-481e-8245-447ede8005a9" containerID="6f245dc116343beef29b52305a78e2e5211e209d6d37a15cadff607ed3094ab4" exitCode=0
Jul 07 12:58:13.014295 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:13.014175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lfmbs" event={"ID":"b64387ec-b857-481e-8245-447ede8005a9","Type":"ContainerDied","Data":"6f245dc116343beef29b52305a78e2e5211e209d6d37a15cadff607ed3094ab4"}
Jul 07 12:58:13.342630 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:13.342608    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lfmbs"
Jul 07 12:58:13.484366 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:13.484295    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m9n4\" (UniqueName: \"kubernetes.io/projected/b64387ec-b857-481e-8245-447ede8005a9-kube-api-access-6m9n4\") pod \"b64387ec-b857-481e-8245-447ede8005a9\" (UID: \"b64387ec-b857-481e-8245-447ede8005a9\") "
Jul 07 12:58:13.486492 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:13.486465    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64387ec-b857-481e-8245-447ede8005a9-kube-api-access-6m9n4" (OuterVolumeSpecName: "kube-api-access-6m9n4") pod "b64387ec-b857-481e-8245-447ede8005a9" (UID: "b64387ec-b857-481e-8245-447ede8005a9"). InnerVolumeSpecName "kube-api-access-6m9n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:58:13.584950 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:13.584916    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m9n4\" (UniqueName: \"kubernetes.io/projected/b64387ec-b857-481e-8245-447ede8005a9-kube-api-access-6m9n4\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:58:14.020986 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:14.020946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lfmbs" event={"ID":"b64387ec-b857-481e-8245-447ede8005a9","Type":"ContainerDied","Data":"6737f7b56fecf6db8174148b91f54a1fc515a2b2c142f3fdac9fefb96a3fa97f"}
Jul 07 12:58:14.020986 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:14.020988    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lfmbs"
Jul 07 12:58:14.021188 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:14.021008    2580 scope.go:117] "RemoveContainer" containerID="6f245dc116343beef29b52305a78e2e5211e209d6d37a15cadff607ed3094ab4"
Jul 07 12:58:14.042412 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:14.042388    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lfmbs"]
Jul 07 12:58:14.046235 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:14.046215    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lfmbs"]
Jul 07 12:58:14.172108 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:14.172081    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64387ec-b857-481e-8245-447ede8005a9" path="/var/lib/kubelet/pods/b64387ec-b857-481e-8245-447ede8005a9/volumes"
Jul 07 12:58:16.842979 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.842948    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587857c49f-v4vbs"]
Jul 07 12:58:16.843351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843294    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64387ec-b857-481e-8245-447ede8005a9" containerName="authorino"
Jul 07 12:58:16.843351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843305    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64387ec-b857-481e-8245-447ede8005a9" containerName="authorino"
Jul 07 12:58:16.843351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843323    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30518353-8681-4918-b771-dabfdd93c340" containerName="authorino"
Jul 07 12:58:16.843351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843328    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="30518353-8681-4918-b771-dabfdd93c340" containerName="authorino"
Jul 07 12:58:16.843351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843336    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a" containerName="authorino"
Jul 07 12:58:16.843351 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843341    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a" containerName="authorino"
Jul 07 12:58:16.843561 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843394    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7650dd6a-3cd6-4cd0-b2d5-1b74f715bf4a" containerName="authorino"
Jul 07 12:58:16.843561 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843404    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="30518353-8681-4918-b771-dabfdd93c340" containerName="authorino"
Jul 07 12:58:16.843561 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.843409    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64387ec-b857-481e-8245-447ede8005a9" containerName="authorino"
Jul 07 12:58:16.846034 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.846000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:16.851148 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.851127    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 12:58:16.851282 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.851130    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 12:58:16.851463 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.851448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s9ktv\""
Jul 07 12:58:16.862131 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.862104    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587857c49f-v4vbs"]
Jul 07 12:58:16.913101 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.913065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h4gn\" (UniqueName: \"kubernetes.io/projected/da42e646-99fb-48bd-a6b0-3e7f67030c40-kube-api-access-5h4gn\") pod \"maas-controller-587857c49f-v4vbs\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") " pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:16.913259 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:16.913107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da42e646-99fb-48bd-a6b0-3e7f67030c40-webhook-cert\") pod \"maas-controller-587857c49f-v4vbs\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") " pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:17.013856 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.013825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h4gn\" (UniqueName: \"kubernetes.io/projected/da42e646-99fb-48bd-a6b0-3e7f67030c40-kube-api-access-5h4gn\") pod \"maas-controller-587857c49f-v4vbs\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") " pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:17.013988 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.013862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da42e646-99fb-48bd-a6b0-3e7f67030c40-webhook-cert\") pod \"maas-controller-587857c49f-v4vbs\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") " pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:17.016049 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.016028    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da42e646-99fb-48bd-a6b0-3e7f67030c40-webhook-cert\") pod \"maas-controller-587857c49f-v4vbs\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") " pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:17.025656 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.025635    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h4gn\" (UniqueName: \"kubernetes.io/projected/da42e646-99fb-48bd-a6b0-3e7f67030c40-kube-api-access-5h4gn\") pod \"maas-controller-587857c49f-v4vbs\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") " pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:17.051435 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.051407    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85587bc48f-k4t2l"]
Jul 07 12:58:17.053877 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.053861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.067610 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.067584    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85587bc48f-k4t2l"]
Jul 07 12:58:17.114942 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.114886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/099a1381-67d2-499a-8b9c-21876affd137-webhook-cert\") pod \"maas-controller-85587bc48f-k4t2l\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") " pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.114942 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.114922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvjc\" (UniqueName: \"kubernetes.io/projected/099a1381-67d2-499a-8b9c-21876affd137-kube-api-access-rlvjc\") pod \"maas-controller-85587bc48f-k4t2l\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") " pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.155859 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.155830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:17.215541 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.215484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvjc\" (UniqueName: \"kubernetes.io/projected/099a1381-67d2-499a-8b9c-21876affd137-kube-api-access-rlvjc\") pod \"maas-controller-85587bc48f-k4t2l\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") " pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.215694 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.215676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/099a1381-67d2-499a-8b9c-21876affd137-webhook-cert\") pod \"maas-controller-85587bc48f-k4t2l\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") " pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.218640 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.218275    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/099a1381-67d2-499a-8b9c-21876affd137-webhook-cert\") pod \"maas-controller-85587bc48f-k4t2l\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") " pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.224303 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.224279    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvjc\" (UniqueName: \"kubernetes.io/projected/099a1381-67d2-499a-8b9c-21876affd137-kube-api-access-rlvjc\") pod \"maas-controller-85587bc48f-k4t2l\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") " pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.291829 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.291801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587857c49f-v4vbs"]
Jul 07 12:58:17.293085 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:58:17.293061    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda42e646_99fb_48bd_a6b0_3e7f67030c40.slice/crio-e197508d4e171e88e190ba9f7915ed090abaac41445302a9a2f58a14d2f6d787 WatchSource:0}: Error finding container e197508d4e171e88e190ba9f7915ed090abaac41445302a9a2f58a14d2f6d787: Status 404 returned error can't find the container with id e197508d4e171e88e190ba9f7915ed090abaac41445302a9a2f58a14d2f6d787
Jul 07 12:58:17.363958 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.363931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:17.498318 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:17.498293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85587bc48f-k4t2l"]
Jul 07 12:58:17.500318 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:58:17.500296    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099a1381_67d2_499a_8b9c_21876affd137.slice/crio-b4e958ca26514a1a47b0697b767dfb274a82d2fa9398c984f40ef31a01f86105 WatchSource:0}: Error finding container b4e958ca26514a1a47b0697b767dfb274a82d2fa9398c984f40ef31a01f86105: Status 404 returned error can't find the container with id b4e958ca26514a1a47b0697b767dfb274a82d2fa9398c984f40ef31a01f86105
Jul 07 12:58:18.047339 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:18.047295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85587bc48f-k4t2l" event={"ID":"099a1381-67d2-499a-8b9c-21876affd137","Type":"ContainerStarted","Data":"b4e958ca26514a1a47b0697b767dfb274a82d2fa9398c984f40ef31a01f86105"}
Jul 07 12:58:18.049323 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:18.049254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587857c49f-v4vbs" event={"ID":"da42e646-99fb-48bd-a6b0-3e7f67030c40","Type":"ContainerStarted","Data":"e197508d4e171e88e190ba9f7915ed090abaac41445302a9a2f58a14d2f6d787"}
Jul 07 12:58:20.061917 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:20.061882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85587bc48f-k4t2l" event={"ID":"099a1381-67d2-499a-8b9c-21876affd137","Type":"ContainerStarted","Data":"ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769"}
Jul 07 12:58:20.062413 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:20.061991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:20.063528 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:20.063485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587857c49f-v4vbs" event={"ID":"da42e646-99fb-48bd-a6b0-3e7f67030c40","Type":"ContainerStarted","Data":"d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0"}
Jul 07 12:58:20.063616 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:20.063562    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:20.085810 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:20.085769    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85587bc48f-k4t2l" podStartSLOduration=1.116451621 podStartE2EDuration="3.085754977s" totalImagesPullingTime="1.969303356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:20.08515737 +0000 UTC m=+588.348333844" watchObservedRunningTime="2026-07-07 12:58:20.085754977 +0000 UTC m=+588.348931448"
Jul 07 12:58:20.113115 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:20.113067    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587857c49f-v4vbs" podStartSLOduration=1.947199185 podStartE2EDuration="4.113051957s" totalImagesPullingTime="2.165852772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:20.112999194 +0000 UTC m=+588.376175689" watchObservedRunningTime="2026-07-07 12:58:20.113051957 +0000 UTC m=+588.376228430"
Jul 07 12:58:31.075805 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.075766    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:31.076217 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.075843    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 12:58:31.150689 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.150653    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587857c49f-v4vbs"]
Jul 07 12:58:31.150906 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.150867    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-587857c49f-v4vbs" podUID="da42e646-99fb-48bd-a6b0-3e7f67030c40" containerName="manager" containerID="cri-o://d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0" gracePeriod=30
Jul 07 12:58:31.391273 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.391246    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:31.547250 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.547220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h4gn\" (UniqueName: \"kubernetes.io/projected/da42e646-99fb-48bd-a6b0-3e7f67030c40-kube-api-access-5h4gn\") pod \"da42e646-99fb-48bd-a6b0-3e7f67030c40\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") "
Jul 07 12:58:31.547394 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.547299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da42e646-99fb-48bd-a6b0-3e7f67030c40-webhook-cert\") pod \"da42e646-99fb-48bd-a6b0-3e7f67030c40\" (UID: \"da42e646-99fb-48bd-a6b0-3e7f67030c40\") "
Jul 07 12:58:31.549293 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.549261    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da42e646-99fb-48bd-a6b0-3e7f67030c40-kube-api-access-5h4gn" (OuterVolumeSpecName: "kube-api-access-5h4gn") pod "da42e646-99fb-48bd-a6b0-3e7f67030c40" (UID: "da42e646-99fb-48bd-a6b0-3e7f67030c40"). InnerVolumeSpecName "kube-api-access-5h4gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:58:31.549401 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.549336    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da42e646-99fb-48bd-a6b0-3e7f67030c40-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "da42e646-99fb-48bd-a6b0-3e7f67030c40" (UID: "da42e646-99fb-48bd-a6b0-3e7f67030c40"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:58:31.648122 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.648090    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da42e646-99fb-48bd-a6b0-3e7f67030c40-webhook-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:58:31.648122 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:31.648116    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h4gn\" (UniqueName: \"kubernetes.io/projected/da42e646-99fb-48bd-a6b0-3e7f67030c40-kube-api-access-5h4gn\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 12:58:32.135694 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.135659    2580 generic.go:356] "Generic (PLEG): container finished" podID="da42e646-99fb-48bd-a6b0-3e7f67030c40" containerID="d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0" exitCode=0
Jul 07 12:58:32.136117 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.135699    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587857c49f-v4vbs"
Jul 07 12:58:32.136117 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.135708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587857c49f-v4vbs" event={"ID":"da42e646-99fb-48bd-a6b0-3e7f67030c40","Type":"ContainerDied","Data":"d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0"}
Jul 07 12:58:32.136117 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.135783    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587857c49f-v4vbs" event={"ID":"da42e646-99fb-48bd-a6b0-3e7f67030c40","Type":"ContainerDied","Data":"e197508d4e171e88e190ba9f7915ed090abaac41445302a9a2f58a14d2f6d787"}
Jul 07 12:58:32.136117 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.135807    2580 scope.go:117] "RemoveContainer" containerID="d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0"
Jul 07 12:58:32.144811 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.144791    2580 scope.go:117] "RemoveContainer" containerID="d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0"
Jul 07 12:58:32.145073 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:58:32.145052    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0\": container with ID starting with d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0 not found: ID does not exist" containerID="d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0"
Jul 07 12:58:32.145145 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.145083    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0"} err="failed to get container status \"d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0\": rpc error: code = NotFound desc = could not find container \"d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0\": container with ID starting with d7505b21252802f391780c69223b9bae8a62a8180234ec873417e08970fd00e0 not found: ID does not exist"
Jul 07 12:58:32.158823 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.158798    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587857c49f-v4vbs"]
Jul 07 12:58:32.163233 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.163210    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-587857c49f-v4vbs"]
Jul 07 12:58:32.171723 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:32.171701    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da42e646-99fb-48bd-a6b0-3e7f67030c40" path="/var/lib/kubelet/pods/da42e646-99fb-48bd-a6b0-3e7f67030c40/volumes"
Jul 07 12:58:51.979762 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.979729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7dd85fb775-8qkl2"]
Jul 07 12:58:51.985200 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.980126    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da42e646-99fb-48bd-a6b0-3e7f67030c40" containerName="manager"
Jul 07 12:58:51.985200 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.980137    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="da42e646-99fb-48bd-a6b0-3e7f67030c40" containerName="manager"
Jul 07 12:58:51.985200 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.980202    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="da42e646-99fb-48bd-a6b0-3e7f67030c40" containerName="manager"
Jul 07 12:58:51.986654 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.986637    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:51.991156 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.991135    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 12:58:51.991391 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.991377    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w6kvh\""
Jul 07 12:58:51.998255 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:51.998224    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7dd85fb775-8qkl2"]
Jul 07 12:58:52.026141 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.026112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d04f2ad-75fc-48e9-829e-173787482b70-maas-api-tls\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.026305 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.026174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d04f2ad-75fc-48e9-829e-173787482b70-openshift-service-ca\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.026305 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.026207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsl27\" (UniqueName: \"kubernetes.io/projected/3d04f2ad-75fc-48e9-829e-173787482b70-kube-api-access-rsl27\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.127696 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.127661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d04f2ad-75fc-48e9-829e-173787482b70-openshift-service-ca\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.127871 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.127713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsl27\" (UniqueName: \"kubernetes.io/projected/3d04f2ad-75fc-48e9-829e-173787482b70-kube-api-access-rsl27\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.127871 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.127756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d04f2ad-75fc-48e9-829e-173787482b70-maas-api-tls\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.127945 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:58:52.127873    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 07 12:58:52.127945 ip-10-0-135-39 kubenswrapper[2580]: E0707 12:58:52.127939    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d04f2ad-75fc-48e9-829e-173787482b70-maas-api-tls podName:3d04f2ad-75fc-48e9-829e-173787482b70 nodeName:}" failed. No retries permitted until 2026-07-07 12:58:52.627919279 +0000 UTC m=+620.891095749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d04f2ad-75fc-48e9-829e-173787482b70-maas-api-tls") pod "maas-api-7dd85fb775-8qkl2" (UID: "3d04f2ad-75fc-48e9-829e-173787482b70") : secret "maas-api-serving-cert" not found
Jul 07 12:58:52.128291 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.128272    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d04f2ad-75fc-48e9-829e-173787482b70-openshift-service-ca\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.140843 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.140804    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsl27\" (UniqueName: \"kubernetes.io/projected/3d04f2ad-75fc-48e9-829e-173787482b70-kube-api-access-rsl27\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.634381 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.634344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d04f2ad-75fc-48e9-829e-173787482b70-maas-api-tls\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.636828 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.636802    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d04f2ad-75fc-48e9-829e-173787482b70-maas-api-tls\") pod \"maas-api-7dd85fb775-8qkl2\" (UID: \"3d04f2ad-75fc-48e9-829e-173787482b70\") " pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.721589 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.721556    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-fzm8x"]
Jul 07 12:58:52.730830 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.730796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:52.735597 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.735573    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 12:58:52.735811 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.735797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-846qk\""
Jul 07 12:58:52.748689 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.748651    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-fzm8x"]
Jul 07 12:58:52.819519 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.819482    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-sbpvm"]
Jul 07 12:58:52.823420 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.823403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:52.834897 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.834873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-sbpvm"]
Jul 07 12:58:52.836034 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.836010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxnv\" (UniqueName: \"kubernetes.io/projected/787ebaa4-510d-45a0-829b-b80249785ebb-kube-api-access-ddxnv\") pod \"payload-pre-processing-7964457696-fzm8x\" (UID: \"787ebaa4-510d-45a0-829b-b80249785ebb\") " pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:52.836174 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.836068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787ebaa4-510d-45a0-829b-b80249785ebb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-fzm8x\" (UID: \"787ebaa4-510d-45a0-829b-b80249785ebb\") " pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:52.897266 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.897189    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:52.937251 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.937217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8-plugins-config-volume\") pod \"payload-processing-58f86c7798-sbpvm\" (UID: \"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8\") " pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:52.937420 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.937261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz49v\" (UniqueName: \"kubernetes.io/projected/fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8-kube-api-access-hz49v\") pod \"payload-processing-58f86c7798-sbpvm\" (UID: \"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8\") " pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:52.937420 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.937290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxnv\" (UniqueName: \"kubernetes.io/projected/787ebaa4-510d-45a0-829b-b80249785ebb-kube-api-access-ddxnv\") pod \"payload-pre-processing-7964457696-fzm8x\" (UID: \"787ebaa4-510d-45a0-829b-b80249785ebb\") " pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:52.937553 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.937410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787ebaa4-510d-45a0-829b-b80249785ebb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-fzm8x\" (UID: \"787ebaa4-510d-45a0-829b-b80249785ebb\") " pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:52.938294 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.938273    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/787ebaa4-510d-45a0-829b-b80249785ebb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-fzm8x\" (UID: \"787ebaa4-510d-45a0-829b-b80249785ebb\") " pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:52.949077 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:52.949013    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxnv\" (UniqueName: \"kubernetes.io/projected/787ebaa4-510d-45a0-829b-b80249785ebb-kube-api-access-ddxnv\") pod \"payload-pre-processing-7964457696-fzm8x\" (UID: \"787ebaa4-510d-45a0-829b-b80249785ebb\") " pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:53.038177 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.038151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8-plugins-config-volume\") pod \"payload-processing-58f86c7798-sbpvm\" (UID: \"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8\") " pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:53.038587 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.038197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz49v\" (UniqueName: \"kubernetes.io/projected/fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8-kube-api-access-hz49v\") pod \"payload-processing-58f86c7798-sbpvm\" (UID: \"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8\") " pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:53.039021 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.038992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8-plugins-config-volume\") pod \"payload-processing-58f86c7798-sbpvm\" (UID: \"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8\") " pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:53.039021 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.039005    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7dd85fb775-8qkl2"]
Jul 07 12:58:53.040275 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:58:53.040253    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d04f2ad_75fc_48e9_829e_173787482b70.slice/crio-f8046e54add6ce59fabc0caceaaf5a58cb22995ca7369019e405bce650ae8b15 WatchSource:0}: Error finding container f8046e54add6ce59fabc0caceaaf5a58cb22995ca7369019e405bce650ae8b15: Status 404 returned error can't find the container with id f8046e54add6ce59fabc0caceaaf5a58cb22995ca7369019e405bce650ae8b15
Jul 07 12:58:53.041643 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.041622    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 12:58:53.042055 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.042038    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:53.045986 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.045965    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz49v\" (UniqueName: \"kubernetes.io/projected/fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8-kube-api-access-hz49v\") pod \"payload-processing-58f86c7798-sbpvm\" (UID: \"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8\") " pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:53.134831 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.134800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:53.188606 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:58:53.188576    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787ebaa4_510d_45a0_829b_b80249785ebb.slice/crio-38c1bc75d2600494fe4d0a5d1389f37e99c17ad9e73a36a459ff08d74cb5eff6 WatchSource:0}: Error finding container 38c1bc75d2600494fe4d0a5d1389f37e99c17ad9e73a36a459ff08d74cb5eff6: Status 404 returned error can't find the container with id 38c1bc75d2600494fe4d0a5d1389f37e99c17ad9e73a36a459ff08d74cb5eff6
Jul 07 12:58:53.189447 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.189314    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-fzm8x"]
Jul 07 12:58:53.245193 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.245160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x" event={"ID":"787ebaa4-510d-45a0-829b-b80249785ebb","Type":"ContainerStarted","Data":"38c1bc75d2600494fe4d0a5d1389f37e99c17ad9e73a36a459ff08d74cb5eff6"}
Jul 07 12:58:53.246690 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.246657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7dd85fb775-8qkl2" event={"ID":"3d04f2ad-75fc-48e9-829e-173787482b70","Type":"ContainerStarted","Data":"f8046e54add6ce59fabc0caceaaf5a58cb22995ca7369019e405bce650ae8b15"}
Jul 07 12:58:53.290733 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:53.290197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-sbpvm"]
Jul 07 12:58:53.294606 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:58:53.294573    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6a8f9a_f4a4_461a_946f_e0d8a1ff14f8.slice/crio-2fcd58827dcfcb6f654451a0b425d5838d5d2fab8cabf49263d749f7c273fd95 WatchSource:0}: Error finding container 2fcd58827dcfcb6f654451a0b425d5838d5d2fab8cabf49263d749f7c273fd95: Status 404 returned error can't find the container with id 2fcd58827dcfcb6f654451a0b425d5838d5d2fab8cabf49263d749f7c273fd95
Jul 07 12:58:54.254730 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:54.254631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-sbpvm" event={"ID":"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8","Type":"ContainerStarted","Data":"2fcd58827dcfcb6f654451a0b425d5838d5d2fab8cabf49263d749f7c273fd95"}
Jul 07 12:58:55.262269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.262193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-sbpvm" event={"ID":"fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8","Type":"ContainerStarted","Data":"17b06c1fc223f3cfb56a9e622266df6287e31a3241756bdcf90f91b0a1bcac1f"}
Jul 07 12:58:55.262718 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.262377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:58:55.263948 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.263922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x" event={"ID":"787ebaa4-510d-45a0-829b-b80249785ebb","Type":"ContainerStarted","Data":"d46401782e7081e45476f58033b66e60afd5aa4b53a8c128dcf3e5b32b5b7053"}
Jul 07 12:58:55.264074 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.263970    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:58:55.265370 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.265351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7dd85fb775-8qkl2" event={"ID":"3d04f2ad-75fc-48e9-829e-173787482b70","Type":"ContainerStarted","Data":"6f4da2bdd3f016348cfb9c775626ab4ecb5615fad3f2f4242d87ca64b2f01ad8"}
Jul 07 12:58:55.265451 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.265393    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:58:55.286851 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.286813    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-sbpvm" podStartSLOduration=1.638324226 podStartE2EDuration="3.286799591s" totalImagesPullingTime="1.648475365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:55.286625817 +0000 UTC m=+623.549802292" watchObservedRunningTime="2026-07-07 12:58:55.286799591 +0000 UTC m=+623.549976063"
Jul 07 12:58:55.313035 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.312986    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7dd85fb775-8qkl2" podStartSLOduration=2.407089899 podStartE2EDuration="4.312970441s" totalImagesPullingTime="1.905880542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:55.310731435 +0000 UTC m=+623.573907907" watchObservedRunningTime="2026-07-07 12:58:55.312970441 +0000 UTC m=+623.576146916"
Jul 07 12:58:55.330567 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:58:55.330526    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x" podStartSLOduration=1.576715323 podStartE2EDuration="3.330492611s" totalImagesPullingTime="1.753777288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:55.329359985 +0000 UTC m=+623.592536456" watchObservedRunningTime="2026-07-07 12:58:55.330492611 +0000 UTC m=+623.593669084"
Jul 07 12:59:01.276656 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:01.276631    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7dd85fb775-8qkl2"
Jul 07 12:59:06.272762 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:06.272723    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x" podUID="787ebaa4-510d-45a0-829b-b80249785ebb" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.57:9004: connect: connection refused"
Jul 07 12:59:06.273239 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:06.272888    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-sbpvm"
Jul 07 12:59:09.503269 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.503230    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"]
Jul 07 12:59:09.507653 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.507630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.510143 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.510122    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 12:59:09.510757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.510741    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 12:59:09.510849 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.510762    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 12:59:09.510849 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.510744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hd286\""
Jul 07 12:59:09.524880 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.524854    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"]
Jul 07 12:59:09.581546 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.581503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.581684 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.581585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af57a018-5ef8-4c8a-9494-72ea2654fe48-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.581684 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.581665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9jm\" (UniqueName: \"kubernetes.io/projected/af57a018-5ef8-4c8a-9494-72ea2654fe48-kube-api-access-rs9jm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.581777 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.581683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.581777 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.581700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.581777 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.581717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683218 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9jm\" (UniqueName: \"kubernetes.io/projected/af57a018-5ef8-4c8a-9494-72ea2654fe48-kube-api-access-rs9jm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683409 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683409 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683409 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683584 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683584 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af57a018-5ef8-4c8a-9494-72ea2654fe48-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683750 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683731    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683808 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683768    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.683878 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.683853    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.685489 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.685470    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af57a018-5ef8-4c8a-9494-72ea2654fe48-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.685948 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.685931    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af57a018-5ef8-4c8a-9494-72ea2654fe48-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.694114 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.694083    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9jm\" (UniqueName: \"kubernetes.io/projected/af57a018-5ef8-4c8a-9494-72ea2654fe48-kube-api-access-rs9jm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf\" (UID: \"af57a018-5ef8-4c8a-9494-72ea2654fe48\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.824449 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.824382    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:09.977700 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:09.977678    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"]
Jul 07 12:59:09.979305 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:59:09.979276    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf57a018_5ef8_4c8a_9494_72ea2654fe48.slice/crio-950ec6882c337a15102285e1a8eb74991ced10388e4e644dfe38c0a7bd92940a WatchSource:0}: Error finding container 950ec6882c337a15102285e1a8eb74991ced10388e4e644dfe38c0a7bd92940a: Status 404 returned error can't find the container with id 950ec6882c337a15102285e1a8eb74991ced10388e4e644dfe38c0a7bd92940a
Jul 07 12:59:10.352930 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:10.352884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf" event={"ID":"af57a018-5ef8-4c8a-9494-72ea2654fe48","Type":"ContainerStarted","Data":"950ec6882c337a15102285e1a8eb74991ced10388e4e644dfe38c0a7bd92940a"}
Jul 07 12:59:11.360501 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:11.360400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf" event={"ID":"af57a018-5ef8-4c8a-9494-72ea2654fe48","Type":"ContainerStarted","Data":"02d08df65d1ff043f02fc01da78a7129c7d9ecdbc400ac764917436a8392f7af"}
Jul 07 12:59:11.380572 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:11.380521    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf" podStartSLOduration=1.339532208 podStartE2EDuration="2.380487252s" totalImagesPullingTime="1.040955044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:59:11.379484534 +0000 UTC m=+639.642661006" watchObservedRunningTime="2026-07-07 12:59:11.380487252 +0000 UTC m=+639.643663707"
Jul 07 12:59:16.272012 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:16.271978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-fzm8x"
Jul 07 12:59:17.995196 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:17.995159    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"]
Jul 07 12:59:17.999131 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:17.999109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.001782 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.001765    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 12:59:18.009666 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.009646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"]
Jul 07 12:59:18.153765 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.153730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.153919 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.153770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.153919 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.153799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.153919 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.153871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d69nb\" (UniqueName: \"kubernetes.io/projected/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-kube-api-access-d69nb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.153919 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.153894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.154055 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.153932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255374 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255374 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d69nb\" (UniqueName: \"kubernetes.io/projected/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-kube-api-access-d69nb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255581 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255800 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255777    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255842 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255819    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.255882 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.255854    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.257728 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.257702    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.257904 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.257887    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.269888 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.269857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d69nb\" (UniqueName: \"kubernetes.io/projected/f1a074fa-a1ed-43b0-922d-e6b2c751a96e-kube-api-access-d69nb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-t2vmw\" (UID: \"f1a074fa-a1ed-43b0-922d-e6b2c751a96e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.312757 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.312734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:18.452526 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:18.452487    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"]
Jul 07 12:59:18.453880 ip-10-0-135-39 kubenswrapper[2580]: W0707 12:59:18.453854    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a074fa_a1ed_43b0_922d_e6b2c751a96e.slice/crio-c582eced9622f1d4bcf364371b52ac312d88a4307887090bb39e3a4adb73fd6d WatchSource:0}: Error finding container c582eced9622f1d4bcf364371b52ac312d88a4307887090bb39e3a4adb73fd6d: Status 404 returned error can't find the container with id c582eced9622f1d4bcf364371b52ac312d88a4307887090bb39e3a4adb73fd6d
Jul 07 12:59:19.403471 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:19.403433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw" event={"ID":"f1a074fa-a1ed-43b0-922d-e6b2c751a96e","Type":"ContainerStarted","Data":"126630e5f497e8446a53f5712e0d0292524f598f5b3284922fa847e5b3fa6601"}
Jul 07 12:59:19.403889 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:19.403498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw" event={"ID":"f1a074fa-a1ed-43b0-922d-e6b2c751a96e","Type":"ContainerStarted","Data":"c582eced9622f1d4bcf364371b52ac312d88a4307887090bb39e3a4adb73fd6d"}
Jul 07 12:59:19.421498 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:19.421444    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw" podStartSLOduration=2.179071058 podStartE2EDuration="2.421428659s" totalImagesPullingTime="242.357601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:59:19.420802061 +0000 UTC m=+647.683978534" watchObservedRunningTime="2026-07-07 12:59:19.421428659 +0000 UTC m=+647.684605147"
Jul 07 12:59:19.824834 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:19.824749    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:19.824834 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:19.824814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:19.840390 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:19.840362    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:20.419947 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:20.419914    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf"
Jul 07 12:59:28.313078 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:28.313040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:28.313607 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:28.313103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:28.326046 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:28.326012    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 12:59:28.465069 ip-10-0-135-39 kubenswrapper[2580]: I0707 12:59:28.465035    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-t2vmw"
Jul 07 13:00:00.145394 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.145352    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723820-24nzd"]
Jul 07 13:00:00.147886 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.147868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd"
Jul 07 13:00:00.157844 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.157819    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723820-24nzd"]
Jul 07 13:00:00.283717 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.283681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq8n9\" (UniqueName: \"kubernetes.io/projected/b3af30d7-5f79-4148-9aea-27be3fbb5c74-kube-api-access-lq8n9\") pod \"maas-api-key-cleanup-29723820-24nzd\" (UID: \"b3af30d7-5f79-4148-9aea-27be3fbb5c74\") " pod="opendatahub/maas-api-key-cleanup-29723820-24nzd"
Jul 07 13:00:00.384105 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.384074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq8n9\" (UniqueName: \"kubernetes.io/projected/b3af30d7-5f79-4148-9aea-27be3fbb5c74-kube-api-access-lq8n9\") pod \"maas-api-key-cleanup-29723820-24nzd\" (UID: \"b3af30d7-5f79-4148-9aea-27be3fbb5c74\") " pod="opendatahub/maas-api-key-cleanup-29723820-24nzd"
Jul 07 13:00:00.393264 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.393242    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq8n9\" (UniqueName: \"kubernetes.io/projected/b3af30d7-5f79-4148-9aea-27be3fbb5c74-kube-api-access-lq8n9\") pod \"maas-api-key-cleanup-29723820-24nzd\" (UID: \"b3af30d7-5f79-4148-9aea-27be3fbb5c74\") " pod="opendatahub/maas-api-key-cleanup-29723820-24nzd"
Jul 07 13:00:00.459100 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.459037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd"
Jul 07 13:00:00.796904 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:00.796875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723820-24nzd"]
Jul 07 13:00:00.797425 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:00:00.797396    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3af30d7_5f79_4148_9aea_27be3fbb5c74.slice/crio-e37095f3024656c7b55301c16c54a2fed718fcaa059d8fb539b07cd789cdb2d0 WatchSource:0}: Error finding container e37095f3024656c7b55301c16c54a2fed718fcaa059d8fb539b07cd789cdb2d0: Status 404 returned error can't find the container with id e37095f3024656c7b55301c16c54a2fed718fcaa059d8fb539b07cd789cdb2d0
Jul 07 13:00:01.630447 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:01.630408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd" event={"ID":"b3af30d7-5f79-4148-9aea-27be3fbb5c74","Type":"ContainerStarted","Data":"e37095f3024656c7b55301c16c54a2fed718fcaa059d8fb539b07cd789cdb2d0"}
Jul 07 13:00:02.283120 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.283086    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"]
Jul 07 13:00:02.286035 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.286013    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.288712 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.288691    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 13:00:02.301403 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.301376    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"]
Jul 07 13:00:02.401607 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.401572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.401757 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.401629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/526bb322-a40c-402f-93b3-42bbb88fc1c1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.401757 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.401704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.401757 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.401743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sgqw\" (UniqueName: \"kubernetes.io/projected/526bb322-a40c-402f-93b3-42bbb88fc1c1-kube-api-access-7sgqw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.401868 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.401764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.401868 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.401802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502303 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502442 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502442 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/526bb322-a40c-402f-93b3-42bbb88fc1c1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502442 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502442 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgqw\" (UniqueName: \"kubernetes.io/projected/526bb322-a40c-402f-93b3-42bbb88fc1c1-kube-api-access-7sgqw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502697 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502751 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502731    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502809 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502757    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.502882 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.502864    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.504708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.504678    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/526bb322-a40c-402f-93b3-42bbb88fc1c1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.504869 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.504852    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/526bb322-a40c-402f-93b3-42bbb88fc1c1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.511168 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.511149    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgqw\" (UniqueName: \"kubernetes.io/projected/526bb322-a40c-402f-93b3-42bbb88fc1c1-kube-api-access-7sgqw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf\" (UID: \"526bb322-a40c-402f-93b3-42bbb88fc1c1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.598671 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.598614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:02.735917 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:02.735888    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"]
Jul 07 13:00:02.737000 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:00:02.736972    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526bb322_a40c_402f_93b3_42bbb88fc1c1.slice/crio-2096b6fe1599b5abdb6fba45650edbc6791644a6cf7cd2c17cb2182385fadd9f WatchSource:0}: Error finding container 2096b6fe1599b5abdb6fba45650edbc6791644a6cf7cd2c17cb2182385fadd9f: Status 404 returned error can't find the container with id 2096b6fe1599b5abdb6fba45650edbc6791644a6cf7cd2c17cb2182385fadd9f
Jul 07 13:00:03.645075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:03.645032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf" event={"ID":"526bb322-a40c-402f-93b3-42bbb88fc1c1","Type":"ContainerStarted","Data":"2096b6fe1599b5abdb6fba45650edbc6791644a6cf7cd2c17cb2182385fadd9f"}
Jul 07 13:00:06.663599 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:06.663559    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd" event={"ID":"b3af30d7-5f79-4148-9aea-27be3fbb5c74","Type":"ContainerStarted","Data":"596b11c8c72894314e5f825c274d2596144097d58c95cd993211a84dfd080354"}
Jul 07 13:00:06.686154 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:06.686103    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd" podStartSLOduration=1.411303468 podStartE2EDuration="6.686087322s" totalImagesPullingTime="5.274783854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:00:06.68253628 +0000 UTC m=+694.945712755" watchObservedRunningTime="2026-07-07 13:00:06.686087322 +0000 UTC m=+694.949263794"
Jul 07 13:00:07.670861 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:07.670824    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3af30d7-5f79-4148-9aea-27be3fbb5c74" containerID="596b11c8c72894314e5f825c274d2596144097d58c95cd993211a84dfd080354" exitCode=0
Jul 07 13:00:07.671260 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:07.670908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd" event={"ID":"b3af30d7-5f79-4148-9aea-27be3fbb5c74","Type":"ContainerDied","Data":"596b11c8c72894314e5f825c274d2596144097d58c95cd993211a84dfd080354"}
Jul 07 13:00:08.810068 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:08.810044    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd"
Jul 07 13:00:08.963565 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:08.963455    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq8n9\" (UniqueName: \"kubernetes.io/projected/b3af30d7-5f79-4148-9aea-27be3fbb5c74-kube-api-access-lq8n9\") pod \"b3af30d7-5f79-4148-9aea-27be3fbb5c74\" (UID: \"b3af30d7-5f79-4148-9aea-27be3fbb5c74\") "
Jul 07 13:00:08.965530 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:08.965491    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3af30d7-5f79-4148-9aea-27be3fbb5c74-kube-api-access-lq8n9" (OuterVolumeSpecName: "kube-api-access-lq8n9") pod "b3af30d7-5f79-4148-9aea-27be3fbb5c74" (UID: "b3af30d7-5f79-4148-9aea-27be3fbb5c74"). InnerVolumeSpecName "kube-api-access-lq8n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:00:09.065006 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:09.064983    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq8n9\" (UniqueName: \"kubernetes.io/projected/b3af30d7-5f79-4148-9aea-27be3fbb5c74-kube-api-access-lq8n9\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:00:09.683415 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:09.683381    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd"
Jul 07 13:00:09.683584 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:09.683411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723820-24nzd" event={"ID":"b3af30d7-5f79-4148-9aea-27be3fbb5c74","Type":"ContainerDied","Data":"e37095f3024656c7b55301c16c54a2fed718fcaa059d8fb539b07cd789cdb2d0"}
Jul 07 13:00:09.683584 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:09.683457    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e37095f3024656c7b55301c16c54a2fed718fcaa059d8fb539b07cd789cdb2d0"
Jul 07 13:00:13.704941 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:13.704906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf" event={"ID":"526bb322-a40c-402f-93b3-42bbb88fc1c1","Type":"ContainerStarted","Data":"1007e4e1c05de8f48e2f4f7baf04cc2190f01b170d473b15d8035dd226fcda3c"}
Jul 07 13:00:13.735022 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:13.734962    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf" podStartSLOduration=1.403365532 podStartE2EDuration="11.734943651s" totalImagesPullingTime="10.331578119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:00:13.730731985 +0000 UTC m=+701.993908477" watchObservedRunningTime="2026-07-07 13:00:13.734943651 +0000 UTC m=+701.998120124"
Jul 07 13:00:18.992759 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:18.992723    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"]
Jul 07 13:00:18.993914 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:18.993882    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3af30d7-5f79-4148-9aea-27be3fbb5c74" containerName="cleanup"
Jul 07 13:00:18.993914 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:18.993913    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3af30d7-5f79-4148-9aea-27be3fbb5c74" containerName="cleanup"
Jul 07 13:00:18.994139 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:18.994051    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3af30d7-5f79-4148-9aea-27be3fbb5c74" containerName="cleanup"
Jul 07 13:00:18.996726 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:18.996703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:18.999131 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:18.999112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 13:00:19.007460 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.007438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"]
Jul 07 13:00:19.148564 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.148526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b86821-6c7f-4d40-9fef-10cb9309a21c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.148738 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.148580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.148738 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.148623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.148738 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.148644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8572\" (UniqueName: \"kubernetes.io/projected/00b86821-6c7f-4d40-9fef-10cb9309a21c-kube-api-access-f8572\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.148738 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.148671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.148738 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.148690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.249981 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.249912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b86821-6c7f-4d40-9fef-10cb9309a21c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.249981 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.249962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.250149 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.249992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.250149 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.250095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8572\" (UniqueName: \"kubernetes.io/projected/00b86821-6c7f-4d40-9fef-10cb9309a21c-kube-api-access-f8572\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.250149 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.250125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.250149 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.250147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.250360 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.250331    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.250422 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.250388    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.250592 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.250573    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.252236 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.252217    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00b86821-6c7f-4d40-9fef-10cb9309a21c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.252349 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.252333    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b86821-6c7f-4d40-9fef-10cb9309a21c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.257685 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.257665    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8572\" (UniqueName: \"kubernetes.io/projected/00b86821-6c7f-4d40-9fef-10cb9309a21c-kube-api-access-f8572\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg\" (UID: \"00b86821-6c7f-4d40-9fef-10cb9309a21c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.308693 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.308668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:19.442011 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.441982    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"]
Jul 07 13:00:19.443048 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:00:19.443025    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00b86821_6c7f_4d40_9fef_10cb9309a21c.slice/crio-473eaff89c0b9372e11cede749c63a5e43a5d7a04a96992694723073fe9b1971 WatchSource:0}: Error finding container 473eaff89c0b9372e11cede749c63a5e43a5d7a04a96992694723073fe9b1971: Status 404 returned error can't find the container with id 473eaff89c0b9372e11cede749c63a5e43a5d7a04a96992694723073fe9b1971
Jul 07 13:00:19.744705 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:19.744670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg" event={"ID":"00b86821-6c7f-4d40-9fef-10cb9309a21c","Type":"ContainerStarted","Data":"473eaff89c0b9372e11cede749c63a5e43a5d7a04a96992694723073fe9b1971"}
Jul 07 13:00:22.599666 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:22.599624    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:22.600072 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:22.599714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:22.611765 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:22.611734    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:22.772575 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:22.772546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf"
Jul 07 13:00:51.924499 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:51.924451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg" event={"ID":"00b86821-6c7f-4d40-9fef-10cb9309a21c","Type":"ContainerStarted","Data":"e7aa49f48d7c5ac73b964b4ad64c6517d72e62f9b3e2cd052a06fc8f83e2e1cb"}
Jul 07 13:00:51.943289 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:51.943238    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg" podStartSLOduration=2.209748611 podStartE2EDuration="33.943220598s" totalImagesPullingTime="31.733471987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:00:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:00:51.940793843 +0000 UTC m=+740.203970306" watchObservedRunningTime="2026-07-07 13:00:51.943220598 +0000 UTC m=+740.206397069"
Jul 07 13:00:59.308959 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:59.308915    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:59.308959 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:59.308971    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:59.321882 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:59.321856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:00:59.987043 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:00:59.987014    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg"
Jul 07 13:03:03.639233 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:03.639171    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85587bc48f-k4t2l"]
Jul 07 13:03:03.639894 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:03.639464    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-85587bc48f-k4t2l" podUID="099a1381-67d2-499a-8b9c-21876affd137" containerName="manager" containerID="cri-o://ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769" gracePeriod=30
Jul 07 13:03:03.894782 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:03.894724    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 13:03:03.965154 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:03.965106    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlvjc\" (UniqueName: \"kubernetes.io/projected/099a1381-67d2-499a-8b9c-21876affd137-kube-api-access-rlvjc\") pod \"099a1381-67d2-499a-8b9c-21876affd137\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") "
Jul 07 13:03:03.965306 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:03.965231    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/099a1381-67d2-499a-8b9c-21876affd137-webhook-cert\") pod \"099a1381-67d2-499a-8b9c-21876affd137\" (UID: \"099a1381-67d2-499a-8b9c-21876affd137\") "
Jul 07 13:03:03.967242 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:03.967210    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/099a1381-67d2-499a-8b9c-21876affd137-kube-api-access-rlvjc" (OuterVolumeSpecName: "kube-api-access-rlvjc") pod "099a1381-67d2-499a-8b9c-21876affd137" (UID: "099a1381-67d2-499a-8b9c-21876affd137"). InnerVolumeSpecName "kube-api-access-rlvjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:03:03.967359 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:03.967299    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/099a1381-67d2-499a-8b9c-21876affd137-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "099a1381-67d2-499a-8b9c-21876affd137" (UID: "099a1381-67d2-499a-8b9c-21876affd137"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 13:03:04.066805 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.066776    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/099a1381-67d2-499a-8b9c-21876affd137-webhook-cert\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:03:04.066805 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.066801    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlvjc\" (UniqueName: \"kubernetes.io/projected/099a1381-67d2-499a-8b9c-21876affd137-kube-api-access-rlvjc\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:03:04.675376 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.675341    2580 generic.go:356] "Generic (PLEG): container finished" podID="099a1381-67d2-499a-8b9c-21876affd137" containerID="ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769" exitCode=0
Jul 07 13:03:04.675889 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.675391    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85587bc48f-k4t2l"
Jul 07 13:03:04.675889 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.675401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85587bc48f-k4t2l" event={"ID":"099a1381-67d2-499a-8b9c-21876affd137","Type":"ContainerDied","Data":"ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769"}
Jul 07 13:03:04.675889 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.675438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85587bc48f-k4t2l" event={"ID":"099a1381-67d2-499a-8b9c-21876affd137","Type":"ContainerDied","Data":"b4e958ca26514a1a47b0697b767dfb274a82d2fa9398c984f40ef31a01f86105"}
Jul 07 13:03:04.675889 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.675459    2580 scope.go:117] "RemoveContainer" containerID="ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769"
Jul 07 13:03:04.684909 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.684892    2580 scope.go:117] "RemoveContainer" containerID="ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769"
Jul 07 13:03:04.685175 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:03:04.685157    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769\": container with ID starting with ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769 not found: ID does not exist" containerID="ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769"
Jul 07 13:03:04.685222 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.685185    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769"} err="failed to get container status \"ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769\": rpc error: code = NotFound desc = could not find container \"ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769\": container with ID starting with ba3395f34ded56d5c6f071545ea86c5bd29e5ea9d9271e672426dce09a49a769 not found: ID does not exist"
Jul 07 13:03:04.692389 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.692365    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85587bc48f-k4t2l"]
Jul 07 13:03:04.698095 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:04.698071    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85587bc48f-k4t2l"]
Jul 07 13:03:05.531313 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.531279    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85587bc48f-d4ff5"]
Jul 07 13:03:05.531756 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.531727    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="099a1381-67d2-499a-8b9c-21876affd137" containerName="manager"
Jul 07 13:03:05.531756 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.531746    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="099a1381-67d2-499a-8b9c-21876affd137" containerName="manager"
Jul 07 13:03:05.531969 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.531834    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="099a1381-67d2-499a-8b9c-21876affd137" containerName="manager"
Jul 07 13:03:05.536302 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.536283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.539767 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.539746    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 13:03:05.539875 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.539825    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s9ktv\""
Jul 07 13:03:05.539875 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.539865    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 13:03:05.546838 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.546815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85587bc48f-d4ff5"]
Jul 07 13:03:05.683167 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.683127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/935ef09d-ec16-4b2f-953d-0cf65da2f4dc-webhook-cert\") pod \"maas-controller-85587bc48f-d4ff5\" (UID: \"935ef09d-ec16-4b2f-953d-0cf65da2f4dc\") " pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.683840 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.683814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm9qt\" (UniqueName: \"kubernetes.io/projected/935ef09d-ec16-4b2f-953d-0cf65da2f4dc-kube-api-access-tm9qt\") pod \"maas-controller-85587bc48f-d4ff5\" (UID: \"935ef09d-ec16-4b2f-953d-0cf65da2f4dc\") " pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.785191 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.785101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm9qt\" (UniqueName: \"kubernetes.io/projected/935ef09d-ec16-4b2f-953d-0cf65da2f4dc-kube-api-access-tm9qt\") pod \"maas-controller-85587bc48f-d4ff5\" (UID: \"935ef09d-ec16-4b2f-953d-0cf65da2f4dc\") " pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.785191 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.785158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/935ef09d-ec16-4b2f-953d-0cf65da2f4dc-webhook-cert\") pod \"maas-controller-85587bc48f-d4ff5\" (UID: \"935ef09d-ec16-4b2f-953d-0cf65da2f4dc\") " pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.787543 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.787502    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/935ef09d-ec16-4b2f-953d-0cf65da2f4dc-webhook-cert\") pod \"maas-controller-85587bc48f-d4ff5\" (UID: \"935ef09d-ec16-4b2f-953d-0cf65da2f4dc\") " pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.793828 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.793805    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm9qt\" (UniqueName: \"kubernetes.io/projected/935ef09d-ec16-4b2f-953d-0cf65da2f4dc-kube-api-access-tm9qt\") pod \"maas-controller-85587bc48f-d4ff5\" (UID: \"935ef09d-ec16-4b2f-953d-0cf65da2f4dc\") " pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.846836 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.846808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:05.985105 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:05.985074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85587bc48f-d4ff5"]
Jul 07 13:03:05.985986 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:03:05.985953    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935ef09d_ec16_4b2f_953d_0cf65da2f4dc.slice/crio-b884edf5b01dffc7d73463292178c217e83beff4cc48992021396a18eb644772 WatchSource:0}: Error finding container b884edf5b01dffc7d73463292178c217e83beff4cc48992021396a18eb644772: Status 404 returned error can't find the container with id b884edf5b01dffc7d73463292178c217e83beff4cc48992021396a18eb644772
Jul 07 13:03:06.173397 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:06.173362    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="099a1381-67d2-499a-8b9c-21876affd137" path="/var/lib/kubelet/pods/099a1381-67d2-499a-8b9c-21876affd137/volumes"
Jul 07 13:03:06.690977 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:06.690942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85587bc48f-d4ff5" event={"ID":"935ef09d-ec16-4b2f-953d-0cf65da2f4dc","Type":"ContainerStarted","Data":"acecfa96f9cd3dbf237241ad83cdc676126f46021636bc0e84350a2f841b7d11"}
Jul 07 13:03:06.691416 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:06.691000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85587bc48f-d4ff5" event={"ID":"935ef09d-ec16-4b2f-953d-0cf65da2f4dc","Type":"ContainerStarted","Data":"b884edf5b01dffc7d73463292178c217e83beff4cc48992021396a18eb644772"}
Jul 07 13:03:06.691416 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:06.691161    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:03:06.713420 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:06.713333    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85587bc48f-d4ff5" podStartSLOduration=1.250436837 podStartE2EDuration="1.713319784s" totalImagesPullingTime="462.882947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:03:06.711470095 +0000 UTC m=+874.974646567" watchObservedRunningTime="2026-07-07 13:03:06.713319784 +0000 UTC m=+874.976496256"
Jul 07 13:03:17.704213 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:03:17.704175    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85587bc48f-d4ff5"
Jul 07 13:07:55.411381 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:55.411297    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"]
Jul 07 13:07:55.411948 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:55.411559    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth" podUID="c49ced59-7db5-4c60-8c75-71715f96480b" containerName="manager" containerID="cri-o://f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1" gracePeriod=10
Jul 07 13:07:59.164368 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.164343    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 13:07:59.262234 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.262196    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztj5f\" (UniqueName: \"kubernetes.io/projected/c49ced59-7db5-4c60-8c75-71715f96480b-kube-api-access-ztj5f\") pod \"c49ced59-7db5-4c60-8c75-71715f96480b\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") "
Jul 07 13:07:59.262406 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.262287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c49ced59-7db5-4c60-8c75-71715f96480b-extensions-socket-volume\") pod \"c49ced59-7db5-4c60-8c75-71715f96480b\" (UID: \"c49ced59-7db5-4c60-8c75-71715f96480b\") "
Jul 07 13:07:59.262708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.262688    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c49ced59-7db5-4c60-8c75-71715f96480b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c49ced59-7db5-4c60-8c75-71715f96480b" (UID: "c49ced59-7db5-4c60-8c75-71715f96480b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:07:59.264445 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.264421    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49ced59-7db5-4c60-8c75-71715f96480b-kube-api-access-ztj5f" (OuterVolumeSpecName: "kube-api-access-ztj5f") pod "c49ced59-7db5-4c60-8c75-71715f96480b" (UID: "c49ced59-7db5-4c60-8c75-71715f96480b"). InnerVolumeSpecName "kube-api-access-ztj5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:07:59.340346 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.340263    2580 generic.go:356] "Generic (PLEG): container finished" podID="c49ced59-7db5-4c60-8c75-71715f96480b" containerID="f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1" exitCode=0
Jul 07 13:07:59.340346 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.340304    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"
Jul 07 13:07:59.340346 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.340325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth" event={"ID":"c49ced59-7db5-4c60-8c75-71715f96480b","Type":"ContainerDied","Data":"f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1"}
Jul 07 13:07:59.340634 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.340379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth" event={"ID":"c49ced59-7db5-4c60-8c75-71715f96480b","Type":"ContainerDied","Data":"1e40567244ac11d07e803abfdfba690d95a0a67907705891185a3a65bdc61700"}
Jul 07 13:07:59.340634 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.340409    2580 scope.go:117] "RemoveContainer" containerID="f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1"
Jul 07 13:07:59.350278 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.350259    2580 scope.go:117] "RemoveContainer" containerID="f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1"
Jul 07 13:07:59.350549 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:07:59.350488    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1\": container with ID starting with f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1 not found: ID does not exist" containerID="f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1"
Jul 07 13:07:59.350610 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.350550    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1"} err="failed to get container status \"f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1\": rpc error: code = NotFound desc = could not find container \"f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1\": container with ID starting with f44c597bbf9facb9a92516a010e80a7a1c5560c9d2318592ae6726f97c3145a1 not found: ID does not exist"
Jul 07 13:07:59.364219 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.364192    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztj5f\" (UniqueName: \"kubernetes.io/projected/c49ced59-7db5-4c60-8c75-71715f96480b-kube-api-access-ztj5f\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:07:59.364400 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.364382    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c49ced59-7db5-4c60-8c75-71715f96480b-extensions-socket-volume\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:07:59.368581 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.368554    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"]
Jul 07 13:07:59.370391 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:07:59.370367    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6nth"]
Jul 07 13:08:00.172880 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:00.172842    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c49ced59-7db5-4c60-8c75-71715f96480b" path="/var/lib/kubelet/pods/c49ced59-7db5-4c60-8c75-71715f96480b/volumes"
Jul 07 13:08:56.609822 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.609787    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"]
Jul 07 13:08:56.610268 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.610170    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49ced59-7db5-4c60-8c75-71715f96480b" containerName="manager"
Jul 07 13:08:56.610268 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.610181    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49ced59-7db5-4c60-8c75-71715f96480b" containerName="manager"
Jul 07 13:08:56.610268 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.610251    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c49ced59-7db5-4c60-8c75-71715f96480b" containerName="manager"
Jul 07 13:08:56.614477 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.614460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:56.617183 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.617163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x7f7q\""
Jul 07 13:08:56.626672 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.626650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"]
Jul 07 13:08:56.653023 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.652988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfa2367-0675-48ed-86c1-298429dd4cdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q5m4d\" (UID: \"4bfa2367-0675-48ed-86c1-298429dd4cdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:56.653159 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.653087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w84v9\" (UniqueName: \"kubernetes.io/projected/4bfa2367-0675-48ed-86c1-298429dd4cdc-kube-api-access-w84v9\") pod \"kuadrant-operator-controller-manager-86878c769f-q5m4d\" (UID: \"4bfa2367-0675-48ed-86c1-298429dd4cdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:56.754415 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.754390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfa2367-0675-48ed-86c1-298429dd4cdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q5m4d\" (UID: \"4bfa2367-0675-48ed-86c1-298429dd4cdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:56.754567 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.754442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w84v9\" (UniqueName: \"kubernetes.io/projected/4bfa2367-0675-48ed-86c1-298429dd4cdc-kube-api-access-w84v9\") pod \"kuadrant-operator-controller-manager-86878c769f-q5m4d\" (UID: \"4bfa2367-0675-48ed-86c1-298429dd4cdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:56.754775 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.754757    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bfa2367-0675-48ed-86c1-298429dd4cdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q5m4d\" (UID: \"4bfa2367-0675-48ed-86c1-298429dd4cdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:56.772051 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.772030    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w84v9\" (UniqueName: \"kubernetes.io/projected/4bfa2367-0675-48ed-86c1-298429dd4cdc-kube-api-access-w84v9\") pod \"kuadrant-operator-controller-manager-86878c769f-q5m4d\" (UID: \"4bfa2367-0675-48ed-86c1-298429dd4cdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:56.925261 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:56.925238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:57.068125 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:57.068100    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"]
Jul 07 13:08:57.069852 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:08:57.069823    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfa2367_0675_48ed_86c1_298429dd4cdc.slice/crio-2ada0707402d4e5449dd271a09f7a5617fc9d9dff54ec39802924282c02037bd WatchSource:0}: Error finding container 2ada0707402d4e5449dd271a09f7a5617fc9d9dff54ec39802924282c02037bd: Status 404 returned error can't find the container with id 2ada0707402d4e5449dd271a09f7a5617fc9d9dff54ec39802924282c02037bd
Jul 07 13:08:57.652736 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:57.652705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d" event={"ID":"4bfa2367-0675-48ed-86c1-298429dd4cdc","Type":"ContainerStarted","Data":"775ed9973e12e87f846093e2c041058494741cd65b9fd502c4faf482e4322078"}
Jul 07 13:08:57.653124 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:57.652756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d" event={"ID":"4bfa2367-0675-48ed-86c1-298429dd4cdc","Type":"ContainerStarted","Data":"2ada0707402d4e5449dd271a09f7a5617fc9d9dff54ec39802924282c02037bd"}
Jul 07 13:08:57.653124 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:57.652820    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:08:57.733483 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:08:57.733433    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d" podStartSLOduration=1.733417513 podStartE2EDuration="1.733417513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:08:57.730721045 +0000 UTC m=+1225.993897520" watchObservedRunningTime="2026-07-07 13:08:57.733417513 +0000 UTC m=+1225.996593984"
Jul 07 13:09:08.660168 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:09:08.660134    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q5m4d"
Jul 07 13:18:15.092642 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.092613    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"]
Jul 07 13:18:15.096108 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.096088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.099823 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.099797    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9638b7d0\"/\"kube-root-ca.crt\""
Jul 07 13:18:15.099949 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.099821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9638b7d0\"/\"openshift-service-ca.crt\""
Jul 07 13:18:15.099949 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.099798    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9638b7d0\"/\"default-dockercfg-kzs2k\""
Jul 07 13:18:15.099949 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.099853    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9638b7d0\"/\"e2e-lifecycle-model-9638b7d0-kserve-self-signed-certs\""
Jul 07 13:18:15.108531 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.108493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"]
Jul 07 13:18:15.162616 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.162587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-dshm\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.162740 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.162626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72p5x\" (UniqueName: \"kubernetes.io/projected/bb2ccad2-1d41-4985-b33b-b41831693d94-kube-api-access-72p5x\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.162740 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.162706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-home\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.162824 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.162780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-tmp-dir\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.162824 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.162805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2ccad2-1d41-4985-b33b-b41831693d94-tls-certs\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.162894 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.162825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-model-cache\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.263889 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.263856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-tmp-dir\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264059 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.263900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2ccad2-1d41-4985-b33b-b41831693d94-tls-certs\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264059 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.263931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-model-cache\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264059 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.263968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-dshm\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264059 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.264003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72p5x\" (UniqueName: \"kubernetes.io/projected/bb2ccad2-1d41-4985-b33b-b41831693d94-kube-api-access-72p5x\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264287 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.264064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-home\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264427 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.264403    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-model-cache\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264573 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.264552    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-tmp-dir\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.264629 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.264607    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-home\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.266421 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.266396    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-dshm\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.266727 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.266712    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2ccad2-1d41-4985-b33b-b41831693d94-tls-certs\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.271885 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.271861    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72p5x\" (UniqueName: \"kubernetes.io/projected/bb2ccad2-1d41-4985-b33b-b41831693d94-kube-api-access-72p5x\") pod \"e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") " pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.406183 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.406157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:15.551816 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.551791    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"]
Jul 07 13:18:15.554016 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:18:15.553985    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb2ccad2_1d41_4985_b33b_b41831693d94.slice/crio-043c615dcff2408a57e25d7959fcbc0bd19f38aa02129987f4ee81e92f8cca35 WatchSource:0}: Error finding container 043c615dcff2408a57e25d7959fcbc0bd19f38aa02129987f4ee81e92f8cca35: Status 404 returned error can't find the container with id 043c615dcff2408a57e25d7959fcbc0bd19f38aa02129987f4ee81e92f8cca35
Jul 07 13:18:15.741169 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.741086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp" event={"ID":"bb2ccad2-1d41-4985-b33b-b41831693d94","Type":"ContainerStarted","Data":"d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26"}
Jul 07 13:18:15.741169 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.741135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp" event={"ID":"bb2ccad2-1d41-4985-b33b-b41831693d94","Type":"ContainerStarted","Data":"043c615dcff2408a57e25d7959fcbc0bd19f38aa02129987f4ee81e92f8cca35"}
Jul 07 13:18:15.767868 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:15.767824    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp" podStartSLOduration=0.767810008 podStartE2EDuration="767.810008ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:18:15.7656796 +0000 UTC m=+1784.028856072" watchObservedRunningTime="2026-07-07 13:18:15.767810008 +0000 UTC m=+1784.030986479"
Jul 07 13:18:25.407063 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:25.406974    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:25.407431 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:25.407061    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:25.419445 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:25.419423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:25.808438 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:25.808356    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:44.696397 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:44.696365    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"]
Jul 07 13:18:59.717600 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:59.717561    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp" podUID="bb2ccad2-1d41-4985-b33b-b41831693d94" containerName="main" containerID="cri-o://d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26" gracePeriod=45
Jul 07 13:18:59.971726 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:59.971654    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:59.997312 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:59.997277    2580 generic.go:356] "Generic (PLEG): container finished" podID="bb2ccad2-1d41-4985-b33b-b41831693d94" containerID="d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26" exitCode=0
Jul 07 13:18:59.997458 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:59.997337    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"
Jul 07 13:18:59.997458 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:59.997344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp" event={"ID":"bb2ccad2-1d41-4985-b33b-b41831693d94","Type":"ContainerDied","Data":"d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26"}
Jul 07 13:18:59.997458 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:59.997407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp" event={"ID":"bb2ccad2-1d41-4985-b33b-b41831693d94","Type":"ContainerDied","Data":"043c615dcff2408a57e25d7959fcbc0bd19f38aa02129987f4ee81e92f8cca35"}
Jul 07 13:18:59.997458 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:18:59.997431    2580 scope.go:117] "RemoveContainer" containerID="d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26"
Jul 07 13:19:00.009613 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.009586    2580 scope.go:117] "RemoveContainer" containerID="d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26"
Jul 07 13:19:00.009920 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:19:00.009897    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26\": container with ID starting with d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26 not found: ID does not exist" containerID="d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26"
Jul 07 13:19:00.010005 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.009934    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26"} err="failed to get container status \"d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26\": rpc error: code = NotFound desc = could not find container \"d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26\": container with ID starting with d1edcc16f5c728b719d5e826a23e787fbb031e7f7085f84f1bf97572b27c6b26 not found: ID does not exist"
Jul 07 13:19:00.069620 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069590    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-home\") pod \"bb2ccad2-1d41-4985-b33b-b41831693d94\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") "
Jul 07 13:19:00.069773 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069649    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72p5x\" (UniqueName: \"kubernetes.io/projected/bb2ccad2-1d41-4985-b33b-b41831693d94-kube-api-access-72p5x\") pod \"bb2ccad2-1d41-4985-b33b-b41831693d94\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") "
Jul 07 13:19:00.069773 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-tmp-dir\") pod \"bb2ccad2-1d41-4985-b33b-b41831693d94\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") "
Jul 07 13:19:00.069773 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069699    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-dshm\") pod \"bb2ccad2-1d41-4985-b33b-b41831693d94\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") "
Jul 07 13:19:00.069908 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069774    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-model-cache\") pod \"bb2ccad2-1d41-4985-b33b-b41831693d94\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") "
Jul 07 13:19:00.069908 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2ccad2-1d41-4985-b33b-b41831693d94-tls-certs\") pod \"bb2ccad2-1d41-4985-b33b-b41831693d94\" (UID: \"bb2ccad2-1d41-4985-b33b-b41831693d94\") "
Jul 07 13:19:00.069908 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069849    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-home" (OuterVolumeSpecName: "home") pod "bb2ccad2-1d41-4985-b33b-b41831693d94" (UID: "bb2ccad2-1d41-4985-b33b-b41831693d94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:19:00.070073 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.069968    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb2ccad2-1d41-4985-b33b-b41831693d94" (UID: "bb2ccad2-1d41-4985-b33b-b41831693d94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:19:00.070073 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.070044    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb2ccad2-1d41-4985-b33b-b41831693d94" (UID: "bb2ccad2-1d41-4985-b33b-b41831693d94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:19:00.070196 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.070142    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-model-cache\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:19:00.070196 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.070159    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-home\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:19:00.070196 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.070172    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-tmp-dir\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:19:00.071936 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.071912    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-dshm" (OuterVolumeSpecName: "dshm") pod "bb2ccad2-1d41-4985-b33b-b41831693d94" (UID: "bb2ccad2-1d41-4985-b33b-b41831693d94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:19:00.072006 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.071931    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2ccad2-1d41-4985-b33b-b41831693d94-kube-api-access-72p5x" (OuterVolumeSpecName: "kube-api-access-72p5x") pod "bb2ccad2-1d41-4985-b33b-b41831693d94" (UID: "bb2ccad2-1d41-4985-b33b-b41831693d94"). InnerVolumeSpecName "kube-api-access-72p5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:19:00.072006 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.071942    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb2ccad2-1d41-4985-b33b-b41831693d94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb2ccad2-1d41-4985-b33b-b41831693d94" (UID: "bb2ccad2-1d41-4985-b33b-b41831693d94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 13:19:00.170744 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.170721    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72p5x\" (UniqueName: \"kubernetes.io/projected/bb2ccad2-1d41-4985-b33b-b41831693d94-kube-api-access-72p5x\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:19:00.170744 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.170741    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2ccad2-1d41-4985-b33b-b41831693d94-dshm\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:19:00.170891 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.170752    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2ccad2-1d41-4985-b33b-b41831693d94-tls-certs\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:19:00.317227 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.317159    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"]
Jul 07 13:19:00.322807 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:00.322784    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9638b7d0/e2e-lifecycle-model-9638b7d0-kserve-5bbff4f4c9-6grjp"]
Jul 07 13:19:02.172896 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:19:02.172858    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2ccad2-1d41-4985-b33b-b41831693d94" path="/var/lib/kubelet/pods/bb2ccad2-1d41-4985-b33b-b41831693d94/volumes"
Jul 07 13:20:58.822698 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.822667    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"]
Jul 07 13:20:58.823301 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.823282    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2ccad2-1d41-4985-b33b-b41831693d94" containerName="main"
Jul 07 13:20:58.823386 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.823306    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2ccad2-1d41-4985-b33b-b41831693d94" containerName="main"
Jul 07 13:20:58.823460 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.823448    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2ccad2-1d41-4985-b33b-b41831693d94" containerName="main"
Jul 07 13:20:58.826558 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.826536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.832689 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.832655    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ba2ec\"/\"default-dockercfg-gbg9k\""
Jul 07 13:20:58.832831 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.832749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ba2ec\"/\"test-model-5ba2ec-kserve-self-signed-certs\""
Jul 07 13:20:58.832831 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.832655    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ba2ec\"/\"openshift-service-ca.crt\""
Jul 07 13:20:58.833006 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.832895    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ba2ec\"/\"kube-root-ca.crt\""
Jul 07 13:20:58.841692 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.841673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"]
Jul 07 13:20:58.851562 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.851541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l66n5\" (UniqueName: \"kubernetes.io/projected/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-kube-api-access-l66n5\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.851669 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.851574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-dshm\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.851669 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.851614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tmp-dir\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.851784 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.851687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-home\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.851784 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.851727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tls-certs\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.851784 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.851777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-model-cache\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.952683 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.952634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tmp-dir\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.952865 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.952709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-home\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.952865 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.952742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tls-certs\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.952865 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.952783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-model-cache\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.952865 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.952857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l66n5\" (UniqueName: \"kubernetes.io/projected/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-kube-api-access-l66n5\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.953088 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.952890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-dshm\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.953088 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.953055    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tmp-dir\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.953212 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.953096    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-home\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.953212 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.953126    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-model-cache\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.955019 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.954996    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-dshm\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.955359 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.955312    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tls-certs\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:58.961410 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:58.961390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l66n5\" (UniqueName: \"kubernetes.io/projected/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-kube-api-access-l66n5\") pod \"test-model-5ba2ec-kserve-7b8c7f58f7-7wv96\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") " pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:59.138730 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:59.138690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:20:59.293568 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:59.293537    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"]
Jul 07 13:20:59.295434 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:20:59.295403    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32ff4f45_f157_41f5_8de6_5ff6c40eccf6.slice/crio-206615f6d5a70edeba0aea68f6d8e4046daee9d26cfc83821a7f3f0690eec13e WatchSource:0}: Error finding container 206615f6d5a70edeba0aea68f6d8e4046daee9d26cfc83821a7f3f0690eec13e: Status 404 returned error can't find the container with id 206615f6d5a70edeba0aea68f6d8e4046daee9d26cfc83821a7f3f0690eec13e
Jul 07 13:20:59.675462 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:59.675424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96" event={"ID":"32ff4f45-f157-41f5-8de6-5ff6c40eccf6","Type":"ContainerStarted","Data":"197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39"}
Jul 07 13:20:59.675462 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:59.675471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96" event={"ID":"32ff4f45-f157-41f5-8de6-5ff6c40eccf6","Type":"ContainerStarted","Data":"206615f6d5a70edeba0aea68f6d8e4046daee9d26cfc83821a7f3f0690eec13e"}
Jul 07 13:20:59.693846 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:20:59.693791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96" podStartSLOduration=1.693775473 podStartE2EDuration="1.693775473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:20:59.691608727 +0000 UTC m=+1947.954785200" watchObservedRunningTime="2026-07-07 13:20:59.693775473 +0000 UTC m=+1947.956951974"
Jul 07 13:21:09.139822 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:09.139783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:21:09.140248 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:09.139841    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:21:09.152224 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:09.152200    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:21:09.743226 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:09.743198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:21:25.207214 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.207134    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"]
Jul 07 13:21:25.212469 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.212436    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.217732 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.217708    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-256cc6\"/\"openshift-service-ca.crt\""
Jul 07 13:21:25.217875 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.217731    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-256cc6\"/\"test-model-256cc6-kserve-self-signed-certs\""
Jul 07 13:21:25.217875 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.217757    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-256cc6\"/\"kube-root-ca.crt\""
Jul 07 13:21:25.220743 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.220722    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-256cc6\"/\"default-dockercfg-ncmcs\""
Jul 07 13:21:25.249211 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.249178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"]
Jul 07 13:21:25.288662 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.288631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8qzl\" (UniqueName: \"kubernetes.io/projected/3cfc1948-6608-44c7-91b2-f4a8600b3797-kube-api-access-j8qzl\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.288813 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.288685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-tmp-dir\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.288813 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.288765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-model-cache\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.288813 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.288795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-dshm\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.288930 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.288891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-home\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.288968 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.288954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cfc1948-6608-44c7-91b2-f4a8600b3797-tls-certs\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.389641 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.389607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-home\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.389793 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.389648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cfc1948-6608-44c7-91b2-f4a8600b3797-tls-certs\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.389793 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.389772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8qzl\" (UniqueName: \"kubernetes.io/projected/3cfc1948-6608-44c7-91b2-f4a8600b3797-kube-api-access-j8qzl\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.389877 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.389836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-tmp-dir\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.389929 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.389894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-model-cache\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.389929 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.389922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-dshm\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.390034 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.389991    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-home\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.390206 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.390185    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-tmp-dir\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.390282 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.390212    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-model-cache\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.392001 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.391967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-dshm\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.392156 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.392141    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cfc1948-6608-44c7-91b2-f4a8600b3797-tls-certs\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.398524 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.398487    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8qzl\" (UniqueName: \"kubernetes.io/projected/3cfc1948-6608-44c7-91b2-f4a8600b3797-kube-api-access-j8qzl\") pod \"test-model-256cc6-kserve-595784b64c-r7jtf\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") " pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.523572 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.523471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:25.664260 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.664226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"]
Jul 07 13:21:25.665499 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:21:25.665462    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cfc1948_6608_44c7_91b2_f4a8600b3797.slice/crio-0de3804af68d07a44d47ce96158809190191ba1672afa0093862777a8e598cd7 WatchSource:0}: Error finding container 0de3804af68d07a44d47ce96158809190191ba1672afa0093862777a8e598cd7: Status 404 returned error can't find the container with id 0de3804af68d07a44d47ce96158809190191ba1672afa0093862777a8e598cd7
Jul 07 13:21:25.833782 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.833698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf" event={"ID":"3cfc1948-6608-44c7-91b2-f4a8600b3797","Type":"ContainerStarted","Data":"57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623"}
Jul 07 13:21:25.833782 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.833743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf" event={"ID":"3cfc1948-6608-44c7-91b2-f4a8600b3797","Type":"ContainerStarted","Data":"0de3804af68d07a44d47ce96158809190191ba1672afa0093862777a8e598cd7"}
Jul 07 13:21:25.855808 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:25.855762    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf" podStartSLOduration=0.855746847 podStartE2EDuration="855.746847ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:21:25.853346927 +0000 UTC m=+1974.116523400" watchObservedRunningTime="2026-07-07 13:21:25.855746847 +0000 UTC m=+1974.118923319"
Jul 07 13:21:35.524610 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:35.524568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:35.525211 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:35.524623    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:35.539067 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:35.539043    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:35.907435 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:35.907407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:43.650096 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:43.650061    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"]
Jul 07 13:21:44.531545 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:44.531455    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"]
Jul 07 13:21:58.670831 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:58.670771    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96" podUID="32ff4f45-f157-41f5-8de6-5ff6c40eccf6" containerName="main" containerID="cri-o://197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39" gracePeriod=45
Jul 07 13:21:58.919984 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:58.919959    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:21:59.003426 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tmp-dir\") pod \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") "
Jul 07 13:21:59.003426 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-home\") pod \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") "
Jul 07 13:21:59.003426 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tls-certs\") pod \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") "
Jul 07 13:21:59.003708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-model-cache\") pod \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") "
Jul 07 13:21:59.003708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-dshm\") pod \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") "
Jul 07 13:21:59.003708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003584    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l66n5\" (UniqueName: \"kubernetes.io/projected/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-kube-api-access-l66n5\") pod \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\" (UID: \"32ff4f45-f157-41f5-8de6-5ff6c40eccf6\") "
Jul 07 13:21:59.003708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003687    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32ff4f45-f157-41f5-8de6-5ff6c40eccf6" (UID: "32ff4f45-f157-41f5-8de6-5ff6c40eccf6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.003918 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003710    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-home" (OuterVolumeSpecName: "home") pod "32ff4f45-f157-41f5-8de6-5ff6c40eccf6" (UID: "32ff4f45-f157-41f5-8de6-5ff6c40eccf6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.003918 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003728    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-model-cache" (OuterVolumeSpecName: "model-cache") pod "32ff4f45-f157-41f5-8de6-5ff6c40eccf6" (UID: "32ff4f45-f157-41f5-8de6-5ff6c40eccf6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.003993 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003963    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tmp-dir\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.003993 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003979    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-home\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.004065 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.003992    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-model-cache\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.005816 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.005793    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-dshm" (OuterVolumeSpecName: "dshm") pod "32ff4f45-f157-41f5-8de6-5ff6c40eccf6" (UID: "32ff4f45-f157-41f5-8de6-5ff6c40eccf6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.005816 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.005802    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32ff4f45-f157-41f5-8de6-5ff6c40eccf6" (UID: "32ff4f45-f157-41f5-8de6-5ff6c40eccf6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 13:21:59.005933 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.005827    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-kube-api-access-l66n5" (OuterVolumeSpecName: "kube-api-access-l66n5") pod "32ff4f45-f157-41f5-8de6-5ff6c40eccf6" (UID: "32ff4f45-f157-41f5-8de6-5ff6c40eccf6"). InnerVolumeSpecName "kube-api-access-l66n5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:21:59.031098 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.031068    2580 generic.go:356] "Generic (PLEG): container finished" podID="32ff4f45-f157-41f5-8de6-5ff6c40eccf6" containerID="197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39" exitCode=0
Jul 07 13:21:59.031223 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.031107    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"
Jul 07 13:21:59.031223 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.031155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96" event={"ID":"32ff4f45-f157-41f5-8de6-5ff6c40eccf6","Type":"ContainerDied","Data":"197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39"}
Jul 07 13:21:59.031223 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.031203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96" event={"ID":"32ff4f45-f157-41f5-8de6-5ff6c40eccf6","Type":"ContainerDied","Data":"206615f6d5a70edeba0aea68f6d8e4046daee9d26cfc83821a7f3f0690eec13e"}
Jul 07 13:21:59.031391 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.031226    2580 scope.go:117] "RemoveContainer" containerID="197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39"
Jul 07 13:21:59.040804 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.040786    2580 scope.go:117] "RemoveContainer" containerID="197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39"
Jul 07 13:21:59.041044 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:21:59.041026    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39\": container with ID starting with 197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39 not found: ID does not exist" containerID="197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39"
Jul 07 13:21:59.041092 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.041053    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39"} err="failed to get container status \"197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39\": rpc error: code = NotFound desc = could not find container \"197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39\": container with ID starting with 197ef7648b49d62100cc5d99780220be453bafd4716cdb880937772898243b39 not found: ID does not exist"
Jul 07 13:21:59.053739 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.053718    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"]
Jul 07 13:21:59.058744 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.058724    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-5ba2ec/test-model-5ba2ec-kserve-7b8c7f58f7-7wv96"]
Jul 07 13:21:59.104834 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.104810    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l66n5\" (UniqueName: \"kubernetes.io/projected/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-kube-api-access-l66n5\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.104834 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.104832    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-tls-certs\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.104950 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.104843    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4f45-f157-41f5-8de6-5ff6c40eccf6-dshm\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.553318 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.553266    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf" podUID="3cfc1948-6608-44c7-91b2-f4a8600b3797" containerName="main" containerID="cri-o://57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623" gracePeriod=45
Jul 07 13:21:59.813210 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.813155    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:21:59.912255 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8qzl\" (UniqueName: \"kubernetes.io/projected/3cfc1948-6608-44c7-91b2-f4a8600b3797-kube-api-access-j8qzl\") pod \"3cfc1948-6608-44c7-91b2-f4a8600b3797\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") "
Jul 07 13:21:59.912400 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912288    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-home\") pod \"3cfc1948-6608-44c7-91b2-f4a8600b3797\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") "
Jul 07 13:21:59.912442 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912392    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-tmp-dir\") pod \"3cfc1948-6608-44c7-91b2-f4a8600b3797\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") "
Jul 07 13:21:59.912475 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912456    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-dshm\") pod \"3cfc1948-6608-44c7-91b2-f4a8600b3797\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") "
Jul 07 13:21:59.912532 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912483    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-model-cache\") pod \"3cfc1948-6608-44c7-91b2-f4a8600b3797\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") "
Jul 07 13:21:59.912532 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912525    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cfc1948-6608-44c7-91b2-f4a8600b3797-tls-certs\") pod \"3cfc1948-6608-44c7-91b2-f4a8600b3797\" (UID: \"3cfc1948-6608-44c7-91b2-f4a8600b3797\") "
Jul 07 13:21:59.912635 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912541    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-home" (OuterVolumeSpecName: "home") pod "3cfc1948-6608-44c7-91b2-f4a8600b3797" (UID: "3cfc1948-6608-44c7-91b2-f4a8600b3797"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.912731 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912684    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3cfc1948-6608-44c7-91b2-f4a8600b3797" (UID: "3cfc1948-6608-44c7-91b2-f4a8600b3797"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.912800 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912740    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-model-cache" (OuterVolumeSpecName: "model-cache") pod "3cfc1948-6608-44c7-91b2-f4a8600b3797" (UID: "3cfc1948-6608-44c7-91b2-f4a8600b3797"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.912893 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912875    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-model-cache\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.912950 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912894    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-home\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.912950 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.912903    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-tmp-dir\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:21:59.914470 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.914449    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cfc1948-6608-44c7-91b2-f4a8600b3797-kube-api-access-j8qzl" (OuterVolumeSpecName: "kube-api-access-j8qzl") pod "3cfc1948-6608-44c7-91b2-f4a8600b3797" (UID: "3cfc1948-6608-44c7-91b2-f4a8600b3797"). InnerVolumeSpecName "kube-api-access-j8qzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:21:59.914572 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.914484    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-dshm" (OuterVolumeSpecName: "dshm") pod "3cfc1948-6608-44c7-91b2-f4a8600b3797" (UID: "3cfc1948-6608-44c7-91b2-f4a8600b3797"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:21:59.914633 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:21:59.914620    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cfc1948-6608-44c7-91b2-f4a8600b3797-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3cfc1948-6608-44c7-91b2-f4a8600b3797" (UID: "3cfc1948-6608-44c7-91b2-f4a8600b3797"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 13:22:00.013894 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.013862    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8qzl\" (UniqueName: \"kubernetes.io/projected/3cfc1948-6608-44c7-91b2-f4a8600b3797-kube-api-access-j8qzl\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:22:00.013894 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.013892    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cfc1948-6608-44c7-91b2-f4a8600b3797-dshm\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:22:00.013894 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.013901    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cfc1948-6608-44c7-91b2-f4a8600b3797-tls-certs\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:22:00.038610 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.038579    2580 generic.go:356] "Generic (PLEG): container finished" podID="3cfc1948-6608-44c7-91b2-f4a8600b3797" containerID="57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623" exitCode=0
Jul 07 13:22:00.038766 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.038624    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"
Jul 07 13:22:00.038766 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.038670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf" event={"ID":"3cfc1948-6608-44c7-91b2-f4a8600b3797","Type":"ContainerDied","Data":"57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623"}
Jul 07 13:22:00.038766 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.038711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf" event={"ID":"3cfc1948-6608-44c7-91b2-f4a8600b3797","Type":"ContainerDied","Data":"0de3804af68d07a44d47ce96158809190191ba1672afa0093862777a8e598cd7"}
Jul 07 13:22:00.038766 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.038727    2580 scope.go:117] "RemoveContainer" containerID="57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623"
Jul 07 13:22:00.048519 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.048489    2580 scope.go:117] "RemoveContainer" containerID="57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623"
Jul 07 13:22:00.048789 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:22:00.048767    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623\": container with ID starting with 57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623 not found: ID does not exist" containerID="57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623"
Jul 07 13:22:00.048854 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.048811    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623"} err="failed to get container status \"57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623\": rpc error: code = NotFound desc = could not find container \"57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623\": container with ID starting with 57ec5b0d6d1523391d6f124fc2bfc294f371c42ec475abd76e2256b4377e8623 not found: ID does not exist"
Jul 07 13:22:00.060036 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.060014    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"]
Jul 07 13:22:00.064001 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.063951    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-256cc6/test-model-256cc6-kserve-595784b64c-r7jtf"]
Jul 07 13:22:00.173020 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.172992    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ff4f45-f157-41f5-8de6-5ff6c40eccf6" path="/var/lib/kubelet/pods/32ff4f45-f157-41f5-8de6-5ff6c40eccf6/volumes"
Jul 07 13:22:00.173389 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:22:00.173376    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cfc1948-6608-44c7-91b2-f4a8600b3797" path="/var/lib/kubelet/pods/3cfc1948-6608-44c7-91b2-f4a8600b3797/volumes"
Jul 07 13:23:46.698544 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.698492    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"]
Jul 07 13:23:46.699075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.698909    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ff4f45-f157-41f5-8de6-5ff6c40eccf6" containerName="main"
Jul 07 13:23:46.699075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.698921    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ff4f45-f157-41f5-8de6-5ff6c40eccf6" containerName="main"
Jul 07 13:23:46.699075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.698941    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cfc1948-6608-44c7-91b2-f4a8600b3797" containerName="main"
Jul 07 13:23:46.699075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.698947    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfc1948-6608-44c7-91b2-f4a8600b3797" containerName="main"
Jul 07 13:23:46.699075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.699012    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cfc1948-6608-44c7-91b2-f4a8600b3797" containerName="main"
Jul 07 13:23:46.699075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.699023    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32ff4f45-f157-41f5-8de6-5ff6c40eccf6" containerName="main"
Jul 07 13:23:46.702150 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.702127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.704889 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.704870    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-951cca\"/\"default-dockercfg-7fh7f\""
Jul 07 13:23:46.705437 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.705418    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-951cca\"/\"kube-root-ca.crt\""
Jul 07 13:23:46.705730 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.705707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-951cca\"/\"auth-test-model-951cca-kserve-self-signed-certs\""
Jul 07 13:23:46.705843 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.705763    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-951cca\"/\"openshift-service-ca.crt\""
Jul 07 13:23:46.719537 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.719486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"]
Jul 07 13:23:46.790626 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.790594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc3be949-7259-4d65-9a74-99230df9149f-tls-certs\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.790626 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.790627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-home\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.790806 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.790659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-tmp-dir\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.790806 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.790743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqgr\" (UniqueName: \"kubernetes.io/projected/dc3be949-7259-4d65-9a74-99230df9149f-kube-api-access-fgqgr\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.790806 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.790786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-model-cache\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.790909 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.790819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-dshm\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892081 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-model-cache\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892081 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-dshm\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892279 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc3be949-7259-4d65-9a74-99230df9149f-tls-certs\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892279 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-home\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892364 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-tmp-dir\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892421 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqgr\" (UniqueName: \"kubernetes.io/projected/dc3be949-7259-4d65-9a74-99230df9149f-kube-api-access-fgqgr\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892502 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892480    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-model-cache\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892599 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892572    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-home\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.892692 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.892670    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-tmp-dir\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.894443 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.894426    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-dshm\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.894766 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.894744    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc3be949-7259-4d65-9a74-99230df9149f-tls-certs\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:46.901157 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:46.901133    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqgr\" (UniqueName: \"kubernetes.io/projected/dc3be949-7259-4d65-9a74-99230df9149f-kube-api-access-fgqgr\") pod \"auth-test-model-951cca-kserve-569484656c-h9px4\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") " pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:47.011844 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:47.011765    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:47.153486 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:47.153459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"]
Jul 07 13:23:47.154161 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:23:47.154135    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc3be949_7259_4d65_9a74_99230df9149f.slice/crio-427642cd0ccb5e47114f5cda61ff313c14ee74402ee1cb8e60e9addebb54edac WatchSource:0}: Error finding container 427642cd0ccb5e47114f5cda61ff313c14ee74402ee1cb8e60e9addebb54edac: Status 404 returned error can't find the container with id 427642cd0ccb5e47114f5cda61ff313c14ee74402ee1cb8e60e9addebb54edac
Jul 07 13:23:47.636768 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:47.636736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4" event={"ID":"dc3be949-7259-4d65-9a74-99230df9149f","Type":"ContainerStarted","Data":"f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07"}
Jul 07 13:23:47.636947 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:47.636776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4" event={"ID":"dc3be949-7259-4d65-9a74-99230df9149f","Type":"ContainerStarted","Data":"427642cd0ccb5e47114f5cda61ff313c14ee74402ee1cb8e60e9addebb54edac"}
Jul 07 13:23:47.661817 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:47.661766    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4" podStartSLOduration=1.661750531 podStartE2EDuration="1.661750531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:47.659781232 +0000 UTC m=+2115.922957705" watchObservedRunningTime="2026-07-07 13:23:47.661750531 +0000 UTC m=+2115.924927002"
Jul 07 13:23:57.012170 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:57.012135    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:57.012601 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:57.012188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:57.024681 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:57.024659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:23:57.704026 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:23:57.703996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:26:17.727086 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:17.727051    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"]
Jul 07 13:26:32.748016 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:32.747967    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4" podUID="dc3be949-7259-4d65-9a74-99230df9149f" containerName="main" containerID="cri-o://f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07" gracePeriod=45
Jul 07 13:26:33.001405 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.001330    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:26:33.118175 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118126    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc3be949-7259-4d65-9a74-99230df9149f-tls-certs\") pod \"dc3be949-7259-4d65-9a74-99230df9149f\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") "
Jul 07 13:26:33.118175 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118181    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-model-cache\") pod \"dc3be949-7259-4d65-9a74-99230df9149f\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") "
Jul 07 13:26:33.118459 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118210    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-dshm\") pod \"dc3be949-7259-4d65-9a74-99230df9149f\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") "
Jul 07 13:26:33.118459 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118276    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgqgr\" (UniqueName: \"kubernetes.io/projected/dc3be949-7259-4d65-9a74-99230df9149f-kube-api-access-fgqgr\") pod \"dc3be949-7259-4d65-9a74-99230df9149f\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") "
Jul 07 13:26:33.118459 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-home\") pod \"dc3be949-7259-4d65-9a74-99230df9149f\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") "
Jul 07 13:26:33.118459 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-tmp-dir\") pod \"dc3be949-7259-4d65-9a74-99230df9149f\" (UID: \"dc3be949-7259-4d65-9a74-99230df9149f\") "
Jul 07 13:26:33.118459 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118444    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-model-cache" (OuterVolumeSpecName: "model-cache") pod "dc3be949-7259-4d65-9a74-99230df9149f" (UID: "dc3be949-7259-4d65-9a74-99230df9149f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:26:33.118774 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118657    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dc3be949-7259-4d65-9a74-99230df9149f" (UID: "dc3be949-7259-4d65-9a74-99230df9149f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:26:33.118774 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118677    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-home" (OuterVolumeSpecName: "home") pod "dc3be949-7259-4d65-9a74-99230df9149f" (UID: "dc3be949-7259-4d65-9a74-99230df9149f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:26:33.118774 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118765    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-model-cache\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:26:33.118933 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118777    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-home\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:26:33.118933 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.118787    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-tmp-dir\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:26:33.120496 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.120469    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-dshm" (OuterVolumeSpecName: "dshm") pod "dc3be949-7259-4d65-9a74-99230df9149f" (UID: "dc3be949-7259-4d65-9a74-99230df9149f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 13:26:33.120625 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.120537    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc3be949-7259-4d65-9a74-99230df9149f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dc3be949-7259-4d65-9a74-99230df9149f" (UID: "dc3be949-7259-4d65-9a74-99230df9149f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 13:26:33.120625 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.120573    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3be949-7259-4d65-9a74-99230df9149f-kube-api-access-fgqgr" (OuterVolumeSpecName: "kube-api-access-fgqgr") pod "dc3be949-7259-4d65-9a74-99230df9149f" (UID: "dc3be949-7259-4d65-9a74-99230df9149f"). InnerVolumeSpecName "kube-api-access-fgqgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:26:33.220182 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.220145    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc3be949-7259-4d65-9a74-99230df9149f-tls-certs\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:26:33.220182 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.220176    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc3be949-7259-4d65-9a74-99230df9149f-dshm\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:26:33.220182 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.220186    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgqgr\" (UniqueName: \"kubernetes.io/projected/dc3be949-7259-4d65-9a74-99230df9149f-kube-api-access-fgqgr\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:26:33.592827 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.592792    2580 generic.go:356] "Generic (PLEG): container finished" podID="dc3be949-7259-4d65-9a74-99230df9149f" containerID="f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07" exitCode=0
Jul 07 13:26:33.593007 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.592837    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"
Jul 07 13:26:33.593007 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.592863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4" event={"ID":"dc3be949-7259-4d65-9a74-99230df9149f","Type":"ContainerDied","Data":"f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07"}
Jul 07 13:26:33.593007 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.592893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4" event={"ID":"dc3be949-7259-4d65-9a74-99230df9149f","Type":"ContainerDied","Data":"427642cd0ccb5e47114f5cda61ff313c14ee74402ee1cb8e60e9addebb54edac"}
Jul 07 13:26:33.593007 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.592909    2580 scope.go:117] "RemoveContainer" containerID="f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07"
Jul 07 13:26:33.603174 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.603155    2580 scope.go:117] "RemoveContainer" containerID="f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07"
Jul 07 13:26:33.603454 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:26:33.603438    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07\": container with ID starting with f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07 not found: ID does not exist" containerID="f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07"
Jul 07 13:26:33.603501 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.603462    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07"} err="failed to get container status \"f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07\": rpc error: code = NotFound desc = could not find container \"f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07\": container with ID starting with f89b4fbcd62beb533ff2b67ba9c3a46e13850765ff0ea0e1e10a41d4fee90c07 not found: ID does not exist"
Jul 07 13:26:33.616662 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.616632    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"]
Jul 07 13:26:33.621750 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:33.621726    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-951cca/auth-test-model-951cca-kserve-569484656c-h9px4"]
Jul 07 13:26:34.173152 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:26:34.173109    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3be949-7259-4d65-9a74-99230df9149f" path="/var/lib/kubelet/pods/dc3be949-7259-4d65-9a74-99230df9149f/volumes"
Jul 07 13:29:05.129747 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.129707    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002639650464"]
Jul 07 13:29:05.130368 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.130323    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3be949-7259-4d65-9a74-99230df9149f" containerName="main"
Jul 07 13:29:05.130368 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.130347    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3be949-7259-4d65-9a74-99230df9149f" containerName="main"
Jul 07 13:29:05.130548 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.130532    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3be949-7259-4d65-9a74-99230df9149f" containerName="main"
Jul 07 13:29:05.133762 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.133740    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650464"
Jul 07 13:29:05.138929 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.138900    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650464"]
Jul 07 13:29:05.249772 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.249736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2xrh\" (UniqueName: \"kubernetes.io/projected/a86ecba9-c50a-4789-8121-8e1fc59229f4-kube-api-access-j2xrh\") pod \"test-curl-8212-140002639650464\" (UID: \"a86ecba9-c50a-4789-8121-8e1fc59229f4\") " pod="opendatahub/test-curl-8212-140002639650464"
Jul 07 13:29:05.350524 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.350476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2xrh\" (UniqueName: \"kubernetes.io/projected/a86ecba9-c50a-4789-8121-8e1fc59229f4-kube-api-access-j2xrh\") pod \"test-curl-8212-140002639650464\" (UID: \"a86ecba9-c50a-4789-8121-8e1fc59229f4\") " pod="opendatahub/test-curl-8212-140002639650464"
Jul 07 13:29:05.359877 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.359850    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2xrh\" (UniqueName: \"kubernetes.io/projected/a86ecba9-c50a-4789-8121-8e1fc59229f4-kube-api-access-j2xrh\") pod \"test-curl-8212-140002639650464\" (UID: \"a86ecba9-c50a-4789-8121-8e1fc59229f4\") " pod="opendatahub/test-curl-8212-140002639650464"
Jul 07 13:29:05.444850 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.444753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650464"
Jul 07 13:29:05.585252 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.585224    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650464"]
Jul 07 13:29:05.587224 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:05.587189    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda86ecba9_c50a_4789_8121_8e1fc59229f4.slice/crio-30a8afddd8558d9a9f2101970ef0e9107459dbacca46723bc7829e71d61d9543 WatchSource:0}: Error finding container 30a8afddd8558d9a9f2101970ef0e9107459dbacca46723bc7829e71d61d9543: Status 404 returned error can't find the container with id 30a8afddd8558d9a9f2101970ef0e9107459dbacca46723bc7829e71d61d9543
Jul 07 13:29:05.588826 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:05.588806    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 13:29:06.478806 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:06.478765    2580 generic.go:356] "Generic (PLEG): container finished" podID="a86ecba9-c50a-4789-8121-8e1fc59229f4" containerID="a1d40fbc98224702eaf3c5a984fc5bf098db990dab5aaf99a533b696a036de59" exitCode=0
Jul 07 13:29:06.479189 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:06.478849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650464" event={"ID":"a86ecba9-c50a-4789-8121-8e1fc59229f4","Type":"ContainerDied","Data":"a1d40fbc98224702eaf3c5a984fc5bf098db990dab5aaf99a533b696a036de59"}
Jul 07 13:29:06.479189 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:06.478893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650464" event={"ID":"a86ecba9-c50a-4789-8121-8e1fc59229f4","Type":"ContainerStarted","Data":"30a8afddd8558d9a9f2101970ef0e9107459dbacca46723bc7829e71d61d9543"}
Jul 07 13:29:07.622982 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.622960    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650464"
Jul 07 13:29:07.660072 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.660044    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002639650464_a86ecba9-c50a-4789-8121-8e1fc59229f4/test-curl-8212-140002639650464/0.log"
Jul 07 13:29:07.687040 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.687011    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002639650464"]
Jul 07 13:29:07.691406 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.691381    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002639650464"]
Jul 07 13:29:07.780118 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.780026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2xrh\" (UniqueName: \"kubernetes.io/projected/a86ecba9-c50a-4789-8121-8e1fc59229f4-kube-api-access-j2xrh\") pod \"a86ecba9-c50a-4789-8121-8e1fc59229f4\" (UID: \"a86ecba9-c50a-4789-8121-8e1fc59229f4\") "
Jul 07 13:29:07.782084 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.782053    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a86ecba9-c50a-4789-8121-8e1fc59229f4-kube-api-access-j2xrh" (OuterVolumeSpecName: "kube-api-access-j2xrh") pod "a86ecba9-c50a-4789-8121-8e1fc59229f4" (UID: "a86ecba9-c50a-4789-8121-8e1fc59229f4"). InnerVolumeSpecName "kube-api-access-j2xrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:07.850371 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.850333    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002639650576"]
Jul 07 13:29:07.850869 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.850851    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86ecba9-c50a-4789-8121-8e1fc59229f4" containerName="test-curl-8212-140002639650464"
Jul 07 13:29:07.850923 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.850872    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86ecba9-c50a-4789-8121-8e1fc59229f4" containerName="test-curl-8212-140002639650464"
Jul 07 13:29:07.850979 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.850970    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86ecba9-c50a-4789-8121-8e1fc59229f4" containerName="test-curl-8212-140002639650464"
Jul 07 13:29:07.854139 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.854123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:07.866627 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.866601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650576"]
Jul 07 13:29:07.881178 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.881136    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2xrh\" (UniqueName: \"kubernetes.io/projected/a86ecba9-c50a-4789-8121-8e1fc59229f4-kube-api-access-j2xrh\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:07.981675 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:07.981634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkz9s\" (UniqueName: \"kubernetes.io/projected/524a9b62-b5b2-4183-b86d-e82ba132264d-kube-api-access-xkz9s\") pod \"test-curl-8212-140002639650576\" (UID: \"524a9b62-b5b2-4183-b86d-e82ba132264d\") " pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:08.082489 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.082389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkz9s\" (UniqueName: \"kubernetes.io/projected/524a9b62-b5b2-4183-b86d-e82ba132264d-kube-api-access-xkz9s\") pod \"test-curl-8212-140002639650576\" (UID: \"524a9b62-b5b2-4183-b86d-e82ba132264d\") " pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:08.100618 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.100588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkz9s\" (UniqueName: \"kubernetes.io/projected/524a9b62-b5b2-4183-b86d-e82ba132264d-kube-api-access-xkz9s\") pod \"test-curl-8212-140002639650576\" (UID: \"524a9b62-b5b2-4183-b86d-e82ba132264d\") " pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:08.164399 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.164359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:08.180390 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.175004    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a86ecba9-c50a-4789-8121-8e1fc59229f4" path="/var/lib/kubelet/pods/a86ecba9-c50a-4789-8121-8e1fc59229f4/volumes"
Jul 07 13:29:08.309162 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.309131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650576"]
Jul 07 13:29:08.310710 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:08.310677    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod524a9b62_b5b2_4183_b86d_e82ba132264d.slice/crio-0bf550b55927201de370264b3b3296ab4205b76bde7f05e7a5a0a64343953a9a WatchSource:0}: Error finding container 0bf550b55927201de370264b3b3296ab4205b76bde7f05e7a5a0a64343953a9a: Status 404 returned error can't find the container with id 0bf550b55927201de370264b3b3296ab4205b76bde7f05e7a5a0a64343953a9a
Jul 07 13:29:08.492623 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.492576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650576" event={"ID":"524a9b62-b5b2-4183-b86d-e82ba132264d","Type":"ContainerStarted","Data":"0bf550b55927201de370264b3b3296ab4205b76bde7f05e7a5a0a64343953a9a"}
Jul 07 13:29:08.493887 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.493863    2580 scope.go:117] "RemoveContainer" containerID="a1d40fbc98224702eaf3c5a984fc5bf098db990dab5aaf99a533b696a036de59"
Jul 07 13:29:08.494006 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:08.493884    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650464"
Jul 07 13:29:09.502989 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:09.502952    2580 generic.go:356] "Generic (PLEG): container finished" podID="524a9b62-b5b2-4183-b86d-e82ba132264d" containerID="f968f09a42f596a483c6dcdefec12a31abc27ad523dcd14ed0fdef0ecb7434f7" exitCode=0
Jul 07 13:29:09.503352 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:09.503014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650576" event={"ID":"524a9b62-b5b2-4183-b86d-e82ba132264d","Type":"ContainerDied","Data":"f968f09a42f596a483c6dcdefec12a31abc27ad523dcd14ed0fdef0ecb7434f7"}
Jul 07 13:29:10.649184 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.649156    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:10.669733 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.669704    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002639650576_524a9b62-b5b2-4183-b86d-e82ba132264d/test-curl-8212-140002639650576/0.log"
Jul 07 13:29:10.695871 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.695804    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002639650576"]
Jul 07 13:29:10.698706 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.698682    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002639650576"]
Jul 07 13:29:10.704187 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.704170    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkz9s\" (UniqueName: \"kubernetes.io/projected/524a9b62-b5b2-4183-b86d-e82ba132264d-kube-api-access-xkz9s\") pod \"524a9b62-b5b2-4183-b86d-e82ba132264d\" (UID: \"524a9b62-b5b2-4183-b86d-e82ba132264d\") "
Jul 07 13:29:10.706212 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.706193    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524a9b62-b5b2-4183-b86d-e82ba132264d-kube-api-access-xkz9s" (OuterVolumeSpecName: "kube-api-access-xkz9s") pod "524a9b62-b5b2-4183-b86d-e82ba132264d" (UID: "524a9b62-b5b2-4183-b86d-e82ba132264d"). InnerVolumeSpecName "kube-api-access-xkz9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:10.804992 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.804885    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkz9s\" (UniqueName: \"kubernetes.io/projected/524a9b62-b5b2-4183-b86d-e82ba132264d-kube-api-access-xkz9s\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:10.858163 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.858128    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002639650688"]
Jul 07 13:29:10.858571 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.858558    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524a9b62-b5b2-4183-b86d-e82ba132264d" containerName="test-curl-8212-140002639650576"
Jul 07 13:29:10.858645 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.858573    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="524a9b62-b5b2-4183-b86d-e82ba132264d" containerName="test-curl-8212-140002639650576"
Jul 07 13:29:10.858645 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.858639    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="524a9b62-b5b2-4183-b86d-e82ba132264d" containerName="test-curl-8212-140002639650576"
Jul 07 13:29:10.861708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.861691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650688"
Jul 07 13:29:10.866310 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.866284    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650688"]
Jul 07 13:29:10.905230 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:10.905197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shhkd\" (UniqueName: \"kubernetes.io/projected/70cd53f6-f1e4-4873-8aa3-8178bd10d017-kube-api-access-shhkd\") pod \"test-curl-8212-140002639650688\" (UID: \"70cd53f6-f1e4-4873-8aa3-8178bd10d017\") " pod="opendatahub/test-curl-8212-140002639650688"
Jul 07 13:29:11.005846 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:11.005811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shhkd\" (UniqueName: \"kubernetes.io/projected/70cd53f6-f1e4-4873-8aa3-8178bd10d017-kube-api-access-shhkd\") pod \"test-curl-8212-140002639650688\" (UID: \"70cd53f6-f1e4-4873-8aa3-8178bd10d017\") " pod="opendatahub/test-curl-8212-140002639650688"
Jul 07 13:29:11.014199 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:11.014178    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shhkd\" (UniqueName: \"kubernetes.io/projected/70cd53f6-f1e4-4873-8aa3-8178bd10d017-kube-api-access-shhkd\") pod \"test-curl-8212-140002639650688\" (UID: \"70cd53f6-f1e4-4873-8aa3-8178bd10d017\") " pod="opendatahub/test-curl-8212-140002639650688"
Jul 07 13:29:11.171391 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:11.171354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650688"
Jul 07 13:29:11.315886 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:11.315860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650688"]
Jul 07 13:29:11.317429 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:11.317401    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70cd53f6_f1e4_4873_8aa3_8178bd10d017.slice/crio-a9803242a66f43fa2e97b9cdefadd9a9ae1cd12818e8b9e5ff613df541902da2 WatchSource:0}: Error finding container a9803242a66f43fa2e97b9cdefadd9a9ae1cd12818e8b9e5ff613df541902da2: Status 404 returned error can't find the container with id a9803242a66f43fa2e97b9cdefadd9a9ae1cd12818e8b9e5ff613df541902da2
Jul 07 13:29:11.515796 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:11.515705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650688" event={"ID":"70cd53f6-f1e4-4873-8aa3-8178bd10d017","Type":"ContainerStarted","Data":"a9803242a66f43fa2e97b9cdefadd9a9ae1cd12818e8b9e5ff613df541902da2"}
Jul 07 13:29:11.517135 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:11.517108    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bf550b55927201de370264b3b3296ab4205b76bde7f05e7a5a0a64343953a9a"
Jul 07 13:29:11.517135 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:11.517133    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:11.527311 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:11.527279    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002639650576\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="524a9b62-b5b2-4183-b86d-e82ba132264d" pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:12.171757 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:12.171719    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002639650576\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="524a9b62-b5b2-4183-b86d-e82ba132264d" pod="opendatahub/test-curl-8212-140002639650576"
Jul 07 13:29:12.174326 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:12.174302    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="524a9b62-b5b2-4183-b86d-e82ba132264d" path="/var/lib/kubelet/pods/524a9b62-b5b2-4183-b86d-e82ba132264d/volumes"
Jul 07 13:29:12.524079 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:12.523996    2580 generic.go:356] "Generic (PLEG): container finished" podID="70cd53f6-f1e4-4873-8aa3-8178bd10d017" containerID="26ab29dda0bea34c0810c4fdb224dc706178b4ed5e2b379a80761e9e78c37071" exitCode=0
Jul 07 13:29:12.524227 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:12.524082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650688" event={"ID":"70cd53f6-f1e4-4873-8aa3-8178bd10d017","Type":"ContainerDied","Data":"26ab29dda0bea34c0810c4fdb224dc706178b4ed5e2b379a80761e9e78c37071"}
Jul 07 13:29:13.669332 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.669304    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650688"
Jul 07 13:29:13.692075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.692051    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002639650688_70cd53f6-f1e4-4873-8aa3-8178bd10d017/test-curl-8212-140002639650688/0.log"
Jul 07 13:29:13.716373 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.716340    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002639650688"]
Jul 07 13:29:13.720805 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.720774    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002639650688"]
Jul 07 13:29:13.731361 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.731341    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shhkd\" (UniqueName: \"kubernetes.io/projected/70cd53f6-f1e4-4873-8aa3-8178bd10d017-kube-api-access-shhkd\") pod \"70cd53f6-f1e4-4873-8aa3-8178bd10d017\" (UID: \"70cd53f6-f1e4-4873-8aa3-8178bd10d017\") "
Jul 07 13:29:13.733471 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.733441    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cd53f6-f1e4-4873-8aa3-8178bd10d017-kube-api-access-shhkd" (OuterVolumeSpecName: "kube-api-access-shhkd") pod "70cd53f6-f1e4-4873-8aa3-8178bd10d017" (UID: "70cd53f6-f1e4-4873-8aa3-8178bd10d017"). InnerVolumeSpecName "kube-api-access-shhkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:13.832868 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.832746    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shhkd\" (UniqueName: \"kubernetes.io/projected/70cd53f6-f1e4-4873-8aa3-8178bd10d017-kube-api-access-shhkd\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:13.865516 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.865482    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002639650016"]
Jul 07 13:29:13.865955 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.865942    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cd53f6-f1e4-4873-8aa3-8178bd10d017" containerName="test-curl-8212-140002639650688"
Jul 07 13:29:13.866008 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.865957    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cd53f6-f1e4-4873-8aa3-8178bd10d017" containerName="test-curl-8212-140002639650688"
Jul 07 13:29:13.866044 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.866024    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cd53f6-f1e4-4873-8aa3-8178bd10d017" containerName="test-curl-8212-140002639650688"
Jul 07 13:29:13.868994 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.868978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:13.876194 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.876139    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650016"]
Jul 07 13:29:13.933909 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:13.933871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hkr\" (UniqueName: \"kubernetes.io/projected/ab202cb0-4cd3-4dbb-85d2-a6668f5884fd-kube-api-access-j5hkr\") pod \"test-curl-8212-140002639650016\" (UID: \"ab202cb0-4cd3-4dbb-85d2-a6668f5884fd\") " pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:14.034622 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.034585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hkr\" (UniqueName: \"kubernetes.io/projected/ab202cb0-4cd3-4dbb-85d2-a6668f5884fd-kube-api-access-j5hkr\") pod \"test-curl-8212-140002639650016\" (UID: \"ab202cb0-4cd3-4dbb-85d2-a6668f5884fd\") " pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:14.042776 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.042749    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hkr\" (UniqueName: \"kubernetes.io/projected/ab202cb0-4cd3-4dbb-85d2-a6668f5884fd-kube-api-access-j5hkr\") pod \"test-curl-8212-140002639650016\" (UID: \"ab202cb0-4cd3-4dbb-85d2-a6668f5884fd\") " pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:14.172943 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.172909    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cd53f6-f1e4-4873-8aa3-8178bd10d017" path="/var/lib/kubelet/pods/70cd53f6-f1e4-4873-8aa3-8178bd10d017/volumes"
Jul 07 13:29:14.191599 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.191561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:14.330752 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.330724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002639650016"]
Jul 07 13:29:14.331731 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:14.331706    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab202cb0_4cd3_4dbb_85d2_a6668f5884fd.slice/crio-d97c9ff127ced058f107908b1c3f19a1bc1b0becccc0b27b389da0f202c34a24 WatchSource:0}: Error finding container d97c9ff127ced058f107908b1c3f19a1bc1b0becccc0b27b389da0f202c34a24: Status 404 returned error can't find the container with id d97c9ff127ced058f107908b1c3f19a1bc1b0becccc0b27b389da0f202c34a24
Jul 07 13:29:14.537691 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.537604    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650688"
Jul 07 13:29:14.537691 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.537672    2580 scope.go:117] "RemoveContainer" containerID="26ab29dda0bea34c0810c4fdb224dc706178b4ed5e2b379a80761e9e78c37071"
Jul 07 13:29:14.539562 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:14.539535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650016" event={"ID":"ab202cb0-4cd3-4dbb-85d2-a6668f5884fd","Type":"ContainerStarted","Data":"d97c9ff127ced058f107908b1c3f19a1bc1b0becccc0b27b389da0f202c34a24"}
Jul 07 13:29:15.547523 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:15.547474    2580 generic.go:356] "Generic (PLEG): container finished" podID="ab202cb0-4cd3-4dbb-85d2-a6668f5884fd" containerID="2285dd74854f4ed85033bf47f263f1ecb3bec7fb0af91bd279d4abd416227809" exitCode=0
Jul 07 13:29:15.547923 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:15.547596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002639650016" event={"ID":"ab202cb0-4cd3-4dbb-85d2-a6668f5884fd","Type":"ContainerDied","Data":"2285dd74854f4ed85033bf47f263f1ecb3bec7fb0af91bd279d4abd416227809"}
Jul 07 13:29:16.698028 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.698000    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:16.719363 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.719320    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002639650016_ab202cb0-4cd3-4dbb-85d2-a6668f5884fd/test-curl-8212-140002639650016/0.log"
Jul 07 13:29:16.744424 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.744389    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002639650016"]
Jul 07 13:29:16.750553 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.750519    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002639650016"]
Jul 07 13:29:16.756633 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.756608    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5hkr\" (UniqueName: \"kubernetes.io/projected/ab202cb0-4cd3-4dbb-85d2-a6668f5884fd-kube-api-access-j5hkr\") pod \"ab202cb0-4cd3-4dbb-85d2-a6668f5884fd\" (UID: \"ab202cb0-4cd3-4dbb-85d2-a6668f5884fd\") "
Jul 07 13:29:16.758672 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.758639    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab202cb0-4cd3-4dbb-85d2-a6668f5884fd-kube-api-access-j5hkr" (OuterVolumeSpecName: "kube-api-access-j5hkr") pod "ab202cb0-4cd3-4dbb-85d2-a6668f5884fd" (UID: "ab202cb0-4cd3-4dbb-85d2-a6668f5884fd"). InnerVolumeSpecName "kube-api-access-j5hkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:16.857414 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.857324    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5hkr\" (UniqueName: \"kubernetes.io/projected/ab202cb0-4cd3-4dbb-85d2-a6668f5884fd-kube-api-access-j5hkr\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:16.978836 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.978801    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002638672496"]
Jul 07 13:29:16.979326 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.979305    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab202cb0-4cd3-4dbb-85d2-a6668f5884fd" containerName="test-curl-8212-140002639650016"
Jul 07 13:29:16.979414 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.979328    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab202cb0-4cd3-4dbb-85d2-a6668f5884fd" containerName="test-curl-8212-140002639650016"
Jul 07 13:29:16.979471 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.979427    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab202cb0-4cd3-4dbb-85d2-a6668f5884fd" containerName="test-curl-8212-140002639650016"
Jul 07 13:29:16.982478 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.982457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002638672496"
Jul 07 13:29:16.988693 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:16.988663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002638672496"]
Jul 07 13:29:17.058782 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.058726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr2d5\" (UniqueName: \"kubernetes.io/projected/f99c6ab8-a589-4e2f-8a11-0419242ae6cf-kube-api-access-rr2d5\") pod \"test-curl-8212-140002638672496\" (UID: \"f99c6ab8-a589-4e2f-8a11-0419242ae6cf\") " pod="opendatahub/test-curl-8212-140002638672496"
Jul 07 13:29:17.159985 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.159946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr2d5\" (UniqueName: \"kubernetes.io/projected/f99c6ab8-a589-4e2f-8a11-0419242ae6cf-kube-api-access-rr2d5\") pod \"test-curl-8212-140002638672496\" (UID: \"f99c6ab8-a589-4e2f-8a11-0419242ae6cf\") " pod="opendatahub/test-curl-8212-140002638672496"
Jul 07 13:29:17.168861 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.168835    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr2d5\" (UniqueName: \"kubernetes.io/projected/f99c6ab8-a589-4e2f-8a11-0419242ae6cf-kube-api-access-rr2d5\") pod \"test-curl-8212-140002638672496\" (UID: \"f99c6ab8-a589-4e2f-8a11-0419242ae6cf\") " pod="opendatahub/test-curl-8212-140002638672496"
Jul 07 13:29:17.293340 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.293304    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002638672496"
Jul 07 13:29:17.440294 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.440265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002638672496"]
Jul 07 13:29:17.441943 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:17.441918    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf99c6ab8_a589_4e2f_8a11_0419242ae6cf.slice/crio-73b3a4c935e78b08a656f97db8ba9f3f66aeca8c24986cfa22b3841a3d874e72 WatchSource:0}: Error finding container 73b3a4c935e78b08a656f97db8ba9f3f66aeca8c24986cfa22b3841a3d874e72: Status 404 returned error can't find the container with id 73b3a4c935e78b08a656f97db8ba9f3f66aeca8c24986cfa22b3841a3d874e72
Jul 07 13:29:17.561712 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.561677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002638672496" event={"ID":"f99c6ab8-a589-4e2f-8a11-0419242ae6cf","Type":"ContainerStarted","Data":"73b3a4c935e78b08a656f97db8ba9f3f66aeca8c24986cfa22b3841a3d874e72"}
Jul 07 13:29:17.562933 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.562912    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d97c9ff127ced058f107908b1c3f19a1bc1b0becccc0b27b389da0f202c34a24"
Jul 07 13:29:17.562933 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:17.562921    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:17.573594 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:17.573568    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002639650016\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="ab202cb0-4cd3-4dbb-85d2-a6668f5884fd" pod="opendatahub/test-curl-8212-140002639650016"
Jul 07 13:29:18.173778 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:18.173732    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab202cb0-4cd3-4dbb-85d2-a6668f5884fd" path="/var/lib/kubelet/pods/ab202cb0-4cd3-4dbb-85d2-a6668f5884fd/volumes"
Jul 07 13:29:18.570546 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:18.570429    2580 generic.go:356] "Generic (PLEG): container finished" podID="f99c6ab8-a589-4e2f-8a11-0419242ae6cf" containerID="a031e2ec3107cc5490d47998e81fbe49b47aecfd981e9122cf9e93b4d10d620a" exitCode=0
Jul 07 13:29:18.570546 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:18.570531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002638672496" event={"ID":"f99c6ab8-a589-4e2f-8a11-0419242ae6cf","Type":"ContainerDied","Data":"a031e2ec3107cc5490d47998e81fbe49b47aecfd981e9122cf9e93b4d10d620a"}
Jul 07 13:29:19.720873 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.720848    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002638672496"
Jul 07 13:29:19.740094 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.740061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002638672496_f99c6ab8-a589-4e2f-8a11-0419242ae6cf/test-curl-8212-140002638672496/0.log"
Jul 07 13:29:19.766412 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.766378    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002638672496"]
Jul 07 13:29:19.774879 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.769377    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002638672496"]
Jul 07 13:29:19.782612 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.782580    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr2d5\" (UniqueName: \"kubernetes.io/projected/f99c6ab8-a589-4e2f-8a11-0419242ae6cf-kube-api-access-rr2d5\") pod \"f99c6ab8-a589-4e2f-8a11-0419242ae6cf\" (UID: \"f99c6ab8-a589-4e2f-8a11-0419242ae6cf\") "
Jul 07 13:29:19.784647 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.784622    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f99c6ab8-a589-4e2f-8a11-0419242ae6cf-kube-api-access-rr2d5" (OuterVolumeSpecName: "kube-api-access-rr2d5") pod "f99c6ab8-a589-4e2f-8a11-0419242ae6cf" (UID: "f99c6ab8-a589-4e2f-8a11-0419242ae6cf"). InnerVolumeSpecName "kube-api-access-rr2d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:19.883802 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.883767    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr2d5\" (UniqueName: \"kubernetes.io/projected/f99c6ab8-a589-4e2f-8a11-0419242ae6cf-kube-api-access-rr2d5\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:19.906839 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.906805    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631790288"]
Jul 07 13:29:19.907264 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.907251    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f99c6ab8-a589-4e2f-8a11-0419242ae6cf" containerName="test-curl-8212-140002638672496"
Jul 07 13:29:19.907305 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.907266    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f99c6ab8-a589-4e2f-8a11-0419242ae6cf" containerName="test-curl-8212-140002638672496"
Jul 07 13:29:19.907344 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.907337    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f99c6ab8-a589-4e2f-8a11-0419242ae6cf" containerName="test-curl-8212-140002638672496"
Jul 07 13:29:19.910352 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.910337    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:19.917033 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.917010    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631790288"]
Jul 07 13:29:19.984759 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:19.984729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqwcw\" (UniqueName: \"kubernetes.io/projected/56bec131-cf48-4b88-8479-e0af8f6bef7e-kube-api-access-sqwcw\") pod \"test-curl-8212-140002631790288\" (UID: \"56bec131-cf48-4b88-8479-e0af8f6bef7e\") " pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:20.086198 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.086163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqwcw\" (UniqueName: \"kubernetes.io/projected/56bec131-cf48-4b88-8479-e0af8f6bef7e-kube-api-access-sqwcw\") pod \"test-curl-8212-140002631790288\" (UID: \"56bec131-cf48-4b88-8479-e0af8f6bef7e\") " pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:20.095744 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.095716    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqwcw\" (UniqueName: \"kubernetes.io/projected/56bec131-cf48-4b88-8479-e0af8f6bef7e-kube-api-access-sqwcw\") pod \"test-curl-8212-140002631790288\" (UID: \"56bec131-cf48-4b88-8479-e0af8f6bef7e\") " pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:20.173167 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.173068    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f99c6ab8-a589-4e2f-8a11-0419242ae6cf" path="/var/lib/kubelet/pods/f99c6ab8-a589-4e2f-8a11-0419242ae6cf/volumes"
Jul 07 13:29:20.220181 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.220147    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:20.360373 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.360337    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631790288"]
Jul 07 13:29:20.361635 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:20.361605    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56bec131_cf48_4b88_8479_e0af8f6bef7e.slice/crio-b415cad901af1da91f4e3f0517b5c5d51956e14c9ebf958f784ce0bc3fbb203b WatchSource:0}: Error finding container b415cad901af1da91f4e3f0517b5c5d51956e14c9ebf958f784ce0bc3fbb203b: Status 404 returned error can't find the container with id b415cad901af1da91f4e3f0517b5c5d51956e14c9ebf958f784ce0bc3fbb203b
Jul 07 13:29:20.583399 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.583304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631790288" event={"ID":"56bec131-cf48-4b88-8479-e0af8f6bef7e","Type":"ContainerStarted","Data":"b415cad901af1da91f4e3f0517b5c5d51956e14c9ebf958f784ce0bc3fbb203b"}
Jul 07 13:29:20.584585 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.584565    2580 scope.go:117] "RemoveContainer" containerID="a031e2ec3107cc5490d47998e81fbe49b47aecfd981e9122cf9e93b4d10d620a"
Jul 07 13:29:20.584585 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:20.584576    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002638672496"
Jul 07 13:29:21.591863 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:21.591828    2580 generic.go:356] "Generic (PLEG): container finished" podID="56bec131-cf48-4b88-8479-e0af8f6bef7e" containerID="83440a35b5a1e07f316970eab851e2ef8da3475dcb2d22f091ac822c821918f1" exitCode=0
Jul 07 13:29:21.592309 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:21.591915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631790288" event={"ID":"56bec131-cf48-4b88-8479-e0af8f6bef7e","Type":"ContainerDied","Data":"83440a35b5a1e07f316970eab851e2ef8da3475dcb2d22f091ac822c821918f1"}
Jul 07 13:29:22.738894 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.738864    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:22.760750 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.760654    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631790288_56bec131-cf48-4b88-8479-e0af8f6bef7e/test-curl-8212-140002631790288/0.log"
Jul 07 13:29:22.786345 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.786314    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631790288"]
Jul 07 13:29:22.790455 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.790428    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631790288"]
Jul 07 13:29:22.811187 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.811163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqwcw\" (UniqueName: \"kubernetes.io/projected/56bec131-cf48-4b88-8479-e0af8f6bef7e-kube-api-access-sqwcw\") pod \"56bec131-cf48-4b88-8479-e0af8f6bef7e\" (UID: \"56bec131-cf48-4b88-8479-e0af8f6bef7e\") "
Jul 07 13:29:22.813237 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.813213    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56bec131-cf48-4b88-8479-e0af8f6bef7e-kube-api-access-sqwcw" (OuterVolumeSpecName: "kube-api-access-sqwcw") pod "56bec131-cf48-4b88-8479-e0af8f6bef7e" (UID: "56bec131-cf48-4b88-8479-e0af8f6bef7e"). InnerVolumeSpecName "kube-api-access-sqwcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:22.912879 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.912846    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqwcw\" (UniqueName: \"kubernetes.io/projected/56bec131-cf48-4b88-8479-e0af8f6bef7e-kube-api-access-sqwcw\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:22.936275 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.936238    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631790144"]
Jul 07 13:29:22.936695 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.936668    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56bec131-cf48-4b88-8479-e0af8f6bef7e" containerName="test-curl-8212-140002631790288"
Jul 07 13:29:22.936695 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.936696    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="56bec131-cf48-4b88-8479-e0af8f6bef7e" containerName="test-curl-8212-140002631790288"
Jul 07 13:29:22.936794 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.936784    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="56bec131-cf48-4b88-8479-e0af8f6bef7e" containerName="test-curl-8212-140002631790288"
Jul 07 13:29:22.939867 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.939849    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790144"
Jul 07 13:29:22.946181 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:22.946151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631790144"]
Jul 07 13:29:23.013801 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.013762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8n7\" (UniqueName: \"kubernetes.io/projected/8ba2f727-d9c0-4c62-b402-a1a70e7046ae-kube-api-access-5q8n7\") pod \"test-curl-8212-140002631790144\" (UID: \"8ba2f727-d9c0-4c62-b402-a1a70e7046ae\") " pod="opendatahub/test-curl-8212-140002631790144"
Jul 07 13:29:23.114700 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.114657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8n7\" (UniqueName: \"kubernetes.io/projected/8ba2f727-d9c0-4c62-b402-a1a70e7046ae-kube-api-access-5q8n7\") pod \"test-curl-8212-140002631790144\" (UID: \"8ba2f727-d9c0-4c62-b402-a1a70e7046ae\") " pod="opendatahub/test-curl-8212-140002631790144"
Jul 07 13:29:23.122714 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.122685    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8n7\" (UniqueName: \"kubernetes.io/projected/8ba2f727-d9c0-4c62-b402-a1a70e7046ae-kube-api-access-5q8n7\") pod \"test-curl-8212-140002631790144\" (UID: \"8ba2f727-d9c0-4c62-b402-a1a70e7046ae\") " pod="opendatahub/test-curl-8212-140002631790144"
Jul 07 13:29:23.250133 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.250049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790144"
Jul 07 13:29:23.399913 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.399882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631790144"]
Jul 07 13:29:23.401531 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:23.401486    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ba2f727_d9c0_4c62_b402_a1a70e7046ae.slice/crio-cf1a33305eb993990d66d64599c4259eb9b15a563875a5a539fc25be7fb074b8 WatchSource:0}: Error finding container cf1a33305eb993990d66d64599c4259eb9b15a563875a5a539fc25be7fb074b8: Status 404 returned error can't find the container with id cf1a33305eb993990d66d64599c4259eb9b15a563875a5a539fc25be7fb074b8
Jul 07 13:29:23.608887 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.608805    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:23.609039 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.608815    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b415cad901af1da91f4e3f0517b5c5d51956e14c9ebf958f784ce0bc3fbb203b"
Jul 07 13:29:23.610114 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:23.610083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631790144" event={"ID":"8ba2f727-d9c0-4c62-b402-a1a70e7046ae","Type":"ContainerStarted","Data":"cf1a33305eb993990d66d64599c4259eb9b15a563875a5a539fc25be7fb074b8"}
Jul 07 13:29:23.619699 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:23.619673    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002631790288\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="56bec131-cf48-4b88-8479-e0af8f6bef7e" pod="opendatahub/test-curl-8212-140002631790288"
Jul 07 13:29:24.172737 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:24.172702    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56bec131-cf48-4b88-8479-e0af8f6bef7e" path="/var/lib/kubelet/pods/56bec131-cf48-4b88-8479-e0af8f6bef7e/volumes"
Jul 07 13:29:24.617235 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:24.617139    2580 generic.go:356] "Generic (PLEG): container finished" podID="8ba2f727-d9c0-4c62-b402-a1a70e7046ae" containerID="abf215d1dfdf1def380e45fc841299aa19a3c39582ddadfbb471ab0de01b5e54" exitCode=0
Jul 07 13:29:24.617403 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:24.617228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631790144" event={"ID":"8ba2f727-d9c0-4c62-b402-a1a70e7046ae","Type":"ContainerDied","Data":"abf215d1dfdf1def380e45fc841299aa19a3c39582ddadfbb471ab0de01b5e54"}
Jul 07 13:29:25.766500 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.766469    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790144"
Jul 07 13:29:25.790004 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.789940    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631790144_8ba2f727-d9c0-4c62-b402-a1a70e7046ae/test-curl-8212-140002631790144/0.log"
Jul 07 13:29:25.818997 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.818965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631790144"]
Jul 07 13:29:25.827654 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.827627    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631790144"]
Jul 07 13:29:25.841224 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.841195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q8n7\" (UniqueName: \"kubernetes.io/projected/8ba2f727-d9c0-4c62-b402-a1a70e7046ae-kube-api-access-5q8n7\") pod \"8ba2f727-d9c0-4c62-b402-a1a70e7046ae\" (UID: \"8ba2f727-d9c0-4c62-b402-a1a70e7046ae\") "
Jul 07 13:29:25.843308 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.843279    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba2f727-d9c0-4c62-b402-a1a70e7046ae-kube-api-access-5q8n7" (OuterVolumeSpecName: "kube-api-access-5q8n7") pod "8ba2f727-d9c0-4c62-b402-a1a70e7046ae" (UID: "8ba2f727-d9c0-4c62-b402-a1a70e7046ae"). InnerVolumeSpecName "kube-api-access-5q8n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:25.942887 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.942798    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q8n7\" (UniqueName: \"kubernetes.io/projected/8ba2f727-d9c0-4c62-b402-a1a70e7046ae-kube-api-access-5q8n7\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:25.970725 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.970692    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631790000"]
Jul 07 13:29:25.971122 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.971108    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba2f727-d9c0-4c62-b402-a1a70e7046ae" containerName="test-curl-8212-140002631790144"
Jul 07 13:29:25.971161 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.971124    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba2f727-d9c0-4c62-b402-a1a70e7046ae" containerName="test-curl-8212-140002631790144"
Jul 07 13:29:25.971211 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.971202    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba2f727-d9c0-4c62-b402-a1a70e7046ae" containerName="test-curl-8212-140002631790144"
Jul 07 13:29:25.974334 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.974317    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:25.983836 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:25.983808    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631790000"]
Jul 07 13:29:26.044038 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.044000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnvtl\" (UniqueName: \"kubernetes.io/projected/9211a7ea-034e-4352-b327-4b804d645929-kube-api-access-mnvtl\") pod \"test-curl-8212-140002631790000\" (UID: \"9211a7ea-034e-4352-b327-4b804d645929\") " pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:26.145062 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.145025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnvtl\" (UniqueName: \"kubernetes.io/projected/9211a7ea-034e-4352-b327-4b804d645929-kube-api-access-mnvtl\") pod \"test-curl-8212-140002631790000\" (UID: \"9211a7ea-034e-4352-b327-4b804d645929\") " pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:26.154341 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.154317    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnvtl\" (UniqueName: \"kubernetes.io/projected/9211a7ea-034e-4352-b327-4b804d645929-kube-api-access-mnvtl\") pod \"test-curl-8212-140002631790000\" (UID: \"9211a7ea-034e-4352-b327-4b804d645929\") " pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:26.172753 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.172724    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba2f727-d9c0-4c62-b402-a1a70e7046ae" path="/var/lib/kubelet/pods/8ba2f727-d9c0-4c62-b402-a1a70e7046ae/volumes"
Jul 07 13:29:26.284107 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.284021    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:26.424932 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.424127    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631790000"]
Jul 07 13:29:26.427672 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:26.427644    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9211a7ea_034e_4352_b327_4b804d645929.slice/crio-f149a90fa5652a9d7c01c16b76223edbe1754f5bd1e88c20223f449cf4ca9fc5 WatchSource:0}: Error finding container f149a90fa5652a9d7c01c16b76223edbe1754f5bd1e88c20223f449cf4ca9fc5: Status 404 returned error can't find the container with id f149a90fa5652a9d7c01c16b76223edbe1754f5bd1e88c20223f449cf4ca9fc5
Jul 07 13:29:26.631174 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.631137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631790000" event={"ID":"9211a7ea-034e-4352-b327-4b804d645929","Type":"ContainerStarted","Data":"f149a90fa5652a9d7c01c16b76223edbe1754f5bd1e88c20223f449cf4ca9fc5"}
Jul 07 13:29:26.632463 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.632432    2580 scope.go:117] "RemoveContainer" containerID="abf215d1dfdf1def380e45fc841299aa19a3c39582ddadfbb471ab0de01b5e54"
Jul 07 13:29:26.632463 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:26.632457    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790144"
Jul 07 13:29:27.639724 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:27.639692    2580 generic.go:356] "Generic (PLEG): container finished" podID="9211a7ea-034e-4352-b327-4b804d645929" containerID="3fb00bb1d8c9d8644aa923f0e1622efec551a0e2e41d00b5295519569073a82d" exitCode=0
Jul 07 13:29:27.640162 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:27.639785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631790000" event={"ID":"9211a7ea-034e-4352-b327-4b804d645929","Type":"ContainerDied","Data":"3fb00bb1d8c9d8644aa923f0e1622efec551a0e2e41d00b5295519569073a82d"}
Jul 07 13:29:28.790697 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:28.790667    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:28.815738 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:28.815705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631790000_9211a7ea-034e-4352-b327-4b804d645929/test-curl-8212-140002631790000/0.log"
Jul 07 13:29:28.842480 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:28.842443    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631790000"]
Jul 07 13:29:28.846732 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:28.846704    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631790000"]
Jul 07 13:29:28.868354 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:28.868327    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnvtl\" (UniqueName: \"kubernetes.io/projected/9211a7ea-034e-4352-b327-4b804d645929-kube-api-access-mnvtl\") pod \"9211a7ea-034e-4352-b327-4b804d645929\" (UID: \"9211a7ea-034e-4352-b327-4b804d645929\") "
Jul 07 13:29:28.870393 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:28.870365    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9211a7ea-034e-4352-b327-4b804d645929-kube-api-access-mnvtl" (OuterVolumeSpecName: "kube-api-access-mnvtl") pod "9211a7ea-034e-4352-b327-4b804d645929" (UID: "9211a7ea-034e-4352-b327-4b804d645929"). InnerVolumeSpecName "kube-api-access-mnvtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:28.969427 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:28.969317    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnvtl\" (UniqueName: \"kubernetes.io/projected/9211a7ea-034e-4352-b327-4b804d645929-kube-api-access-mnvtl\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:29.001534 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.001478    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:29.001926 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.001909    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9211a7ea-034e-4352-b327-4b804d645929" containerName="test-curl-8212-140002631790000"
Jul 07 13:29:29.001926 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.001926    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9211a7ea-034e-4352-b327-4b804d645929" containerName="test-curl-8212-140002631790000"
Jul 07 13:29:29.002044 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.002009    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9211a7ea-034e-4352-b327-4b804d645929" containerName="test-curl-8212-140002631790000"
Jul 07 13:29:29.005059 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.005042    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:29.014427 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.014400    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:29.069997 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.069963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz98f\" (UniqueName: \"kubernetes.io/projected/b4113177-6384-4afd-8597-cac4eb7e2ef9-kube-api-access-cz98f\") pod \"test-curl-8212-140002631789136\" (UID: \"b4113177-6384-4afd-8597-cac4eb7e2ef9\") " pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:29.170640 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.170606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz98f\" (UniqueName: \"kubernetes.io/projected/b4113177-6384-4afd-8597-cac4eb7e2ef9-kube-api-access-cz98f\") pod \"test-curl-8212-140002631789136\" (UID: \"b4113177-6384-4afd-8597-cac4eb7e2ef9\") " pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:29.181233 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.181204    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz98f\" (UniqueName: \"kubernetes.io/projected/b4113177-6384-4afd-8597-cac4eb7e2ef9-kube-api-access-cz98f\") pod \"test-curl-8212-140002631789136\" (UID: \"b4113177-6384-4afd-8597-cac4eb7e2ef9\") " pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:29.315053 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.314952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:29.458312 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:29.458277    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4113177_6384_4afd_8597_cac4eb7e2ef9.slice/crio-6ea8cf6aa99c2611215df64d6c033273890f8efee5650f1dc7ee939a8ed349f0 WatchSource:0}: Error finding container 6ea8cf6aa99c2611215df64d6c033273890f8efee5650f1dc7ee939a8ed349f0: Status 404 returned error can't find the container with id 6ea8cf6aa99c2611215df64d6c033273890f8efee5650f1dc7ee939a8ed349f0
Jul 07 13:29:29.459159 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.459130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:29.654806 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.654765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631789136" event={"ID":"b4113177-6384-4afd-8597-cac4eb7e2ef9","Type":"ContainerStarted","Data":"6ea8cf6aa99c2611215df64d6c033273890f8efee5650f1dc7ee939a8ed349f0"}
Jul 07 13:29:29.656031 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.656013    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f149a90fa5652a9d7c01c16b76223edbe1754f5bd1e88c20223f449cf4ca9fc5"
Jul 07 13:29:29.656131 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:29.656045    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:29.666715 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:29.666688    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002631790000\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="9211a7ea-034e-4352-b327-4b804d645929" pod="opendatahub/test-curl-8212-140002631790000"
Jul 07 13:29:30.173413 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:30.173377    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9211a7ea-034e-4352-b327-4b804d645929" path="/var/lib/kubelet/pods/9211a7ea-034e-4352-b327-4b804d645929/volumes"
Jul 07 13:29:30.663941 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:30.663906    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4113177-6384-4afd-8597-cac4eb7e2ef9" containerID="612700d4ce55dcff6fa6404383b09eec812540e6b25fafaaf68864c59542b323" exitCode=0
Jul 07 13:29:30.664125 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:30.663988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631789136" event={"ID":"b4113177-6384-4afd-8597-cac4eb7e2ef9","Type":"ContainerDied","Data":"612700d4ce55dcff6fa6404383b09eec812540e6b25fafaaf68864c59542b323"}
Jul 07 13:29:31.817852 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.817686    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:31.838606 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.838575    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631789136_b4113177-6384-4afd-8597-cac4eb7e2ef9/test-curl-8212-140002631789136/0.log"
Jul 07 13:29:31.863307 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.863278    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:31.867378 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.867353    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:31.897726 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.897697    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz98f\" (UniqueName: \"kubernetes.io/projected/b4113177-6384-4afd-8597-cac4eb7e2ef9-kube-api-access-cz98f\") pod \"b4113177-6384-4afd-8597-cac4eb7e2ef9\" (UID: \"b4113177-6384-4afd-8597-cac4eb7e2ef9\") "
Jul 07 13:29:31.899720 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.899692    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4113177-6384-4afd-8597-cac4eb7e2ef9-kube-api-access-cz98f" (OuterVolumeSpecName: "kube-api-access-cz98f") pod "b4113177-6384-4afd-8597-cac4eb7e2ef9" (UID: "b4113177-6384-4afd-8597-cac4eb7e2ef9"). InnerVolumeSpecName "kube-api-access-cz98f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:31.996684 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.996590    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:31.997078 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.997063    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4113177-6384-4afd-8597-cac4eb7e2ef9" containerName="test-curl-8212-140002631789136"
Jul 07 13:29:31.997131 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.997080    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4113177-6384-4afd-8597-cac4eb7e2ef9" containerName="test-curl-8212-140002631789136"
Jul 07 13:29:31.997170 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.997155    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4113177-6384-4afd-8597-cac4eb7e2ef9" containerName="test-curl-8212-140002631789136"
Jul 07 13:29:31.999246 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:31.999224    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz98f\" (UniqueName: \"kubernetes.io/projected/b4113177-6384-4afd-8597-cac4eb7e2ef9-kube-api-access-cz98f\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:32.000448 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.000434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:32.006657 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.006625    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:32.099930 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.099898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc55g\" (UniqueName: \"kubernetes.io/projected/44275034-8057-4da5-94ec-65e354368581-kube-api-access-tc55g\") pod \"test-curl-8212-140002631789136\" (UID: \"44275034-8057-4da5-94ec-65e354368581\") " pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:32.173042 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.173011    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4113177-6384-4afd-8597-cac4eb7e2ef9" path="/var/lib/kubelet/pods/b4113177-6384-4afd-8597-cac4eb7e2ef9/volumes"
Jul 07 13:29:32.200653 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.200613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc55g\" (UniqueName: \"kubernetes.io/projected/44275034-8057-4da5-94ec-65e354368581-kube-api-access-tc55g\") pod \"test-curl-8212-140002631789136\" (UID: \"44275034-8057-4da5-94ec-65e354368581\") " pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:32.209361 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.209324    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc55g\" (UniqueName: \"kubernetes.io/projected/44275034-8057-4da5-94ec-65e354368581-kube-api-access-tc55g\") pod \"test-curl-8212-140002631789136\" (UID: \"44275034-8057-4da5-94ec-65e354368581\") " pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:32.310744 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.310656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:32.451280 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.451247    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:32.451972 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:32.451952    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44275034_8057_4da5_94ec_65e354368581.slice/crio-4da0f50181334bb1bd3d95d5793a2121235985245dda9b8846d8cecb2cf3eb75 WatchSource:0}: Error finding container 4da0f50181334bb1bd3d95d5793a2121235985245dda9b8846d8cecb2cf3eb75: Status 404 returned error can't find the container with id 4da0f50181334bb1bd3d95d5793a2121235985245dda9b8846d8cecb2cf3eb75
Jul 07 13:29:32.678624 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.678594    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:32.678624 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.678612    2580 scope.go:117] "RemoveContainer" containerID="612700d4ce55dcff6fa6404383b09eec812540e6b25fafaaf68864c59542b323"
Jul 07 13:29:32.679910 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:32.679884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631789136" event={"ID":"44275034-8057-4da5-94ec-65e354368581","Type":"ContainerStarted","Data":"4da0f50181334bb1bd3d95d5793a2121235985245dda9b8846d8cecb2cf3eb75"}
Jul 07 13:29:33.688388 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:33.688353    2580 generic.go:356] "Generic (PLEG): container finished" podID="44275034-8057-4da5-94ec-65e354368581" containerID="cd0d2f8ea013372af0e6f38b6f19613544ee69a9482d0bae8e32ed287d81f254" exitCode=0
Jul 07 13:29:33.688819 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:33.688442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631789136" event={"ID":"44275034-8057-4da5-94ec-65e354368581","Type":"ContainerDied","Data":"cd0d2f8ea013372af0e6f38b6f19613544ee69a9482d0bae8e32ed287d81f254"}
Jul 07 13:29:34.837020 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:34.836985    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:34.857427 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:34.857394    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631789136_44275034-8057-4da5-94ec-65e354368581/test-curl-8212-140002631789136/0.log"
Jul 07 13:29:34.881783 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:34.881751    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:34.885958 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:34.885934    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631789136"]
Jul 07 13:29:34.929782 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:34.929744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc55g\" (UniqueName: \"kubernetes.io/projected/44275034-8057-4da5-94ec-65e354368581-kube-api-access-tc55g\") pod \"44275034-8057-4da5-94ec-65e354368581\" (UID: \"44275034-8057-4da5-94ec-65e354368581\") "
Jul 07 13:29:34.931817 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:34.931794    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44275034-8057-4da5-94ec-65e354368581-kube-api-access-tc55g" (OuterVolumeSpecName: "kube-api-access-tc55g") pod "44275034-8057-4da5-94ec-65e354368581" (UID: "44275034-8057-4da5-94ec-65e354368581"). InnerVolumeSpecName "kube-api-access-tc55g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:35.017432 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.017346    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:35.017796 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.017782    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44275034-8057-4da5-94ec-65e354368581" containerName="test-curl-8212-140002631789136"
Jul 07 13:29:35.017842 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.017798    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="44275034-8057-4da5-94ec-65e354368581" containerName="test-curl-8212-140002631789136"
Jul 07 13:29:35.017875 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.017859    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="44275034-8057-4da5-94ec-65e354368581" containerName="test-curl-8212-140002631789136"
Jul 07 13:29:35.020981 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.020958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:35.026472 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.026446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:35.030993 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.030966    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc55g\" (UniqueName: \"kubernetes.io/projected/44275034-8057-4da5-94ec-65e354368581-kube-api-access-tc55g\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:35.131857 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.131819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4n2\" (UniqueName: \"kubernetes.io/projected/4764d914-b084-4808-ae68-0abced1eb084-kube-api-access-tx4n2\") pod \"test-curl-8212-140002631819744\" (UID: \"4764d914-b084-4808-ae68-0abced1eb084\") " pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:35.233227 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.233190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4n2\" (UniqueName: \"kubernetes.io/projected/4764d914-b084-4808-ae68-0abced1eb084-kube-api-access-tx4n2\") pod \"test-curl-8212-140002631819744\" (UID: \"4764d914-b084-4808-ae68-0abced1eb084\") " pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:35.241398 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.241373    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4n2\" (UniqueName: \"kubernetes.io/projected/4764d914-b084-4808-ae68-0abced1eb084-kube-api-access-tx4n2\") pod \"test-curl-8212-140002631819744\" (UID: \"4764d914-b084-4808-ae68-0abced1eb084\") " pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:35.332218 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.332116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:35.475085 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:35.475051    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4764d914_b084_4808_ae68_0abced1eb084.slice/crio-8654d926047e16af9e6e5c3a1662371af607943b76ee137f5f78cd94f9cdfb17 WatchSource:0}: Error finding container 8654d926047e16af9e6e5c3a1662371af607943b76ee137f5f78cd94f9cdfb17: Status 404 returned error can't find the container with id 8654d926047e16af9e6e5c3a1662371af607943b76ee137f5f78cd94f9cdfb17
Jul 07 13:29:35.475570 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.475537    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:35.700846 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.700814    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631819744" event={"ID":"4764d914-b084-4808-ae68-0abced1eb084","Type":"ContainerStarted","Data":"8654d926047e16af9e6e5c3a1662371af607943b76ee137f5f78cd94f9cdfb17"}
Jul 07 13:29:35.702075 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.702055    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4da0f50181334bb1bd3d95d5793a2121235985245dda9b8846d8cecb2cf3eb75"
Jul 07 13:29:35.702178 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:35.702104    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:35.712427 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:35.712402    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002631789136\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="44275034-8057-4da5-94ec-65e354368581" pod="opendatahub/test-curl-8212-140002631789136"
Jul 07 13:29:36.173169 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:36.173130    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44275034-8057-4da5-94ec-65e354368581" path="/var/lib/kubelet/pods/44275034-8057-4da5-94ec-65e354368581/volumes"
Jul 07 13:29:36.709842 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:36.709812    2580 generic.go:356] "Generic (PLEG): container finished" podID="4764d914-b084-4808-ae68-0abced1eb084" containerID="8b11f3f748484f7dde5e78cfa6ce3652e7c28292b673b1f09f06cae7f9cd219b" exitCode=0
Jul 07 13:29:36.710031 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:36.709849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631819744" event={"ID":"4764d914-b084-4808-ae68-0abced1eb084","Type":"ContainerDied","Data":"8b11f3f748484f7dde5e78cfa6ce3652e7c28292b673b1f09f06cae7f9cd219b"}
Jul 07 13:29:37.863236 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:37.863210    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:37.893780 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:37.893755    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631819744_4764d914-b084-4808-ae68-0abced1eb084/test-curl-8212-140002631819744/0.log"
Jul 07 13:29:37.923164 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:37.923131    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:37.926411 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:37.926384    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:37.958247 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:37.958209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx4n2\" (UniqueName: \"kubernetes.io/projected/4764d914-b084-4808-ae68-0abced1eb084-kube-api-access-tx4n2\") pod \"4764d914-b084-4808-ae68-0abced1eb084\" (UID: \"4764d914-b084-4808-ae68-0abced1eb084\") "
Jul 07 13:29:37.960415 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:37.960382    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4764d914-b084-4808-ae68-0abced1eb084-kube-api-access-tx4n2" (OuterVolumeSpecName: "kube-api-access-tx4n2") pod "4764d914-b084-4808-ae68-0abced1eb084" (UID: "4764d914-b084-4808-ae68-0abced1eb084"). InnerVolumeSpecName "kube-api-access-tx4n2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:38.059668 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.059637    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx4n2\" (UniqueName: \"kubernetes.io/projected/4764d914-b084-4808-ae68-0abced1eb084-kube-api-access-tx4n2\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:38.075059 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.075021    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:38.075440 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.075427    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4764d914-b084-4808-ae68-0abced1eb084" containerName="test-curl-8212-140002631819744"
Jul 07 13:29:38.075485 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.075441    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4764d914-b084-4808-ae68-0abced1eb084" containerName="test-curl-8212-140002631819744"
Jul 07 13:29:38.075553 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.075547    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4764d914-b084-4808-ae68-0abced1eb084" containerName="test-curl-8212-140002631819744"
Jul 07 13:29:38.079287 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.079270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:38.083801 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.083772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:38.160967 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.160927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kgw5\" (UniqueName: \"kubernetes.io/projected/3a3f6cbc-2ee9-4d01-b698-34eb4c263d26-kube-api-access-4kgw5\") pod \"test-curl-8212-140002631819744\" (UID: \"3a3f6cbc-2ee9-4d01-b698-34eb4c263d26\") " pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:38.173583 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.173548    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4764d914-b084-4808-ae68-0abced1eb084" path="/var/lib/kubelet/pods/4764d914-b084-4808-ae68-0abced1eb084/volumes"
Jul 07 13:29:38.262065 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.261975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kgw5\" (UniqueName: \"kubernetes.io/projected/3a3f6cbc-2ee9-4d01-b698-34eb4c263d26-kube-api-access-4kgw5\") pod \"test-curl-8212-140002631819744\" (UID: \"3a3f6cbc-2ee9-4d01-b698-34eb4c263d26\") " pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:38.271676 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.271640    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kgw5\" (UniqueName: \"kubernetes.io/projected/3a3f6cbc-2ee9-4d01-b698-34eb4c263d26-kube-api-access-4kgw5\") pod \"test-curl-8212-140002631819744\" (UID: \"3a3f6cbc-2ee9-4d01-b698-34eb4c263d26\") " pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:38.390359 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.390324    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:38.536975 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.536951    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:38.537751 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:38.537725    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a3f6cbc_2ee9_4d01_b698_34eb4c263d26.slice/crio-17a6089db51dcc01b55c7006682bd7ffb15072ff270c8d045e508c6002054da2 WatchSource:0}: Error finding container 17a6089db51dcc01b55c7006682bd7ffb15072ff270c8d045e508c6002054da2: Status 404 returned error can't find the container with id 17a6089db51dcc01b55c7006682bd7ffb15072ff270c8d045e508c6002054da2
Jul 07 13:29:38.722740 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.722704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631819744" event={"ID":"3a3f6cbc-2ee9-4d01-b698-34eb4c263d26","Type":"ContainerStarted","Data":"17a6089db51dcc01b55c7006682bd7ffb15072ff270c8d045e508c6002054da2"}
Jul 07 13:29:38.723929 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.723908    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:38.724040 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:38.723969    2580 scope.go:117] "RemoveContainer" containerID="8b11f3f748484f7dde5e78cfa6ce3652e7c28292b673b1f09f06cae7f9cd219b"
Jul 07 13:29:39.738262 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:39.738221    2580 generic.go:356] "Generic (PLEG): container finished" podID="3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" containerID="49c1c12757302196ce2d916358b40603b5acc66c54cc843b7e2054032e72fb83" exitCode=0
Jul 07 13:29:39.738790 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:39.738310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631819744" event={"ID":"3a3f6cbc-2ee9-4d01-b698-34eb4c263d26","Type":"ContainerDied","Data":"49c1c12757302196ce2d916358b40603b5acc66c54cc843b7e2054032e72fb83"}
Jul 07 13:29:40.887500 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:40.887472    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:40.916614 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:40.916585    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631819744_3a3f6cbc-2ee9-4d01-b698-34eb4c263d26/test-curl-8212-140002631819744/0.log"
Jul 07 13:29:40.946412 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:40.946382    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:40.948762 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:40.948738    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631819744"]
Jul 07 13:29:40.988786 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:40.988749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kgw5\" (UniqueName: \"kubernetes.io/projected/3a3f6cbc-2ee9-4d01-b698-34eb4c263d26-kube-api-access-4kgw5\") pod \"3a3f6cbc-2ee9-4d01-b698-34eb4c263d26\" (UID: \"3a3f6cbc-2ee9-4d01-b698-34eb4c263d26\") "
Jul 07 13:29:40.990846 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:40.990823    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3f6cbc-2ee9-4d01-b698-34eb4c263d26-kube-api-access-4kgw5" (OuterVolumeSpecName: "kube-api-access-4kgw5") pod "3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" (UID: "3a3f6cbc-2ee9-4d01-b698-34eb4c263d26"). InnerVolumeSpecName "kube-api-access-4kgw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:41.089481 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.089446    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kgw5\" (UniqueName: \"kubernetes.io/projected/3a3f6cbc-2ee9-4d01-b698-34eb4c263d26-kube-api-access-4kgw5\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:41.101569 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.101537    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631819600"]
Jul 07 13:29:41.101955 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.101941    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" containerName="test-curl-8212-140002631819744"
Jul 07 13:29:41.101998 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.101956    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" containerName="test-curl-8212-140002631819744"
Jul 07 13:29:41.102042 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.102033    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" containerName="test-curl-8212-140002631819744"
Jul 07 13:29:41.105010 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.104995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819600"
Jul 07 13:29:41.113796 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.113761    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631819600"]
Jul 07 13:29:41.190593 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.190559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h8sl\" (UniqueName: \"kubernetes.io/projected/4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f-kube-api-access-6h8sl\") pod \"test-curl-8212-140002631819600\" (UID: \"4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f\") " pod="opendatahub/test-curl-8212-140002631819600"
Jul 07 13:29:41.291703 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.291615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h8sl\" (UniqueName: \"kubernetes.io/projected/4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f-kube-api-access-6h8sl\") pod \"test-curl-8212-140002631819600\" (UID: \"4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f\") " pod="opendatahub/test-curl-8212-140002631819600"
Jul 07 13:29:41.301019 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.300999    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h8sl\" (UniqueName: \"kubernetes.io/projected/4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f-kube-api-access-6h8sl\") pod \"test-curl-8212-140002631819600\" (UID: \"4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f\") " pod="opendatahub/test-curl-8212-140002631819600"
Jul 07 13:29:41.415262 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.415225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819600"
Jul 07 13:29:41.562993 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.562912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631819600"]
Jul 07 13:29:41.566198 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:41.566175    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4daf6d02_dfb6_49c2_a2fb_9c6db8bd633f.slice/crio-14c19980edd6bcb63ef1e9878fee58f9efb65fd0d962cb4e4ddaaf70eb60f5a2 WatchSource:0}: Error finding container 14c19980edd6bcb63ef1e9878fee58f9efb65fd0d962cb4e4ddaaf70eb60f5a2: Status 404 returned error can't find the container with id 14c19980edd6bcb63ef1e9878fee58f9efb65fd0d962cb4e4ddaaf70eb60f5a2
Jul 07 13:29:41.752629 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.752596    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:41.752629 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.752624    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17a6089db51dcc01b55c7006682bd7ffb15072ff270c8d045e508c6002054da2"
Jul 07 13:29:41.753902 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:41.753871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631819600" event={"ID":"4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f","Type":"ContainerStarted","Data":"14c19980edd6bcb63ef1e9878fee58f9efb65fd0d962cb4e4ddaaf70eb60f5a2"}
Jul 07 13:29:41.763994 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:41.763969    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002631819744\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:42.173569 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:42.173535    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002631819744\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" pod="opendatahub/test-curl-8212-140002631819744"
Jul 07 13:29:42.174580 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:42.174559    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a3f6cbc-2ee9-4d01-b698-34eb4c263d26" path="/var/lib/kubelet/pods/3a3f6cbc-2ee9-4d01-b698-34eb4c263d26/volumes"
Jul 07 13:29:42.762081 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:42.762043    2580 generic.go:356] "Generic (PLEG): container finished" podID="4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f" containerID="b04fdc227a2777ebf7f5ab1312f2ae72d5255fe58c68abcad4dd63148c79d0f3" exitCode=0
Jul 07 13:29:42.762266 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:42.762126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631819600" event={"ID":"4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f","Type":"ContainerDied","Data":"b04fdc227a2777ebf7f5ab1312f2ae72d5255fe58c68abcad4dd63148c79d0f3"}
Jul 07 13:29:43.908107 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:43.908080    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819600"
Jul 07 13:29:43.938850 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:43.938820    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631819600_4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f/test-curl-8212-140002631819600/0.log"
Jul 07 13:29:43.966540 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:43.966488    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631819600"]
Jul 07 13:29:43.972273 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:43.972245    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631819600"]
Jul 07 13:29:44.018927 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.018856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h8sl\" (UniqueName: \"kubernetes.io/projected/4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f-kube-api-access-6h8sl\") pod \"4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f\" (UID: \"4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f\") "
Jul 07 13:29:44.020941 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.020915    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f-kube-api-access-6h8sl" (OuterVolumeSpecName: "kube-api-access-6h8sl") pod "4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f" (UID: "4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f"). InnerVolumeSpecName "kube-api-access-6h8sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:44.114400 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.114364    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8212-140002631820176"]
Jul 07 13:29:44.114871 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.114855    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f" containerName="test-curl-8212-140002631819600"
Jul 07 13:29:44.114926 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.114873    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f" containerName="test-curl-8212-140002631819600"
Jul 07 13:29:44.114962 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.114956    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f" containerName="test-curl-8212-140002631819600"
Jul 07 13:29:44.118048 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.118032    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:44.120578 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.120559    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h8sl\" (UniqueName: \"kubernetes.io/projected/4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f-kube-api-access-6h8sl\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:44.124713 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.124683    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631820176"]
Jul 07 13:29:44.182003 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.181968    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f" path="/var/lib/kubelet/pods/4daf6d02-dfb6-49c2-a2fb-9c6db8bd633f/volumes"
Jul 07 13:29:44.221924 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.221885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmtkt\" (UniqueName: \"kubernetes.io/projected/d4410ec2-3f33-4dce-a534-56d3860c4cd3-kube-api-access-zmtkt\") pod \"test-curl-8212-140002631820176\" (UID: \"d4410ec2-3f33-4dce-a534-56d3860c4cd3\") " pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:44.323023 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.322933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmtkt\" (UniqueName: \"kubernetes.io/projected/d4410ec2-3f33-4dce-a534-56d3860c4cd3-kube-api-access-zmtkt\") pod \"test-curl-8212-140002631820176\" (UID: \"d4410ec2-3f33-4dce-a534-56d3860c4cd3\") " pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:44.332091 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.332057    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmtkt\" (UniqueName: \"kubernetes.io/projected/d4410ec2-3f33-4dce-a534-56d3860c4cd3-kube-api-access-zmtkt\") pod \"test-curl-8212-140002631820176\" (UID: \"d4410ec2-3f33-4dce-a534-56d3860c4cd3\") " pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:44.428628 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.428596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:44.568930 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.568902    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8212-140002631820176"]
Jul 07 13:29:44.570076 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:29:44.570045    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4410ec2_3f33_4dce_a534_56d3860c4cd3.slice/crio-4f2203f3bca637e47b36c4e1468a0910aaf6b9881aaad29fffce6c3fc9641520 WatchSource:0}: Error finding container 4f2203f3bca637e47b36c4e1468a0910aaf6b9881aaad29fffce6c3fc9641520: Status 404 returned error can't find the container with id 4f2203f3bca637e47b36c4e1468a0910aaf6b9881aaad29fffce6c3fc9641520
Jul 07 13:29:44.775460 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.775431    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631819600"
Jul 07 13:29:44.775667 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.775436    2580 scope.go:117] "RemoveContainer" containerID="b04fdc227a2777ebf7f5ab1312f2ae72d5255fe58c68abcad4dd63148c79d0f3"
Jul 07 13:29:44.776847 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:44.776654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631820176" event={"ID":"d4410ec2-3f33-4dce-a534-56d3860c4cd3","Type":"ContainerStarted","Data":"4f2203f3bca637e47b36c4e1468a0910aaf6b9881aaad29fffce6c3fc9641520"}
Jul 07 13:29:45.783955 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:45.783916    2580 generic.go:356] "Generic (PLEG): container finished" podID="d4410ec2-3f33-4dce-a534-56d3860c4cd3" containerID="44c2d2e94f95c49d0fc138a60d939ce48e4c447992cabe8d46a0e8b73ed01fc3" exitCode=0
Jul 07 13:29:45.784352 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:45.784008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8212-140002631820176" event={"ID":"d4410ec2-3f33-4dce-a534-56d3860c4cd3","Type":"ContainerDied","Data":"44c2d2e94f95c49d0fc138a60d939ce48e4c447992cabe8d46a0e8b73ed01fc3"}
Jul 07 13:29:46.933340 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:46.933307    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:46.953636 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:46.953603    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8212-140002631820176_d4410ec2-3f33-4dce-a534-56d3860c4cd3/test-curl-8212-140002631820176/0.log"
Jul 07 13:29:46.980002 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:46.979965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8212-140002631820176"]
Jul 07 13:29:46.988716 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:46.988684    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8212-140002631820176"]
Jul 07 13:29:47.050062 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:47.049964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmtkt\" (UniqueName: \"kubernetes.io/projected/d4410ec2-3f33-4dce-a534-56d3860c4cd3-kube-api-access-zmtkt\") pod \"d4410ec2-3f33-4dce-a534-56d3860c4cd3\" (UID: \"d4410ec2-3f33-4dce-a534-56d3860c4cd3\") "
Jul 07 13:29:47.052120 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:47.052092    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4410ec2-3f33-4dce-a534-56d3860c4cd3-kube-api-access-zmtkt" (OuterVolumeSpecName: "kube-api-access-zmtkt") pod "d4410ec2-3f33-4dce-a534-56d3860c4cd3" (UID: "d4410ec2-3f33-4dce-a534-56d3860c4cd3"). InnerVolumeSpecName "kube-api-access-zmtkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 13:29:47.150976 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:47.150944    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmtkt\" (UniqueName: \"kubernetes.io/projected/d4410ec2-3f33-4dce-a534-56d3860c4cd3-kube-api-access-zmtkt\") on node \"ip-10-0-135-39.ec2.internal\" DevicePath \"\""
Jul 07 13:29:47.797495 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:47.797468    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f2203f3bca637e47b36c4e1468a0910aaf6b9881aaad29fffce6c3fc9641520"
Jul 07 13:29:47.797495 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:47.797469    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:47.807476 ip-10-0-135-39 kubenswrapper[2580]: E0707 13:29:47.807445    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8212-140002631820176\" is forbidden: User \"system:node:ip-10-0-135-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-39.ec2.internal' and this object" podUID="d4410ec2-3f33-4dce-a534-56d3860c4cd3" pod="opendatahub/test-curl-8212-140002631820176"
Jul 07 13:29:48.173111 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:29:48.173075    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4410ec2-3f33-4dce-a534-56d3860c4cd3" path="/var/lib/kubelet/pods/d4410ec2-3f33-4dce-a534-56d3860c4cd3/volumes"
Jul 07 13:30:07.912736 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:07.912695    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mf86z_5dd309ff-90e1-4443-96a2-7262a0e48539/manager/0.log"
Jul 07 13:30:08.041613 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:08.041583    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s9k92_7872cef6-9d09-4c83-a4eb-8caee18484e3/manager/0.log"
Jul 07 13:30:08.175798 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:08.175711    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7dd85fb775-8qkl2_3d04f2ad-75fc-48e9-829e-173787482b70/maas-api/0.log"
Jul 07 13:30:08.292263 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:08.292232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723820-24nzd_b3af30d7-5f79-4148-9aea-27be3fbb5c74/cleanup/0.log"
Jul 07 13:30:08.673430 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:08.673393    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85587bc48f-d4ff5_935ef09d-ec16-4b2f-953d-0cf65da2f4dc/manager/0.log"
Jul 07 13:30:08.804441 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:08.804413    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xbqh6_1f39845f-3c61-4a75-8dfe-0b3d6416f43a/server/0.log"
Jul 07 13:30:08.934966 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:08.934873    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f2jdg_08d1da7e-db0c-4fa6-9958-bb2ca1171378/manager/0.log"
Jul 07 13:30:09.200824 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:09.200743    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-mth9t_c430c94d-a536-458d-b3ae-0fd460749c8d/copy-manifests/0.log"
Jul 07 13:30:09.208892 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:09.208870    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-mth9t_c430c94d-a536-458d-b3ae-0fd460749c8d/manager/0.log"
Jul 07 13:30:09.469079 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:09.468993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lxlcc_4afa8320-28e9-43cf-b4ce-5a15a32f1552/postgres/0.log"
Jul 07 13:30:11.359826 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.359789    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s_323a3974-b009-4aed-96ba-779ada503712/pull/0.log"
Jul 07 13:30:11.367465 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.367432    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s_323a3974-b009-4aed-96ba-779ada503712/extract/0.log"
Jul 07 13:30:11.374968 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.374946    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s_323a3974-b009-4aed-96ba-779ada503712/util/0.log"
Jul 07 13:30:11.510032 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.510002    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj_e2d7319f-4b02-4329-a8bf-689cc1f75e54/util/0.log"
Jul 07 13:30:11.525547 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.525516    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj_e2d7319f-4b02-4329-a8bf-689cc1f75e54/pull/0.log"
Jul 07 13:30:11.533424 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.533399    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj_e2d7319f-4b02-4329-a8bf-689cc1f75e54/extract/0.log"
Jul 07 13:30:11.659067 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.659039    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4_1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad/util/0.log"
Jul 07 13:30:11.668246 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.668217    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4_1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad/pull/0.log"
Jul 07 13:30:11.678668 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.678638    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4_1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad/extract/0.log"
Jul 07 13:30:11.803760 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.803729    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886_60de5b33-ec77-493d-96fb-4234fe81197b/pull/0.log"
Jul 07 13:30:11.812358 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.812296    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886_60de5b33-ec77-493d-96fb-4234fe81197b/extract/0.log"
Jul 07 13:30:11.818594 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:11.818575    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886_60de5b33-ec77-493d-96fb-4234fe81197b/util/0.log"
Jul 07 13:30:12.108057 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:12.107956    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bv9hx_9963014e-3b88-4361-a435-2a6c43205834/manager/0.log"
Jul 07 13:30:12.235571 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:12.235541    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mgkqq_9cb66e38-cdd4-4df1-bb34-79c29ad40657/manager/0.log"
Jul 07 13:30:12.372317 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:12.372227    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9tmnb_65f0089e-dc60-41d2-8a58-ef61b3429400/kuadrant-console-plugin/0.log"
Jul 07 13:30:12.511579 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:12.511534    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hql5t_2e7323d7-fe70-42d7-af3b-3c947eca59c1/registry-server/0.log"
Jul 07 13:30:12.665454 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:12.665421    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q5m4d_4bfa2367-0675-48ed-86c1-298429dd4cdc/manager/0.log"
Jul 07 13:30:12.936104 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:12.935992    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n469c_a96e730d-68e5-4430-9381-07513dc0bdac/manager/0.log"
Jul 07 13:30:13.564939 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:13.564910    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677fdffd75-27hnl_ebd638d4-d966-4d0d-a7d3-2d20ba15cd95/kube-auth-proxy/0.log"
Jul 07 13:30:13.982911 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:13.982877    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fzm8x_787ebaa4-510d-45a0-829b-b80249785ebb/payload-pre-processing/0.log"
Jul 07 13:30:14.124193 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:14.124157    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sbpvm_fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8/payload-processing/0.log"
Jul 07 13:30:14.656711 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:14.656685    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gcttf_af57a018-5ef8-4c8a-9494-72ea2654fe48/main/0.log"
Jul 07 13:30:14.779934 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:14.779889    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-t2vmw_f1a074fa-a1ed-43b0-922d-e6b2c751a96e/main/0.log"
Jul 07 13:30:15.041439 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:15.041330    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbl55mf_526bb322-a40c-402f-93b3-42bbb88fc1c1/main/0.log"
Jul 07 13:30:15.286756 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:15.286725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bp2gg_00b86821-6c7f-4d40-9fef-10cb9309a21c/main/0.log"
Jul 07 13:30:19.679553 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.679519    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kfwnx/must-gather-v9tsd"]
Jul 07 13:30:19.680205 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.680186    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4410ec2-3f33-4dce-a534-56d3860c4cd3" containerName="test-curl-8212-140002631820176"
Jul 07 13:30:19.680249 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.680208    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4410ec2-3f33-4dce-a534-56d3860c4cd3" containerName="test-curl-8212-140002631820176"
Jul 07 13:30:19.680331 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.680318    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4410ec2-3f33-4dce-a534-56d3860c4cd3" containerName="test-curl-8212-140002631820176"
Jul 07 13:30:19.684315 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.684295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:19.691524 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.691396    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kfwnx\"/\"kube-root-ca.crt\""
Jul 07 13:30:19.691876 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.691854    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kfwnx\"/\"openshift-service-ca.crt\""
Jul 07 13:30:19.691995 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.691889    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kfwnx\"/\"default-dockercfg-kcgqp\""
Jul 07 13:30:19.709645 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.709608    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfwnx/must-gather-v9tsd"]
Jul 07 13:30:19.765402 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.765366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnz4f\" (UniqueName: \"kubernetes.io/projected/4aca12db-5072-4757-9b7f-9cbc7786d44a-kube-api-access-hnz4f\") pod \"must-gather-v9tsd\" (UID: \"4aca12db-5072-4757-9b7f-9cbc7786d44a\") " pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:19.765600 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.765484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4aca12db-5072-4757-9b7f-9cbc7786d44a-must-gather-output\") pod \"must-gather-v9tsd\" (UID: \"4aca12db-5072-4757-9b7f-9cbc7786d44a\") " pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:19.866716 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.866675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4aca12db-5072-4757-9b7f-9cbc7786d44a-must-gather-output\") pod \"must-gather-v9tsd\" (UID: \"4aca12db-5072-4757-9b7f-9cbc7786d44a\") " pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:19.866921 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.866740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnz4f\" (UniqueName: \"kubernetes.io/projected/4aca12db-5072-4757-9b7f-9cbc7786d44a-kube-api-access-hnz4f\") pod \"must-gather-v9tsd\" (UID: \"4aca12db-5072-4757-9b7f-9cbc7786d44a\") " pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:19.867091 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.867064    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4aca12db-5072-4757-9b7f-9cbc7786d44a-must-gather-output\") pod \"must-gather-v9tsd\" (UID: \"4aca12db-5072-4757-9b7f-9cbc7786d44a\") " pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:19.878123 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.878084    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnz4f\" (UniqueName: \"kubernetes.io/projected/4aca12db-5072-4757-9b7f-9cbc7786d44a-kube-api-access-hnz4f\") pod \"must-gather-v9tsd\" (UID: \"4aca12db-5072-4757-9b7f-9cbc7786d44a\") " pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:19.994708 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:19.994607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfwnx/must-gather-v9tsd"
Jul 07 13:30:20.136061 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:20.136032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfwnx/must-gather-v9tsd"]
Jul 07 13:30:20.138142 ip-10-0-135-39 kubenswrapper[2580]: W0707 13:30:20.138115    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aca12db_5072_4757_9b7f_9cbc7786d44a.slice/crio-18f90a2790780286691374f5be0f6983595648d7f511fc700479a6094d5df688 WatchSource:0}: Error finding container 18f90a2790780286691374f5be0f6983595648d7f511fc700479a6094d5df688: Status 404 returned error can't find the container with id 18f90a2790780286691374f5be0f6983595648d7f511fc700479a6094d5df688
Jul 07 13:30:21.013071 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:21.012831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfwnx/must-gather-v9tsd" event={"ID":"4aca12db-5072-4757-9b7f-9cbc7786d44a","Type":"ContainerStarted","Data":"d4b276284a5bdb7b0d07787e3d9b0f70e8be7e47f64b859435c8da6b6d218a1e"}
Jul 07 13:30:21.013071 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:21.012885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfwnx/must-gather-v9tsd" event={"ID":"4aca12db-5072-4757-9b7f-9cbc7786d44a","Type":"ContainerStarted","Data":"18f90a2790780286691374f5be0f6983595648d7f511fc700479a6094d5df688"}
Jul 07 13:30:22.037186 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:22.036766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfwnx/must-gather-v9tsd" event={"ID":"4aca12db-5072-4757-9b7f-9cbc7786d44a","Type":"ContainerStarted","Data":"15b754263ff2aa0f9f3e4a2eb2080dc549811cc9eabe1a81167aa10f6fef901c"}
Jul 07 13:30:22.056942 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:22.056868    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kfwnx/must-gather-v9tsd" podStartSLOduration=2.323523969 podStartE2EDuration="3.056848863s" totalImagesPullingTime="733.324894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:30:22.056166383 +0000 UTC m=+2510.319342857" watchObservedRunningTime="2026-07-07 13:30:22.056848863 +0000 UTC m=+2510.320025340"
Jul 07 13:30:22.525067 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:22.525031    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9xmgq_5d294dbc-5492-4102-925c-0920e7d8715c/global-pull-secret-syncer/0.log"
Jul 07 13:30:22.789404 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:22.789312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vglnc_f001bf42-0efc-422c-a15d-2944de740776/konnectivity-agent/0.log"
Jul 07 13:30:22.848874 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:22.848842    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-39.ec2.internal_f56b37d7e2e421e49f960418acbfc2d5/haproxy/0.log"
Jul 07 13:30:27.258366 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.258209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s_323a3974-b009-4aed-96ba-779ada503712/extract/0.log"
Jul 07 13:30:27.291094 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.291059    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s_323a3974-b009-4aed-96ba-779ada503712/util/0.log"
Jul 07 13:30:27.317492 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.317418    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fz29s_323a3974-b009-4aed-96ba-779ada503712/pull/0.log"
Jul 07 13:30:27.349466 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.349406    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj_e2d7319f-4b02-4329-a8bf-689cc1f75e54/extract/0.log"
Jul 07 13:30:27.391063 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.391029    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj_e2d7319f-4b02-4329-a8bf-689cc1f75e54/util/0.log"
Jul 07 13:30:27.420218 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.420184    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e084pvj_e2d7319f-4b02-4329-a8bf-689cc1f75e54/pull/0.log"
Jul 07 13:30:27.454437 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.454403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4_1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad/extract/0.log"
Jul 07 13:30:27.486097 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.486064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4_1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad/util/0.log"
Jul 07 13:30:27.527147 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.526928    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qskm4_1f2a10c7-a96c-49a5-a3c5-0b47b1d9ffad/pull/0.log"
Jul 07 13:30:27.566689 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.566656    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886_60de5b33-ec77-493d-96fb-4234fe81197b/extract/0.log"
Jul 07 13:30:27.615145 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.615097    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886_60de5b33-ec77-493d-96fb-4234fe81197b/util/0.log"
Jul 07 13:30:27.668157 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:27.667730    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t4886_60de5b33-ec77-493d-96fb-4234fe81197b/pull/0.log"
Jul 07 13:30:28.032352 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:28.032310    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bv9hx_9963014e-3b88-4361-a435-2a6c43205834/manager/0.log"
Jul 07 13:30:28.063798 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:28.063765    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mgkqq_9cb66e38-cdd4-4df1-bb34-79c29ad40657/manager/0.log"
Jul 07 13:30:28.092293 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:28.092260    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9tmnb_65f0089e-dc60-41d2-8a58-ef61b3429400/kuadrant-console-plugin/0.log"
Jul 07 13:30:28.141200 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:28.141150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hql5t_2e7323d7-fe70-42d7-af3b-3c947eca59c1/registry-server/0.log"
Jul 07 13:30:28.301581 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:28.297836    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q5m4d_4bfa2367-0675-48ed-86c1-298429dd4cdc/manager/0.log"
Jul 07 13:30:28.452570 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:28.452531    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n469c_a96e730d-68e5-4430-9381-07513dc0bdac/manager/0.log"
Jul 07 13:30:30.496290 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.496248    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-thgh5_cb46ce5b-8153-47d7-9492-ef7f3e49afdc/kube-state-metrics/0.log"
Jul 07 13:30:30.525211 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.525181    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-thgh5_cb46ce5b-8153-47d7-9492-ef7f3e49afdc/kube-rbac-proxy-main/0.log"
Jul 07 13:30:30.550697 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.550550    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-thgh5_cb46ce5b-8153-47d7-9492-ef7f3e49afdc/kube-rbac-proxy-self/0.log"
Jul 07 13:30:30.582796 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.582768    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-659c6f478b-8djcx_876d0840-c024-4524-9f3a-c3c96d4f32ff/metrics-server/0.log"
Jul 07 13:30:30.616609 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.616578    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-888mx_b2eca0ba-f989-4983-ab6a-6163b6f4da24/monitoring-plugin/0.log"
Jul 07 13:30:30.656643 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.656607    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ncl78_dab55708-4582-42f7-8a56-4e44eb93ba79/node-exporter/0.log"
Jul 07 13:30:30.683373 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.683345    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ncl78_dab55708-4582-42f7-8a56-4e44eb93ba79/kube-rbac-proxy/0.log"
Jul 07 13:30:30.712199 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:30.712156    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ncl78_dab55708-4582-42f7-8a56-4e44eb93ba79/init-textfile/0.log"
Jul 07 13:30:31.346088 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:31.346004    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-flwwm_4675dd23-eae5-44dc-abe1-96ddf6a55c07/prometheus-operator-admission-webhook/0.log"
Jul 07 13:30:31.378055 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:31.377927    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74db64d585-q8mhq_68969550-028d-4845-80b4-0fc62ea6e0a3/telemeter-client/0.log"
Jul 07 13:30:31.401222 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:31.401186    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74db64d585-q8mhq_68969550-028d-4845-80b4-0fc62ea6e0a3/reload/0.log"
Jul 07 13:30:31.423890 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:31.423860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74db64d585-q8mhq_68969550-028d-4845-80b4-0fc62ea6e0a3/kube-rbac-proxy/0.log"
Jul 07 13:30:33.070439 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.070399    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"]
Jul 07 13:30:33.076212 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.076181    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.083368 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.083338    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"]
Jul 07 13:30:33.220995 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.220939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-proc\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.220995 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.220996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-lib-modules\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.221258 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.221075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-podres\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.221258 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.221121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-sys\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.221258 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.221159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghqn7\" (UniqueName: \"kubernetes.io/projected/52f2688e-d576-4d0e-980c-cdee4dab70d9-kube-api-access-ghqn7\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322220 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-sys\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322220 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghqn7\" (UniqueName: \"kubernetes.io/projected/52f2688e-d576-4d0e-980c-cdee4dab70d9-kube-api-access-ghqn7\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322452 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-proc\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322452 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322281    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-sys\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322452 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-lib-modules\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322452 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-podres\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322452 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322428    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-lib-modules\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322452 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322436    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-proc\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.322696 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.322564    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52f2688e-d576-4d0e-980c-cdee4dab70d9-podres\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.332579 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.332548    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghqn7\" (UniqueName: \"kubernetes.io/projected/52f2688e-d576-4d0e-980c-cdee4dab70d9-kube-api-access-ghqn7\") pod \"perf-node-gather-daemonset-rrk6p\" (UID: \"52f2688e-d576-4d0e-980c-cdee4dab70d9\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.389566 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.389528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:33.573133 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:33.573101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"]
Jul 07 13:30:34.013958 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:34.013913    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55bddc7476-86vvj_1f05bc7d-697d-454a-85a1-597fd3302233/console/0.log"
Jul 07 13:30:34.148866 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:34.148822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p" event={"ID":"52f2688e-d576-4d0e-980c-cdee4dab70d9","Type":"ContainerStarted","Data":"0c524a63263c8c04fa4382c237b4ccbf4a1799053e3bdba2c8f07312695c20b2"}
Jul 07 13:30:34.149384 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:34.148891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p" event={"ID":"52f2688e-d576-4d0e-980c-cdee4dab70d9","Type":"ContainerStarted","Data":"35f8b1d8b14b1eafea7830f383022a1a87820b82cdf102f51c757e7b3315d625"}
Jul 07 13:30:34.149798 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:34.149771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:34.173074 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:34.173017    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p" podStartSLOduration=1.173000268 podStartE2EDuration="1.173000268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:30:34.170305989 +0000 UTC m=+2522.433482463" watchObservedRunningTime="2026-07-07 13:30:34.173000268 +0000 UTC m=+2522.436176739"
Jul 07 13:30:35.791346 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:35.791318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-488bd_cca2606f-d189-4b3d-aa4c-9c6c5d20b14b/dns/0.log"
Jul 07 13:30:35.818418 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:35.818391    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-488bd_cca2606f-d189-4b3d-aa4c-9c6c5d20b14b/kube-rbac-proxy/0.log"
Jul 07 13:30:35.990358 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:35.990328    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v2gz8_ec2ba82d-b5a5-4bc9-9c72-2f953aba2a89/dns-node-resolver/0.log"
Jul 07 13:30:36.640624 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:36.640589    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d75c4c488-zpqc2_b66dd520-9208-4735-ab28-d20b99120daf/registry/0.log"
Jul 07 13:30:36.760891 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:36.760860    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p5687_446d8898-d9f8-461a-862d-13ab70b2606b/node-ca/0.log"
Jul 07 13:30:37.991317 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:37.991282    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677fdffd75-27hnl_ebd638d4-d966-4d0d-a7d3-2d20ba15cd95/kube-auth-proxy/0.log"
Jul 07 13:30:38.200807 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:38.200774    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fzm8x_787ebaa4-510d-45a0-829b-b80249785ebb/payload-pre-processing/0.log"
Jul 07 13:30:38.285031 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:38.284923    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sbpvm_fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8/payload-processing/0.log"
Jul 07 13:30:39.085926 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:39.085889    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dzrbn_509b383c-7239-400e-b928-6f56b9127712/serve-healthcheck-canary/0.log"
Jul 07 13:30:39.838753 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:39.838719    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stxz4_229a5731-4cf3-4d59-95c4-82c25afa469b/kube-rbac-proxy/0.log"
Jul 07 13:30:39.861865 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:39.861825    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stxz4_229a5731-4cf3-4d59-95c4-82c25afa469b/exporter/0.log"
Jul 07 13:30:39.887130 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:39.887099    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stxz4_229a5731-4cf3-4d59-95c4-82c25afa469b/extractor/0.log"
Jul 07 13:30:41.171849 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:41.171818    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-rrk6p"
Jul 07 13:30:42.278461 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:42.278416    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mf86z_5dd309ff-90e1-4443-96a2-7262a0e48539/manager/0.log"
Jul 07 13:30:42.516171 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:42.514642    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s9k92_7872cef6-9d09-4c83-a4eb-8caee18484e3/manager/0.log"
Jul 07 13:30:42.597544 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:42.597219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7dd85fb775-8qkl2_3d04f2ad-75fc-48e9-829e-173787482b70/maas-api/0.log"
Jul 07 13:30:42.644263 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:42.644234    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723820-24nzd_b3af30d7-5f79-4148-9aea-27be3fbb5c74/cleanup/0.log"
Jul 07 13:30:43.024732 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.024640    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85587bc48f-d4ff5_935ef09d-ec16-4b2f-953d-0cf65da2f4dc/manager/0.log"
Jul 07 13:30:43.058988 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.058960    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xbqh6_1f39845f-3c61-4a75-8dfe-0b3d6416f43a/server/0.log"
Jul 07 13:30:43.193871 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.193834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f2jdg_08d1da7e-db0c-4fa6-9958-bb2ca1171378/manager/0.log"
Jul 07 13:30:43.387952 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.387925    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-mth9t_c430c94d-a536-458d-b3ae-0fd460749c8d/manager/0.log"
Jul 07 13:30:43.433410 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.433312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-mth9t_c430c94d-a536-458d-b3ae-0fd460749c8d/copy-manifests/0.log"
Jul 07 13:30:43.543250 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.543228    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lxlcc_4afa8320-28e9-43cf-b4ce-5a15a32f1552/postgres/0.log"
Jul 07 13:30:43.783550 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.783520    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677fdffd75-27hnl_ebd638d4-d966-4d0d-a7d3-2d20ba15cd95/kube-auth-proxy/0.log"
Jul 07 13:30:43.924003 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:43.923964    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fzm8x_787ebaa4-510d-45a0-829b-b80249785ebb/payload-pre-processing/0.log"
Jul 07 13:30:44.004216 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:44.004182    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sbpvm_fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8/payload-processing/0.log"
Jul 07 13:30:45.359821 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:45.359793    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677fdffd75-27hnl_ebd638d4-d966-4d0d-a7d3-2d20ba15cd95/kube-auth-proxy/0.log"
Jul 07 13:30:45.477441 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:45.477406    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-fzm8x_787ebaa4-510d-45a0-829b-b80249785ebb/payload-pre-processing/0.log"
Jul 07 13:30:45.538718 ip-10-0-135-39 kubenswrapper[2580]: I0707 13:30:45.538689    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-sbpvm_fb6a8f9a-f4a4-461a-946f-e0d8a1ff14f8/payload-processing/0.log"