Jul 07 21:58:39.301660 ip-10-0-128-35 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 21:58:39.693701 ip-10-0-128-35 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 21:58:39.693701 ip-10-0-128-35 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 21:58:39.693701 ip-10-0-128-35 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 21:58:39.693701 ip-10-0-128-35 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 21:58:39.693701 ip-10-0-128-35 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 21:58:39.694699 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.694563    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 21:58:39.699634 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699618    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 21:58:39.699634 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699634    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699638    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699643    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699645    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699649    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699652    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699654    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699659    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699663    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699666    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699668    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699671    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699675    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699678    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699681    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699684    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699686    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699691    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 21:58:39.699702 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699699    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699702    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699705    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699707    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699710    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699713    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699715    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699718    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699720    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699723    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699725    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699728    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699730    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699733    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699735    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699739    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699742    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699744    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699747    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699749    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 21:58:39.700139 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699752    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699755    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699757    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699759    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699762    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699764    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699766    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699769    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699771    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699774    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699778    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699782    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699785    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699788    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699791    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699794    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699796    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699799    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699802    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699804    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 21:58:39.700677 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699807    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699810    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699813    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699815    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699818    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699820    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699822    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699825    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699827    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699830    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699832    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699835    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699838    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699840    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699843    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699845    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699848    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699850    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699853    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699855    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 21:58:39.701158 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699858    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699860    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699863    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699866    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699868    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699871    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699874    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699877    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699880    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699882    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699885    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699887    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699890    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699892    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699895    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699897    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699899    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699902    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699904    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.699908    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 21:58:39.701662 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700664    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700671    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700675    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700680    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700683    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700686    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700689    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700692    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700695    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700698    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700701    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700703    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700706    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700709    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700711    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700714    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700716    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700719    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700722    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700724    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 21:58:39.702141 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700727    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700729    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700732    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700734    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700738    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700742    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700745    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700748    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700750    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700754    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700757    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700760    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700763    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700766    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700768    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700772    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700774    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700777    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700780    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 21:58:39.702647 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700782    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700785    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700788    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700791    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700795    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700797    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700800    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700802    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700805    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700808    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700810    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700813    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700815    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700818    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700820    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700823    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700826    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700828    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700831    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700834    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 21:58:39.703150 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700836    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700839    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700841    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700844    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700846    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700849    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700851    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700854    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700857    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700859    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700862    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700864    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700868    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700871    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700876    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700879    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700883    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700886    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700889    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 21:58:39.703653 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700892    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700895    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700897    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700900    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700903    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700905    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700908    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700910    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700913    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700915    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700918    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700920    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700923    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700925    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700928    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700930    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700933    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700936    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700939    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700941    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 21:58:39.704116 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.700944    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701384    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701391    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701394    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701396    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701400    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701403    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701408    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701410    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701414    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701416    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701419    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701421    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701424    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701426    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701429    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701431    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701434    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701436    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701439    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 21:58:39.704624 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701441    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701444    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701446    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701449    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701452    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701454    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701457    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701459    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701462    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701464    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701466    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701470    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701473    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701477    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701480    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701482    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701484    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701487    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701490    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701494    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 21:58:39.705117 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701496    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701499    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701501    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701504    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701506    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701509    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701511    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701514    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701516    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701519    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701521    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701524    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701527    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701529    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701532    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701534    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701540    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701543    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701546    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 21:58:39.705618 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701549    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701552    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701554    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701557    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701560    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701562    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701566    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701568    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701571    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701574    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701576    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701579    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701584    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701587    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701590    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701592    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701595    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701597    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701600    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701602    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 21:58:39.706144 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701605    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701608    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701610    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701612    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701616    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701618    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701621    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701623    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701626    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701629    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701633    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701636    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701639    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701642    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701644    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701647    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701650    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701653    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701657    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701659    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 21:58:39.706644 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.701662    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701738    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701744    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701753    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701760    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701767    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701771    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701778    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701784    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701787    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701790    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701793    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701797    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701800    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701803    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701805    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701808    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701811    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701813    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701817    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701820    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701823    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701826    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701829    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 21:58:39.707127 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701833    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701835    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701838    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701842    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701845    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701847    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701851    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701854    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701856    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701860    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701863    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701867    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701870    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701873    2567 flags.go:64] FLAG: --enable-server="true"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701877    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701881    2567 flags.go:64] FLAG: --event-burst="100"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701884    2567 flags.go:64] FLAG: --event-qps="50"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701887    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701890    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701893    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701897    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701900    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701903    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701906    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701909    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 21:58:39.707714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701912    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701914    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701917    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701920    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701923    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701925    2567 flags.go:64] FLAG: --feature-gates=""
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701929    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701932    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701935    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701938    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701941    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701944    2567 flags.go:64] FLAG: --help="false"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701947    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-128-35.ec2.internal"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701950    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701953    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701956    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701959    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701963    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701966    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701968    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701971    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701974    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701977    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701980    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 21:58:39.708387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701983    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701986    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701989    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701991    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701994    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.701997    2567 flags.go:64] FLAG: --lock-file=""
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702000    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702002    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702005    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702010    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702013    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702016    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702018    2567 flags.go:64] FLAG: --logging-format="text"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702021    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702024    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702027    2567 flags.go:64] FLAG: --manifest-url=""
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702030    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702034    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702037    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702041    2567 flags.go:64] FLAG: --max-pods="110"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702044    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702048    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702050    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702053    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702056    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 21:58:39.708975 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702059    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702062    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702069    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702072    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702075    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702078    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702081    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702086    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702089    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702092    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702095    2567 flags.go:64] FLAG: --port="10250"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702098    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702101    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-003ed25fc3b106692"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702104    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702107    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702110    2567 flags.go:64] FLAG: --register-node="true"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702112    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702116    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702118    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702121    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702124    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702127    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702130    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702133    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702136    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 21:58:39.709623 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702138    2567 flags.go:64] FLAG: --runonce="false"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702141    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702145    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702148    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702151    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702153    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702158    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702161    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702164    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702167    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702170    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702172    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702175    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702178    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702182    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702184    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702189    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702192    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702195    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702199    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702202    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702204    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702207    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702210    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702213    2567 flags.go:64] FLAG: --v="2"
Jul 07 21:58:39.710227 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702216    2567 flags.go:64] FLAG: --version="false"
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702220    2567 flags.go:64] FLAG: --vmodule=""
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702224    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.702227    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702359    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702363    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702366    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702369    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702372    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702375    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702379    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702382    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702384    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702388    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702391    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702394    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702397    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702399    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702402    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702404    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 21:58:39.710847 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702407    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702409    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702414    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702417    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702420    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702423    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702426    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702429    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702431    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702434    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702436    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702439    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702441    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702444    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702446    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702449    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702451    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702454    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702456    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 21:58:39.711331 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702459    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702461    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702464    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702469    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702471    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702474    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702478    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702480    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702483    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702486    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702488    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702491    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702493    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702496    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702498    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702501    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702504    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702506    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702508    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702511    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 21:58:39.711818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702513    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702516    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702518    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702521    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702523    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702527    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702530    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702533    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702536    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702538    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702541    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702543    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702545    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702549    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702553    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702557    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702560    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702563    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702567    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 21:58:39.712338 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702570    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702572    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702575    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702578    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702581    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702584    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702586    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702589    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702591    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702594    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702597    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702600    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702602    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702605    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702608    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702610    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702613    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702615    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702618    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702620    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 21:58:39.712818 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702623    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702625    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702628    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702630    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.702633    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.703156    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.709986    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.710000    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.710016    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.710021    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710078    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710083    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710087    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710089    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 21:58:39.713291 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710093    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710095    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710098    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710101    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710103    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710106    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710109    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710111    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710115    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710119    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710122    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710125    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710127    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710130    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710133    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710135    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710138    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710140    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710143    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 21:58:39.713709 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710145    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710149    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710152    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710156    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710160    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710163    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710167    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710170    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710173    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710176    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710179    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710182    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710184    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710187    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710189    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710192    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710194    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710197    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710199    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 21:58:39.714161 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710202    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710204    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710207    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710209    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710212    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710214    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710217    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710219    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710222    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710225    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710227    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710230    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710233    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710235    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710238    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710240    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710243    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710246    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710248    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710252    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 21:58:39.714645 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710255    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710258    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710260    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710263    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710265    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710268    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710271    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710273    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710275    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710278    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710281    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710283    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710286    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710288    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710290    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710293    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710296    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710298    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710300    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710303    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 21:58:39.715123 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710306    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710309    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710311    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710314    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710316    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710318    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710321    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710323    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710325    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710328    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710330    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710333    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710336    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710340    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710357    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710360    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 21:58:39.715666 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710363    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.710368    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710486    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710491    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710494    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710497    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710500    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710502    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710505    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710508    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710511    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710513    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710515    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710518    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710520    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 21:58:39.716060 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710523    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710526    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710528    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710531    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710533    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710536    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710538    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710541    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710543    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710546    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710548    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710551    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710555    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710558    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710562    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710566    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710569    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710572    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 21:58:39.716435 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710576    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710579    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710581    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710584    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710587    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710589    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710592    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710595    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710598    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710600    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710603    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710606    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710609    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710612    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710615    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710617    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710620    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710623    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710625    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710628    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 21:58:39.716880 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710631    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710633    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710637    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710639    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710642    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710645    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710648    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710651    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710653    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710656    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710660    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710662    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710665    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710667    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710670    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710673    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710675    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710678    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710681    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710683    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 21:58:39.717368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710686    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710689    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710691    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710694    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710697    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710699    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710702    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710705    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710707    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710710    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710712    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710715    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710717    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710719    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710722    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710725    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710727    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710730    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710732    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710735    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 21:58:39.717871 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710737    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710740    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710742    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710745    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710748    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710750    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710753    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:39.710755    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.710760    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.710885    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.712902    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.714455    2567 server.go:1019] "Starting client certificate rotation"
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.714558    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.715245    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 21:58:39.718368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.717111    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 21:58:39.720164 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.718240    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 21:58:39.732390 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.732370    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 07 21:58:39.734622 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.734608    2567 log.go:25] "Validated CRI v1 image API"
Jul 07 21:58:39.735486 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.735455    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 21:58:39.738073 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.738049    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bd4b0afc-655a-43c3-b521-907f30626dba:/dev/nvme0n1p4 e5bd13fd-27ea-4aac-b7fd-c92ce137a338:/dev/nvme0n1p3]
Jul 07 21:58:39.738129 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.738074    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 21:58:39.744016 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.743911    2567 manager.go:216] Machine: {Timestamp:2026-07-07 21:58:39.742753702 +0000 UTC m=+0.327157462 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088845 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec203431a7f4bc282f8a68d35cdb263b SystemUUID:ec203431-a7f4-bc28-2f8a-68d35cdb263b BootID:00c93ff4-3dd0-4fe9-98c4-86d21a1cdf4c Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:24:d2:fa:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:24:d2:fa:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:2a:51:fd:e1:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 21:58:39.744016 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.744012    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 21:58:39.744112 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.744087    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 21:58:39.746534 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.746519    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 21:58:39.747137 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.747108    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 21:58:39.747271 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.747143    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 21:58:39.748533 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.748522    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 21:58:39.748569 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.748536    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 21:58:39.748569 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.748544    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 21:58:39.749342 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.749332    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 21:58:39.750677 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.750667    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 21:58:39.753450 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753439    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 21:58:39.753560 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753552    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 21:58:39.753589 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753580    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 21:58:39.753615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753590    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 21:58:39.753615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753604    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 21:58:39.753615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753614    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 07 21:58:39.753717 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753623    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 21:58:39.753970 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753959    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 21:58:39.754007 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.753979    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 21:58:39.756181 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.756161    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 21:58:39.757960 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.757945    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 21:58:39.758034 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.757976    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 21:58:39.759068 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759058    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 21:58:39.759118 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759073    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 21:58:39.759118 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759080    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 21:58:39.759118 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759085    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 21:58:39.759118 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759095    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 21:58:39.759118 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759101    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 21:58:39.759118 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759110    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 21:58:39.759118 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759114    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 21:58:39.759294 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759124    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 21:58:39.759294 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759130    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 21:58:39.759294 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759143    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 21:58:39.759294 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759185    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 21:58:39.759983 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759973    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 21:58:39.759983 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.759983    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 21:58:39.763164 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.763148    2567 server.go:1268] "Started kubelet"
Jul 07 21:58:39.763271 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.763240    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 21:58:39.763467 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.763329    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 21:58:39.767454 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.767403    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 21:58:39.767855 ip-10-0-128-35 systemd[1]: Started Kubernetes Kubelet.
Jul 07 21:58:39.768583 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.768540    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 21:58:39.769273 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.769231    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 21:58:39.769387 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.769308    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 21:58:39.769387 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.769310    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 21:58:39.771767 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.771750    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 21:58:39.775112 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.775091    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 21:58:39.775182 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.774182    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-35.ec2.internal.18c020cd940f2a5c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-35.ec2.internal,UID:ip-10-0-128-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-35.ec2.internal,},FirstTimestamp:2026-07-07 21:58:39.76312278 +0000 UTC m=+0.347526542,LastTimestamp:2026-07-07 21:58:39.76312278 +0000 UTC m=+0.347526542,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-35.ec2.internal,}"
Jul 07 21:58:39.777471 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.777456    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 21:58:39.777471 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.777467    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 21:58:39.777638 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.777612    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:39.778082 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778067    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 21:58:39.778082 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778085    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 21:58:39.778219 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778067    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 21:58:39.778267 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778234    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 21:58:39.778267 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778243    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 21:58:39.778506 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778493    2567 factory.go:55] Registering systemd factory
Jul 07 21:58:39.778580 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778529    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 07 21:58:39.778750 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778738    2567 factory.go:153] Registering CRI-O factory
Jul 07 21:58:39.778797 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778753    2567 factory.go:223] Registration of the crio container factory successfully
Jul 07 21:58:39.778830 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778806    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 21:58:39.778830 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778827    2567 factory.go:103] Registering Raw factory
Jul 07 21:58:39.778891 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.778838    2567 manager.go:1196] Started watching for new ooms in manager
Jul 07 21:58:39.779308 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.779295    2567 manager.go:349] Starting recovery of all containers
Jul 07 21:58:39.784481 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.784452    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 21:58:39.784611 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.784584    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 21:58:39.789576 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.789435    2567 manager.go:354] Recovery completed
Jul 07 21:58:39.790841 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.790822    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 07 21:58:39.794125 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.794112    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:39.796067 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.796042    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:39.796124 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.796079    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:39.796124 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.796089    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:39.796597 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.796582    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 21:58:39.796597 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.796594    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 21:58:39.796714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.796608    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 21:58:39.796714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.796616    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:39.797238 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.797224    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:39.797281 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.797251    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:39.797281 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.797260    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:39.797924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.797912    2567 policy_none.go:49] "None policy: Start"
Jul 07 21:58:39.797958 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.797928    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 21:58:39.797958 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.797938    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 21:58:39.798981 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.798652    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-35.ec2.internal.18c020cd9605d8bc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-35.ec2.internal,UID:ip-10-0-128-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-35.ec2.internal,},FirstTimestamp:2026-07-07 21:58:39.796066492 +0000 UTC m=+0.380470258,LastTimestamp:2026-07-07 21:58:39.796066492 +0000 UTC m=+0.380470258,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-35.ec2.internal,}"
Jul 07 21:58:39.799183 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.799166    2567 policy_none.go:47] "Start"
Jul 07 21:58:39.806657 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.806640    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-66h5c"
Jul 07 21:58:39.807425 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.807370    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-35.ec2.internal.18c020cd96061e02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-35.ec2.internal,UID:ip-10-0-128-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-35.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-35.ec2.internal,},FirstTimestamp:2026-07-07 21:58:39.796084226 +0000 UTC m=+0.380487988,LastTimestamp:2026-07-07 21:58:39.796084226 +0000 UTC m=+0.380487988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-35.ec2.internal,}"
Jul 07 21:58:39.810563 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.810547    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-66h5c"
Jul 07 21:58:39.811936 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.811884    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-35.ec2.internal.18c020cd960640d9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-35.ec2.internal,UID:ip-10-0-128-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-35.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-35.ec2.internal,},FirstTimestamp:2026-07-07 21:58:39.796093145 +0000 UTC m=+0.380496907,LastTimestamp:2026-07-07 21:58:39.796093145 +0000 UTC m=+0.380496907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-35.ec2.internal,}"
Jul 07 21:58:39.847968 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.847951    2567 manager.go:337] "Starting Device Plugin manager"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.847988    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.848002    2567 server.go:87] "Starting device plugin registration server"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.848290    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.848301    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.848403    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.848480    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.848489    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.849079    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 21:58:39.859257 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.849141    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:39.949152 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.949064    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:39.950360 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.950324    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:39.950463 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.950371    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:39.950463 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.950385    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:39.950463 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.950410    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-35.ec2.internal"
Jul 07 21:58:39.956223 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.956199    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 21:58:39.957606 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.957583    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 21:58:39.957697 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.957632    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 21:58:39.957697 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.957657    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 21:58:39.957797 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.957697    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 21:58:39.960087 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.960070    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 21:58:39.961089 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:39.961074    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-35.ec2.internal"
Jul 07 21:58:39.961162 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:39.961094    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-35.ec2.internal\": node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.024851 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.024828    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.057936 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.057908    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal"]
Jul 07 21:58:40.058004 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.057980    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:40.059658 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.059642    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:40.059722 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.059677    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:40.059722 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.059692    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:40.060880 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.060867    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:40.061011 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.060978    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.061011 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.061008    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:40.061622 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.061593    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:40.061622 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.061621    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:40.061746 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.061596    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:40.061746 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.061631    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:40.061746 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.061649    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:40.061746 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.061660    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:40.062752 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.062737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.062824 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.062761    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:40.063467 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.063453    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:40.063523 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.063476    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:40.063523 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.063485    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:40.079526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.079503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71893f46aaa4941b9a0774d6633ca07f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal\" (UID: \"71893f46aaa4941b9a0774d6633ca07f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.079610 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.079533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71893f46aaa4941b9a0774d6633ca07f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal\" (UID: \"71893f46aaa4941b9a0774d6633ca07f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.079610 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.079557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/120a20f30fe5c9ca002daa23d04a4b05-config\") pod \"kube-apiserver-proxy-ip-10-0-128-35.ec2.internal\" (UID: \"120a20f30fe5c9ca002daa23d04a4b05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.094979 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.094961    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-35.ec2.internal\" not found" node="ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.099486 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.099470    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-35.ec2.internal\" not found" node="ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.125852 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.125830    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.179798 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.179774    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71893f46aaa4941b9a0774d6633ca07f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal\" (UID: \"71893f46aaa4941b9a0774d6633ca07f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.179893 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.179799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71893f46aaa4941b9a0774d6633ca07f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal\" (UID: \"71893f46aaa4941b9a0774d6633ca07f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.179893 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.179817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/120a20f30fe5c9ca002daa23d04a4b05-config\") pod \"kube-apiserver-proxy-ip-10-0-128-35.ec2.internal\" (UID: \"120a20f30fe5c9ca002daa23d04a4b05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.179893 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.179857    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/120a20f30fe5c9ca002daa23d04a4b05-config\") pod \"kube-apiserver-proxy-ip-10-0-128-35.ec2.internal\" (UID: \"120a20f30fe5c9ca002daa23d04a4b05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.179996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.179893    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71893f46aaa4941b9a0774d6633ca07f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal\" (UID: \"71893f46aaa4941b9a0774d6633ca07f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.179996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.179893    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71893f46aaa4941b9a0774d6633ca07f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal\" (UID: \"71893f46aaa4941b9a0774d6633ca07f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.226409 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.226335    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.326998 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.326961    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.398434 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.398413    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.403229 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.403209    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:40.427870 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.427845    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.528434 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.528342    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.590900 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.590875    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 21:58:40.629041 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.629008    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.713618 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.713589    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 21:58:40.714153 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.713743    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 21:58:40.714153 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.713768    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 21:58:40.729886 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.729854    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.812376 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.812279    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 21:53:41 +0000 UTC" deadline="2028-03-28 03:18:03.487638068 +0000 UTC"
Jul 07 21:58:40.812376 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.812309    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15101h19m22.67533187s"
Jul 07 21:58:40.830463 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.830429    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:40.898068 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.898036    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 21:58:40.899059 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.899040    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 21:58:40.899134 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.899079    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 21:58:40.899134 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:40.899092    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeHasSufficientPID"
Jul 07 21:58:40.930730 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:40.930703    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:41.024174 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:41.024148    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 21:58:41.031657 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:41.031632    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:41.095466 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:41.095449    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 21:58:41.132287 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:41.132245    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-35.ec2.internal\" not found"
Jul 07 21:58:41.193695 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:41.193675    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 21:58:41.278335 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:41.278309    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:41.301007 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:41.300986    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 21:58:41.302096 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:41.302083    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal"
Jul 07 21:58:41.312938 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:41.312922    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 21:58:43.041237 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.041154    2567 apiserver.go:52] "Watching apiserver"
Jul 07 21:58:43.043664 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.043642    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 21:58:43.049881 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.049839    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 21:58:43.050325 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.050303    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hrp64","kube-system/konnectivity-agent-jmrp6","kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn","openshift-dns/node-resolver-mpgz9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal","openshift-network-operator/iptables-alerter-pkncd","openshift-ovn-kubernetes/ovnkube-node-zmhl5","openshift-cluster-node-tuning-operator/tuned-8n6kq","openshift-image-registry/node-ca-9vcl9","openshift-multus/multus-5kvl4","openshift-multus/multus-additional-cni-plugins-gdkwg","openshift-multus/network-metrics-daemon-j4m6v","openshift-network-diagnostics/network-check-target-l85fh"]
Jul 07 21:58:43.051875 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.051858    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.053408 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.053385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:43.053505 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.053469    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:43.054605 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.054522    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 21:58:43.054827 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.054808    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:43.054904 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.054869    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:43.054904 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.054888    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 21:58:43.055062 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.054990    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 21:58:43.055286 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.055261    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lqmfj\""
Jul 07 21:58:43.060281 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.059735    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.060359 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.060276    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.061656 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.061594    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.063615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.062902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.065476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.063997    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w2rqs\""
Jul 07 21:58:43.065476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.064114    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 21:58:43.065476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.064610    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.065476 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.064661    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:43.065476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.064785    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 21:58:43.065476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.064983    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 21:58:43.066391 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.065929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.069283 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.067329    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.069283 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.068608    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.070061 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.070037    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.070997 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.070972    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 21:58:43.071231 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.071214    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 21:58:43.071827 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.071737    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 21:58:43.071914 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.071870    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 21:58:43.072092 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.072076    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 21:58:43.072279 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.072259    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 21:58:43.072348 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.072279    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 21:58:43.072451 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.072435    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 21:58:43.072676 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.072661    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 21:58:43.073020 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.073001    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 21:58:43.073445 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.073407    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ntss6\""
Jul 07 21:58:43.075219 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-registration-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.075301 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075246    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.075301 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysctl-conf\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.075405 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-tuned\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.075405 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:43.075405 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.075405 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075401    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d208d9b2-8e9e-4af0-88b8-306fedbcaf86-agent-certs\") pod \"konnectivity-agent-jmrp6\" (UID: \"d208d9b2-8e9e-4af0-88b8-306fedbcaf86\") " pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.075633 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81a05672-518b-4295-8aa0-fceaa96f5a58-host-slash\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.075633 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.075464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hng7s\" (UniqueName: \"kubernetes.io/projected/f27fff47-fac3-41e3-888d-51dd9379d416-kube-api-access-hng7s\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:43.076231 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.076208    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 21:58:43.076367 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.076343    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pwzmm\""
Jul 07 21:58:43.076946 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.076917    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 21:58:43.077054 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.077035    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rvnd6\""
Jul 07 21:58:43.077508 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.077491    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 21:58:43.077671 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.077651    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bs8lz\""
Jul 07 21:58:43.077957 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.077941    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ff58k\""
Jul 07 21:58:43.078055 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.078039    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 21:58:43.078242 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.078206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 21:58:43.078357 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.078336    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.078622    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.078666    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.078745    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-env-overrides\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-var-lib-kubelet\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efee0fac-b0f6-48cb-bc56-7102d99df282-tmp-dir\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81a05672-518b-4295-8aa0-fceaa96f5a58-iptables-alerter-script\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-cni-netd\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079211    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hztqn\" (UniqueName: \"kubernetes.io/projected/ea829b35-e407-40d7-8997-02024f2228ce-kube-api-access-hztqn\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysctl-d\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079244    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-78kmp\""
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-slash\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079285    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-systemd\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-host\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-ovn\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysconfig\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.080476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079638    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-run\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-socket-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-node-log\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.079988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-ovnkube-config\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.080028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-ovnkube-script-lib\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.080069    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.080080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-kubelet\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.080124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-etc-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.080439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-modprobe-d\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.081493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.081073    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8zrx9\""
Jul 07 21:58:43.081980 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.081556    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 21:58:43.082226 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.082202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0afd3747-967b-487c-bf9c-dc1859f0a2e9-tmp\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.082356 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.082321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/efee0fac-b0f6-48cb-bc56-7102d99df282-hosts-file\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.082888 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.082368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-systemd\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.085070 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea829b35-e407-40d7-8997-02024f2228ce-ovn-node-metrics-cert\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.085161 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-lib-modules\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.085161 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-systemd-units\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.085161 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-kubernetes\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.085306 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085180    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-sys-fs\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.085306 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88ptd\" (UniqueName: \"kubernetes.io/projected/1581f59e-e7da-4929-b850-b95cd73ff843-kube-api-access-88ptd\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.085306 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.085661 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.085358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d208d9b2-8e9e-4af0-88b8-306fedbcaf86-konnectivity-ca\") pod \"konnectivity-agent-jmrp6\" (UID: \"d208d9b2-8e9e-4af0-88b8-306fedbcaf86\") " pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.086454 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086428    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-var-lib-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.086557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e731550a-f9e4-4dcc-8753-211daa613598-dbus\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.086660 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086643    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:43.086715 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086675    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-device-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.086774 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46mss\" (UniqueName: \"kubernetes.io/projected/81a05672-518b-4295-8aa0-fceaa96f5a58-kube-api-access-46mss\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.086774 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086738    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bll94\" (UniqueName: \"kubernetes.io/projected/0afd3747-967b-487c-bf9c-dc1859f0a2e9-kube-api-access-bll94\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.086774 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086762    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-cni-bin\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.086912 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086800    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.086912 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086841    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-sys\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.086912 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-run-netns\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.087057 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.086932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e731550a-f9e4-4dcc-8753-211daa613598-kubelet-config\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.087339 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.087322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjk6\" (UniqueName: \"kubernetes.io/projected/efee0fac-b0f6-48cb-bc56-7102d99df282-kube-api-access-5hjk6\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.088339 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.088319    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-log-socket\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.088523 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.088505    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 21:58:43.118274 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.118247    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dnq8h"
Jul 07 21:58:43.126070 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.126046    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dnq8h"
Jul 07 21:58:43.166065 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.166034    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 21:58:43.189304 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-conf-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.189304 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33409e67-7d89-476d-9635-d83b1becf01d-multus-daemon-config\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.189503 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81a05672-518b-4295-8aa0-fceaa96f5a58-iptables-alerter-script\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.189503 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-cni-netd\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.189503 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hztqn\" (UniqueName: \"kubernetes.io/projected/ea829b35-e407-40d7-8997-02024f2228ce-kube-api-access-hztqn\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.189503 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysctl-d\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.189503 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189454    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d7e7a42-1558-456a-be23-2c6b973ad1a4-host\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.189503 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-slash\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-systemd\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189600    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-host\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-netns\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189654    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-kubelet\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189679    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-multus-certs\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189706    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.189743 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-ovn\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysconfig\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-run\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-cni-multus\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189850    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-socket-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-node-log\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-ovnkube-config\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-ovnkube-script-lib\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.189978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-kubelet\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190006    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-etc-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-modprobe-d\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0afd3747-967b-487c-bf9c-dc1859f0a2e9-tmp\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190090    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81a05672-518b-4295-8aa0-fceaa96f5a58-iptables-alerter-script\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190139    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-ovn\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/efee0fac-b0f6-48cb-bc56-7102d99df282-hosts-file\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190210    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysconfig\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190218    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-systemd\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea829b35-e407-40d7-8997-02024f2228ce-ovn-node-metrics-cert\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-lib-modules\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-systemd-units\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190330    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-kubernetes\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d7e7a42-1558-456a-be23-2c6b973ad1a4-serviceca\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190358    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-socket-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-sys-fs\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190401    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88ptd\" (UniqueName: \"kubernetes.io/projected/1581f59e-e7da-4929-b850-b95cd73ff843-kube-api-access-88ptd\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190442    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-node-log\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.190615 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d208d9b2-8e9e-4af0-88b8-306fedbcaf86-konnectivity-ca\") pod \"konnectivity-agent-jmrp6\" (UID: \"d208d9b2-8e9e-4af0-88b8-306fedbcaf86\") " pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-var-lib-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-system-cni-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-k8s-cni-cncf-io\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-hostroot\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190694    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e731550a-f9e4-4dcc-8753-211daa613598-dbus\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-etc-kubernetes\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-device-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46mss\" (UniqueName: \"kubernetes.io/projected/81a05672-518b-4295-8aa0-fceaa96f5a58-kube-api-access-46mss\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190838    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bll94\" (UniqueName: \"kubernetes.io/projected/0afd3747-967b-487c-bf9c-dc1859f0a2e9-kube-api-access-bll94\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190857    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-socket-dir-parent\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-cnibin\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190917    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-cni-bin\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-sys\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.191407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.190996    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-ovnkube-config\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191005    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ftg4\" (UniqueName: \"kubernetes.io/projected/33409e67-7d89-476d-9635-d83b1becf01d-kube-api-access-7ftg4\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8lq5\" (UniqueName: \"kubernetes.io/projected/db63a0f2-4105-4fa5-ae4f-290e1631b761-kube-api-access-m8lq5\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-run-netns\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e731550a-f9e4-4dcc-8753-211daa613598-kubelet-config\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191564    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-ovnkube-script-lib\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjk6\" (UniqueName: \"kubernetes.io/projected/efee0fac-b0f6-48cb-bc56-7102d99df282-kube-api-access-5hjk6\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191640    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-cni-netd\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191629    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-etc-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191721    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-kubelet\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191787    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysctl-d\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-modprobe-d\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191853    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-var-lib-openvswitch\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191918    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-slash\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191958    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-systemd\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.191991    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-host\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192082    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192144    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.192214 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192176    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/efee0fac-b0f6-48cb-bc56-7102d99df282-hosts-file\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192207    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e731550a-f9e4-4dcc-8753-211daa613598-dbus\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192220    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-run-systemd\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192277    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-run\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.192351    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192467    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-sys-fs\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192451    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-lib-modules\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192624    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-systemd-units\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192635    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-cni-bin\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192646    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-kubernetes\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192707    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-sys\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192725    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-run-netns\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192761    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-device-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192788    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e731550a-f9e4-4dcc-8753-211daa613598-kubelet-config\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.192876    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192923    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.192980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-log-socket\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193015    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.193066 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193062    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-registration-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193114    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-log-socket\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.193139    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs podName:f27fff47-fac3-41e3-888d-51dd9379d416 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:43.693117838 +0000 UTC m=+2.991337173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs") pod "network-metrics-daemon-j4m6v" (UID: "f27fff47-fac3-41e3-888d-51dd9379d416") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.193184    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret podName:e731550a-f9e4-4dcc-8753-211daa613598 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:43.693166887 +0000 UTC m=+2.991386215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret") pod "global-pull-secret-syncer-hrp64" (UID: "e731550a-f9e4-4dcc-8753-211daa613598") : object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193210    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-registration-dir\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193227    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea829b35-e407-40d7-8997-02024f2228ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysctl-conf\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-tuned\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-cni-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-os-release\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-system-cni-dir\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193388    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-sysctl-conf\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:43.193924 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193430    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d208d9b2-8e9e-4af0-88b8-306fedbcaf86-konnectivity-ca\") pod \"konnectivity-agent-jmrp6\" (UID: \"d208d9b2-8e9e-4af0-88b8-306fedbcaf86\") " pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193493    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1581f59e-e7da-4929-b850-b95cd73ff843-etc-selinux\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d208d9b2-8e9e-4af0-88b8-306fedbcaf86-agent-certs\") pod \"konnectivity-agent-jmrp6\" (UID: \"d208d9b2-8e9e-4af0-88b8-306fedbcaf86\") " pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81a05672-518b-4295-8aa0-fceaa96f5a58-host-slash\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hng7s\" (UniqueName: \"kubernetes.io/projected/f27fff47-fac3-41e3-888d-51dd9379d416-kube-api-access-hng7s\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193684    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-env-overrides\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193691    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81a05672-518b-4295-8aa0-fceaa96f5a58-host-slash\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-var-lib-kubelet\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d945g\" (UniqueName: \"kubernetes.io/projected/0d7e7a42-1558-456a-be23-2c6b973ad1a4-kube-api-access-d945g\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193762    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efee0fac-b0f6-48cb-bc56-7102d99df282-tmp-dir\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-cnibin\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193810    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-os-release\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33409e67-7d89-476d-9635-d83b1becf01d-cni-binary-copy\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-cni-bin\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.193937    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0afd3747-967b-487c-bf9c-dc1859f0a2e9-var-lib-kubelet\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.194135    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efee0fac-b0f6-48cb-bc56-7102d99df282-tmp-dir\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.194775 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.194216    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea829b35-e407-40d7-8997-02024f2228ce-env-overrides\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.196234 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.196212    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0afd3747-967b-487c-bf9c-dc1859f0a2e9-etc-tuned\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.196328 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.196277    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0afd3747-967b-487c-bf9c-dc1859f0a2e9-tmp\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.197788 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.197765    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d208d9b2-8e9e-4af0-88b8-306fedbcaf86-agent-certs\") pod \"konnectivity-agent-jmrp6\" (UID: \"d208d9b2-8e9e-4af0-88b8-306fedbcaf86\") " pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.198684 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.198661    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea829b35-e407-40d7-8997-02024f2228ce-ovn-node-metrics-cert\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.210355 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.210329    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 21:58:43.210355 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.210356    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 21:58:43.210521 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.210370    2567 projected.go:196] Error preparing data for projected volume kube-api-access-5748z for pod openshift-network-diagnostics/network-check-target-l85fh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:43.210521 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.210438    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z podName:00fdd688-6629-4841-af58-45a9e14aacc1 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:43.710419552 +0000 UTC m=+3.008638902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5748z" (UniqueName: "kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z") pod "network-check-target-l85fh" (UID: "00fdd688-6629-4841-af58-45a9e14aacc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:43.211000 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.210974    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hztqn\" (UniqueName: \"kubernetes.io/projected/ea829b35-e407-40d7-8997-02024f2228ce-kube-api-access-hztqn\") pod \"ovnkube-node-zmhl5\" (UID: \"ea829b35-e407-40d7-8997-02024f2228ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.211144 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.211121    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bll94\" (UniqueName: \"kubernetes.io/projected/0afd3747-967b-487c-bf9c-dc1859f0a2e9-kube-api-access-bll94\") pod \"tuned-8n6kq\" (UID: \"0afd3747-967b-487c-bf9c-dc1859f0a2e9\") " pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.213159 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.213134    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88ptd\" (UniqueName: \"kubernetes.io/projected/1581f59e-e7da-4929-b850-b95cd73ff843-kube-api-access-88ptd\") pod \"aws-ebs-csi-driver-node-9wkfn\" (UID: \"1581f59e-e7da-4929-b850-b95cd73ff843\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.213241 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.213213    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hng7s\" (UniqueName: \"kubernetes.io/projected/f27fff47-fac3-41e3-888d-51dd9379d416-kube-api-access-hng7s\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:43.213555 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.213512    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46mss\" (UniqueName: \"kubernetes.io/projected/81a05672-518b-4295-8aa0-fceaa96f5a58-kube-api-access-46mss\") pod \"iptables-alerter-pkncd\" (UID: \"81a05672-518b-4295-8aa0-fceaa96f5a58\") " pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.214221 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.214197    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjk6\" (UniqueName: \"kubernetes.io/projected/efee0fac-b0f6-48cb-bc56-7102d99df282-kube-api-access-5hjk6\") pod \"node-resolver-mpgz9\" (UID: \"efee0fac-b0f6-48cb-bc56-7102d99df282\") " pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.248565 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.248492    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal" event={"ID":"71893f46aaa4941b9a0774d6633ca07f","Type":"ContainerStarted","Data":"e6ecebc1ab6d9e5aae1174fb3e2d4dfce5085c922d2d8835430be85deff6193d"}
Jul 07 21:58:43.249953 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.249905    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal" event={"ID":"120a20f30fe5c9ca002daa23d04a4b05","Type":"ContainerStarted","Data":"2d7fec8d0f74e1defd7d71a8ebf09a73d8a4a8142befdf649cde38cba6bc5421"}
Jul 07 21:58:43.295084 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d7e7a42-1558-456a-be23-2c6b973ad1a4-serviceca\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.295084 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-system-cni-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-k8s-cni-cncf-io\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-hostroot\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-etc-kubernetes\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-socket-dir-parent\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295194    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-cnibin\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.295263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295218    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ftg4\" (UniqueName: \"kubernetes.io/projected/33409e67-7d89-476d-9635-d83b1becf01d-kube-api-access-7ftg4\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295242    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lq5\" (UniqueName: \"kubernetes.io/projected/db63a0f2-4105-4fa5-ae4f-290e1631b761-kube-api-access-m8lq5\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-cni-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-os-release\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-system-cni-dir\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d945g\" (UniqueName: \"kubernetes.io/projected/0d7e7a42-1558-456a-be23-2c6b973ad1a4-kube-api-access-d945g\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-cnibin\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295455    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-os-release\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33409e67-7d89-476d-9635-d83b1becf01d-cni-binary-copy\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-cni-bin\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-conf-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33409e67-7d89-476d-9635-d83b1becf01d-multus-daemon-config\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d7e7a42-1558-456a-be23-2c6b973ad1a4-host\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-netns\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295714    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-kubelet\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-multus-certs\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-cni-multus\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.295996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.295791    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.296412 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296177    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.296469 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296413    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.296678 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296648    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d7e7a42-1558-456a-be23-2c6b973ad1a4-serviceca\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.296782 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296727    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-system-cni-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.296782 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296740    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-os-release\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.296782 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296768    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-k8s-cni-cncf-io\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.296937 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296806    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-hostroot\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.296937 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296842    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-etc-kubernetes\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.296937 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296848    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-cnibin\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.296937 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296888    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-socket-dir-parent\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.296937 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.296934    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-cnibin\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.297364 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297340    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33409e67-7d89-476d-9635-d83b1becf01d-cni-binary-copy\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.297447 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297412    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-cni-bin\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.297511 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297459    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-conf-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.297776 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297753    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.297849 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297831    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-multus-cni-dir\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.297930 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297914    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-os-release\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.297988 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297916    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33409e67-7d89-476d-9635-d83b1becf01d-multus-daemon-config\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.297988 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297961    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d7e7a42-1558-456a-be23-2c6b973ad1a4-host\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.297988 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.297973    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db63a0f2-4105-4fa5-ae4f-290e1631b761-system-cni-dir\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.298378 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.298360    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db63a0f2-4105-4fa5-ae4f-290e1631b761-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.298471 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.298447    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-netns\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.298557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.298507    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-kubelet\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.298619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.298565    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-run-multus-certs\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.298619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.298608    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33409e67-7d89-476d-9635-d83b1becf01d-host-var-lib-cni-multus\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.309908 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.309880    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d945g\" (UniqueName: \"kubernetes.io/projected/0d7e7a42-1558-456a-be23-2c6b973ad1a4-kube-api-access-d945g\") pod \"node-ca-9vcl9\" (UID: \"0d7e7a42-1558-456a-be23-2c6b973ad1a4\") " pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.310144 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.310127    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ftg4\" (UniqueName: \"kubernetes.io/projected/33409e67-7d89-476d-9635-d83b1becf01d-kube-api-access-7ftg4\") pod \"multus-5kvl4\" (UID: \"33409e67-7d89-476d-9635-d83b1becf01d\") " pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.315647 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.315621    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lq5\" (UniqueName: \"kubernetes.io/projected/db63a0f2-4105-4fa5-ae4f-290e1631b761-kube-api-access-m8lq5\") pod \"multus-additional-cni-plugins-gdkwg\" (UID: \"db63a0f2-4105-4fa5-ae4f-290e1631b761\") " pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.371111 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.371080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkncd"
Jul 07 21:58:43.387159 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.387128    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn"
Jul 07 21:58:43.398346 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.398322    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mpgz9"
Jul 07 21:58:43.406794 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.406776    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:58:43.414517 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.414498    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8n6kq"
Jul 07 21:58:43.423465 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.423446    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:58:43.433097 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.433078    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9vcl9"
Jul 07 21:58:43.438670 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.438645    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5kvl4"
Jul 07 21:58:43.445521 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.445501    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gdkwg"
Jul 07 21:58:43.640024 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.639934    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 21:58:43.698621 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.698572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:43.698752 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.698631    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:43.698805 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.698747    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:43.698805 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.698747    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:43.698865 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.698805    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs podName:f27fff47-fac3-41e3-888d-51dd9379d416 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:44.69879353 +0000 UTC m=+3.997012863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs") pod "network-metrics-daemon-j4m6v" (UID: "f27fff47-fac3-41e3-888d-51dd9379d416") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:43.698865 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.698819    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret podName:e731550a-f9e4-4dcc-8753-211daa613598 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:44.698813341 +0000 UTC m=+3.997032670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret") pod "global-pull-secret-syncer-hrp64" (UID: "e731550a-f9e4-4dcc-8753-211daa613598") : object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:43.799762 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:43.799720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:43.799929 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.799907    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 21:58:43.799988 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.799934    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 21:58:43.799988 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.799947    2567 projected.go:196] Error preparing data for projected volume kube-api-access-5748z for pod openshift-network-diagnostics/network-check-target-l85fh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:43.800099 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:43.800030    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z podName:00fdd688-6629-4841-af58-45a9e14aacc1 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:44.800011427 +0000 UTC m=+4.098230773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5748z" (UniqueName: "kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z") pod "network-check-target-l85fh" (UID: "00fdd688-6629-4841-af58-45a9e14aacc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:44.130070 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:44.129975    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 21:53:43 +0000 UTC" deadline="2028-02-04 23:50:28.43317213 +0000 UTC"
Jul 07 21:58:44.130070 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:44.130019    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13849h51m44.303157271s"
Jul 07 21:58:44.347903 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:44.347839    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afd3747_967b_487c_bf9c_dc1859f0a2e9.slice/crio-237ddadd7421853979daea161d07ad333e0fd98a7726b3f21217cc0c3eb7e4d8 WatchSource:0}: Error finding container 237ddadd7421853979daea161d07ad333e0fd98a7726b3f21217cc0c3eb7e4d8: Status 404 returned error can't find the container with id 237ddadd7421853979daea161d07ad333e0fd98a7726b3f21217cc0c3eb7e4d8
Jul 07 21:58:44.349966 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:44.349890    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7e7a42_1558_456a_be23_2c6b973ad1a4.slice/crio-48b430c44a81e16a738d50e68bfcb29902470b29ead84f00e780e3c8a6f777fc WatchSource:0}: Error finding container 48b430c44a81e16a738d50e68bfcb29902470b29ead84f00e780e3c8a6f777fc: Status 404 returned error can't find the container with id 48b430c44a81e16a738d50e68bfcb29902470b29ead84f00e780e3c8a6f777fc
Jul 07 21:58:44.350471 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:44.350449    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefee0fac_b0f6_48cb_bc56_7102d99df282.slice/crio-645c856a095502720bf1105bcffa03f5438344bc85c525bc91c16a508aad729e WatchSource:0}: Error finding container 645c856a095502720bf1105bcffa03f5438344bc85c525bc91c16a508aad729e: Status 404 returned error can't find the container with id 645c856a095502720bf1105bcffa03f5438344bc85c525bc91c16a508aad729e
Jul 07 21:58:44.353724 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:44.353689    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33409e67_7d89_476d_9635_d83b1becf01d.slice/crio-b9c6347ef2f79f8f624b92ef14b1450d9abed763378077190db105aadd9672da WatchSource:0}: Error finding container b9c6347ef2f79f8f624b92ef14b1450d9abed763378077190db105aadd9672da: Status 404 returned error can't find the container with id b9c6347ef2f79f8f624b92ef14b1450d9abed763378077190db105aadd9672da
Jul 07 21:58:44.354977 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:44.354766    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1581f59e_e7da_4929_b850_b95cd73ff843.slice/crio-18cfaf843f0e7dfd5881f8ba1a398187b07049fd4789547cdeb8ead827bd9e14 WatchSource:0}: Error finding container 18cfaf843f0e7dfd5881f8ba1a398187b07049fd4789547cdeb8ead827bd9e14: Status 404 returned error can't find the container with id 18cfaf843f0e7dfd5881f8ba1a398187b07049fd4789547cdeb8ead827bd9e14
Jul 07 21:58:44.356127 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:44.355612    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a05672_518b_4295_8aa0_fceaa96f5a58.slice/crio-1f34455ae481182ce4e629f772e27835bbd17a755d7aa57b5ebe641a9c19b65f WatchSource:0}: Error finding container 1f34455ae481182ce4e629f772e27835bbd17a755d7aa57b5ebe641a9c19b65f: Status 404 returned error can't find the container with id 1f34455ae481182ce4e629f772e27835bbd17a755d7aa57b5ebe641a9c19b65f
Jul 07 21:58:44.360329 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:58:44.359057    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd208d9b2_8e9e_4af0_88b8_306fedbcaf86.slice/crio-4cab5a360da7673afb969a03acb79fb99dcfb13ebdbe2134abb18956cf063ad2 WatchSource:0}: Error finding container 4cab5a360da7673afb969a03acb79fb99dcfb13ebdbe2134abb18956cf063ad2: Status 404 returned error can't find the container with id 4cab5a360da7673afb969a03acb79fb99dcfb13ebdbe2134abb18956cf063ad2
Jul 07 21:58:44.706426 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:44.706334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:44.706426 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:44.706374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:44.706651 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.706497    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:44.706651 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.706501    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:44.706651 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.706564    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs podName:f27fff47-fac3-41e3-888d-51dd9379d416 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:46.706549346 +0000 UTC m=+6.004768675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs") pod "network-metrics-daemon-j4m6v" (UID: "f27fff47-fac3-41e3-888d-51dd9379d416") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:44.706651 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.706587    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret podName:e731550a-f9e4-4dcc-8753-211daa613598 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:46.706569751 +0000 UTC m=+6.004789100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret") pod "global-pull-secret-syncer-hrp64" (UID: "e731550a-f9e4-4dcc-8753-211daa613598") : object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:44.807749 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:44.806955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:44.807749 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.807103    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 21:58:44.807749 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.807125    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 21:58:44.807749 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.807138    2567 projected.go:196] Error preparing data for projected volume kube-api-access-5748z for pod openshift-network-diagnostics/network-check-target-l85fh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:44.807749 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:44.807196    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z podName:00fdd688-6629-4841-af58-45a9e14aacc1 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:46.807179237 +0000 UTC m=+6.105398571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5748z" (UniqueName: "kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z") pod "network-check-target-l85fh" (UID: "00fdd688-6629-4841-af58-45a9e14aacc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:45.131249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.131122    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 21:53:43 +0000 UTC" deadline="2028-04-15 15:10:16.770781698 +0000 UTC"
Jul 07 21:58:45.131249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.131186    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15545h11m31.639600229s"
Jul 07 21:58:45.245104 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.244367    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:45.245104 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:45.244490    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:45.245104 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.244959    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:45.245104 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:45.245056    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:45.245728 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.245559    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:45.245728 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:45.245663    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:45.263739 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.263706    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn" event={"ID":"1581f59e-e7da-4929-b850-b95cd73ff843","Type":"ContainerStarted","Data":"18cfaf843f0e7dfd5881f8ba1a398187b07049fd4789547cdeb8ead827bd9e14"}
Jul 07 21:58:45.267281 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.267252    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkncd" event={"ID":"81a05672-518b-4295-8aa0-fceaa96f5a58","Type":"ContainerStarted","Data":"1f34455ae481182ce4e629f772e27835bbd17a755d7aa57b5ebe641a9c19b65f"}
Jul 07 21:58:45.277862 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.277835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9vcl9" event={"ID":"0d7e7a42-1558-456a-be23-2c6b973ad1a4","Type":"ContainerStarted","Data":"48b430c44a81e16a738d50e68bfcb29902470b29ead84f00e780e3c8a6f777fc"}
Jul 07 21:58:45.293603 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.293567    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8n6kq" event={"ID":"0afd3747-967b-487c-bf9c-dc1859f0a2e9","Type":"ContainerStarted","Data":"237ddadd7421853979daea161d07ad333e0fd98a7726b3f21217cc0c3eb7e4d8"}
Jul 07 21:58:45.314095 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.314057    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal" event={"ID":"120a20f30fe5c9ca002daa23d04a4b05","Type":"ContainerStarted","Data":"39bad0cd180d1eeb5c6d2bb155db34f52a35265da90f0ce8e6be91217632d84e"}
Jul 07 21:58:45.327286 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.327191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jmrp6" event={"ID":"d208d9b2-8e9e-4af0-88b8-306fedbcaf86","Type":"ContainerStarted","Data":"4cab5a360da7673afb969a03acb79fb99dcfb13ebdbe2134abb18956cf063ad2"}
Jul 07 21:58:45.330552 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.330458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerStarted","Data":"554a5b2449237fade89feebbd154ef436b79f42cf422e808d6e766c475aa1aa2"}
Jul 07 21:58:45.338747 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.338723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5kvl4" event={"ID":"33409e67-7d89-476d-9635-d83b1becf01d","Type":"ContainerStarted","Data":"b9c6347ef2f79f8f624b92ef14b1450d9abed763378077190db105aadd9672da"}
Jul 07 21:58:45.342592 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.342569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mpgz9" event={"ID":"efee0fac-b0f6-48cb-bc56-7102d99df282","Type":"ContainerStarted","Data":"645c856a095502720bf1105bcffa03f5438344bc85c525bc91c16a508aad729e"}
Jul 07 21:58:45.351087 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.351061    2567 generic.go:356] "Generic (PLEG): container finished" podID="71893f46aaa4941b9a0774d6633ca07f" containerID="a49ac31e0119427ad4bc2d6ffb866f73df0bb369b0a1700652a55cc54188ad0c" exitCode=0
Jul 07 21:58:45.351189 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.351151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal" event={"ID":"71893f46aaa4941b9a0774d6633ca07f","Type":"ContainerDied","Data":"a49ac31e0119427ad4bc2d6ffb866f73df0bb369b0a1700652a55cc54188ad0c"}
Jul 07 21:58:45.365290 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.365191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"2838488a33d396f890042a6485b8c3e8498d3d7eebf13484fc722bc106372790"}
Jul 07 21:58:45.369444 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:45.368881    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-35.ec2.internal" podStartSLOduration=3.368864525 podStartE2EDuration="3.368864525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:58:45.345137794 +0000 UTC m=+4.643357145" watchObservedRunningTime="2026-07-07 21:58:45.368864525 +0000 UTC m=+4.667083876"
Jul 07 21:58:46.382679 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:46.382641    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal" event={"ID":"71893f46aaa4941b9a0774d6633ca07f","Type":"ContainerStarted","Data":"45e920cffd03b81f2f0c817b8be2aa834ca31046603c6ac47ad26eb977f791a3"}
Jul 07 21:58:46.723444 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:46.723357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:46.723696 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:46.723482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:46.723696 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.723570    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:46.723696 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.723616    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:46.723696 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.723647    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs podName:f27fff47-fac3-41e3-888d-51dd9379d416 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:50.723626561 +0000 UTC m=+10.021845893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs") pod "network-metrics-daemon-j4m6v" (UID: "f27fff47-fac3-41e3-888d-51dd9379d416") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:46.723696 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.723671    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret podName:e731550a-f9e4-4dcc-8753-211daa613598 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:50.723655745 +0000 UTC m=+10.021875092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret") pod "global-pull-secret-syncer-hrp64" (UID: "e731550a-f9e4-4dcc-8753-211daa613598") : object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:46.824728 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:46.824690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:46.824917 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.824897    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 21:58:46.824990 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.824925    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 21:58:46.824990 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.824937    2567 projected.go:196] Error preparing data for projected volume kube-api-access-5748z for pod openshift-network-diagnostics/network-check-target-l85fh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:46.825094 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:46.824995    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z podName:00fdd688-6629-4841-af58-45a9e14aacc1 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:50.824978068 +0000 UTC m=+10.123197407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5748z" (UniqueName: "kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z") pod "network-check-target-l85fh" (UID: "00fdd688-6629-4841-af58-45a9e14aacc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:47.247551 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:47.246640    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:47.247551 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:47.246798    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:47.247551 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:47.247187    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:47.247551 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:47.247274    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:47.247551 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:47.247364    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:47.247551 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:47.247456    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:49.244991 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:49.244958    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:49.244991 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:49.244983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:49.245476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:49.244971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:49.245476 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:49.245098    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:49.245476 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:49.245174    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:49.245476 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:49.245253    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:50.766955 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:50.766920    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:50.766955 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:50.766960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:50.767419 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.767082    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:50.767419 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.767097    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:50.767419 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.767149    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs podName:f27fff47-fac3-41e3-888d-51dd9379d416 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:58.7671287 +0000 UTC m=+18.065348034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs") pod "network-metrics-daemon-j4m6v" (UID: "f27fff47-fac3-41e3-888d-51dd9379d416") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:50.767419 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.767225    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret podName:e731550a-f9e4-4dcc-8753-211daa613598 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:58.767206411 +0000 UTC m=+18.065425756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret") pod "global-pull-secret-syncer-hrp64" (UID: "e731550a-f9e4-4dcc-8753-211daa613598") : object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:50.868027 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:50.867991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:50.868216 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.868198    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 21:58:50.868261 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.868222    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 21:58:50.868261 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.868234    2567 projected.go:196] Error preparing data for projected volume kube-api-access-5748z for pod openshift-network-diagnostics/network-check-target-l85fh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:50.868320 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:50.868302    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z podName:00fdd688-6629-4841-af58-45a9e14aacc1 nodeName:}" failed. No retries permitted until 2026-07-07 21:58:58.868283522 +0000 UTC m=+18.166502853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5748z" (UniqueName: "kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z") pod "network-check-target-l85fh" (UID: "00fdd688-6629-4841-af58-45a9e14aacc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:51.245732 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:51.245639    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:51.245895 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:51.245740    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:51.246073 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:51.246057    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:51.246137 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:51.246121    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:51.246189 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:51.246163    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:51.246237 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:51.246211    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:53.245555 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:53.244498    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:53.245555 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:53.244498    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:53.245555 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:53.244660    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:53.245555 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:53.244975    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:53.245555 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:53.245069    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:53.245555 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:53.245196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:55.244421 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:55.244379    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:55.244888 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:55.244390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:55.244888 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:55.244547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:55.244888 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:55.244524    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:55.244888 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:55.244665    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:55.244888 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:55.244758    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:57.244205 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:57.244173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:57.244687 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:57.244173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:57.244687 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:57.244325    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:58:57.244687 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:57.244368    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:57.244687 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:57.244180    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:57.244687 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:57.244461    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:58.829299 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:58.829262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:58.829299 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:58.829305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:58.829806 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.829418    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:58.829806 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.829428    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:58.829806 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.829487    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs podName:f27fff47-fac3-41e3-888d-51dd9379d416 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:14.829470085 +0000 UTC m=+34.127689416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs") pod "network-metrics-daemon-j4m6v" (UID: "f27fff47-fac3-41e3-888d-51dd9379d416") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:58:58.829806 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.829504    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret podName:e731550a-f9e4-4dcc-8753-211daa613598 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:14.829495303 +0000 UTC m=+34.127714632 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret") pod "global-pull-secret-syncer-hrp64" (UID: "e731550a-f9e4-4dcc-8753-211daa613598") : object "kube-system"/"original-pull-secret" not registered
Jul 07 21:58:58.929751 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:58.929714    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:58.929896 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.929882    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 21:58:58.929935 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.929904    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 21:58:58.929935 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.929914    2567 projected.go:196] Error preparing data for projected volume kube-api-access-5748z for pod openshift-network-diagnostics/network-check-target-l85fh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:58.929999 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:58.929966    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z podName:00fdd688-6629-4841-af58-45a9e14aacc1 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:14.929948708 +0000 UTC m=+34.228168054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5748z" (UniqueName: "kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z") pod "network-check-target-l85fh" (UID: "00fdd688-6629-4841-af58-45a9e14aacc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:58:59.244137 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:59.244098    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:58:59.244275 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:59.244115    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:58:59.244275 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:59.244223    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:58:59.244398 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:59.244312    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:58:59.244398 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:58:59.244375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:58:59.244504 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:58:59.244460    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:01.248394 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:01.245762    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:01.248394 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:01.245783    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:01.248394 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:01.245899    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:01.248394 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:01.245938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:01.248394 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:01.246076    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:01.248394 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:01.246154    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:03.245050 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:03.244630    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:03.245050 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:03.244752    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:03.245050 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:03.244630    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:03.245050 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:03.244798    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:03.245050 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:03.244871    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:03.245050 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:03.244938    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:04.422408 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.421972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"d01ed2428614fe2910b5c46914510569f97ae525aa6e80165141f699256a4861"}
Jul 07 21:59:04.423211 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.422515    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"02854fc7f37849cc26a069eb825218c848fffe8e3f61671b38063358a4607472"}
Jul 07 21:59:04.423211 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.422582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"a38342bd9638601a50c69a52383546b9e61ba52f74bb473da996f015d9a9ee8f"}
Jul 07 21:59:04.423211 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.422620    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"72fe4986303fcf2dd344d69c15a766083089f1a640025518a14974fccfd6f3ab"}
Jul 07 21:59:04.423211 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.422647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"b1c6da81b514f8ee1cd3e0dc62988458717dd9b910c244fba35d3e9f9137cd3a"}
Jul 07 21:59:04.423211 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.422685    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"1e4454929c4d05ca57f5150c8c69cc76353da9e8b7d2b912358a705158c83e93"}
Jul 07 21:59:04.423429 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.423381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn" event={"ID":"1581f59e-e7da-4929-b850-b95cd73ff843","Type":"ContainerStarted","Data":"0f97bfbc27345e5dc92399b011af622c37836b1c84474763a887ba775d34e765"}
Jul 07 21:59:04.424672 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.424652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9vcl9" event={"ID":"0d7e7a42-1558-456a-be23-2c6b973ad1a4","Type":"ContainerStarted","Data":"1c25759742b2f0c8b031774f3687a0439aeed7945e475188cb76ffe8c4d17156"}
Jul 07 21:59:04.426004 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.425985    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8n6kq" event={"ID":"0afd3747-967b-487c-bf9c-dc1859f0a2e9","Type":"ContainerStarted","Data":"d901b67ea67fcc8e73026ee8bae4843c95fd1943614b36397e447b72dbc93c2d"}
Jul 07 21:59:04.427282 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.427260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jmrp6" event={"ID":"d208d9b2-8e9e-4af0-88b8-306fedbcaf86","Type":"ContainerStarted","Data":"5187beaf032946d466fbe3a27dc24adc0291b22355d2e561ae134bdad7a02f3d"}
Jul 07 21:59:04.428611 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.428588    2567 generic.go:356] "Generic (PLEG): container finished" podID="db63a0f2-4105-4fa5-ae4f-290e1631b761" containerID="9d90ba541ce7b5fcb5fb2a20f42f3d89d14651e55f35d52e83d18ba43d0be407" exitCode=0
Jul 07 21:59:04.428700 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.428660    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerDied","Data":"9d90ba541ce7b5fcb5fb2a20f42f3d89d14651e55f35d52e83d18ba43d0be407"}
Jul 07 21:59:04.430052 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.430033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5kvl4" event={"ID":"33409e67-7d89-476d-9635-d83b1becf01d","Type":"ContainerStarted","Data":"2519420516deaf3f61631e6b45a05c7a678ce943c0c90d16f28d673b545df083"}
Jul 07 21:59:04.431463 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.431442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mpgz9" event={"ID":"efee0fac-b0f6-48cb-bc56-7102d99df282","Type":"ContainerStarted","Data":"928b052138872dc458a01a29117fb1a950e3bd9af9d5657243f600ca81e3a8ad"}
Jul 07 21:59:04.443855 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.443818    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-35.ec2.internal" podStartSLOduration=22.443806843 podStartE2EDuration="22.443806843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:58:46.400468835 +0000 UTC m=+5.698688187" watchObservedRunningTime="2026-07-07 21:59:04.443806843 +0000 UTC m=+23.742026194"
Jul 07 21:59:04.444079 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.444061    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9vcl9" podStartSLOduration=4.34733055 podStartE2EDuration="23.444055516s" totalImagesPullingTime="19.096724966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:04.443686656 +0000 UTC m=+23.741906006" watchObservedRunningTime="2026-07-07 21:59:04.444055516 +0000 UTC m=+23.742274865"
Jul 07 21:59:04.488319 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.488266    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jmrp6" podStartSLOduration=4.404630175 podStartE2EDuration="23.488246682s" totalImagesPullingTime="19.083616507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:04.488180909 +0000 UTC m=+23.786400273" watchObservedRunningTime="2026-07-07 21:59:04.488246682 +0000 UTC m=+23.786466034"
Jul 07 21:59:04.507468 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.507420    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5kvl4" podStartSLOduration=4.361499347 podStartE2EDuration="23.50740611s" totalImagesPullingTime="19.145906763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:04.506965785 +0000 UTC m=+23.805185137" watchObservedRunningTime="2026-07-07 21:59:04.50740611 +0000 UTC m=+23.805625461"
Jul 07 21:59:04.542901 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.542851    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mpgz9" podStartSLOduration=4.45385779 podStartE2EDuration="23.542837924s" totalImagesPullingTime="19.088980134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:04.523993236 +0000 UTC m=+23.822212587" watchObservedRunningTime="2026-07-07 21:59:04.542837924 +0000 UTC m=+23.841057335"
Jul 07 21:59:04.543191 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:04.543161    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8n6kq" podStartSLOduration=4.41408205 podStartE2EDuration="23.543154321s" totalImagesPullingTime="19.129072271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:04.542629513 +0000 UTC m=+23.840848867" watchObservedRunningTime="2026-07-07 21:59:04.543154321 +0000 UTC m=+23.841373675"
Jul 07 21:59:05.013350 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.013315    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:59:05.244598 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.244116    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:05.244598 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.244223    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:05.244598 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:05.244251    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:05.244598 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:05.244323    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:05.244598 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.244381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:05.244598 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:05.244451    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:05.280826 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.280802    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 21:59:05.436493 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.436458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn" event={"ID":"1581f59e-e7da-4929-b850-b95cd73ff843","Type":"ContainerStarted","Data":"9070b50792504bf55f8aebcde4390c86a45bc58eaf5aee5aebc04a648eedbb57"}
Jul 07 21:59:05.438320 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.438281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkncd" event={"ID":"81a05672-518b-4295-8aa0-fceaa96f5a58","Type":"ContainerStarted","Data":"30788e569ba54be6d7d91acdfeeb2a5ec279e6ec790d21f40965ab788789c8ee"}
Jul 07 21:59:05.459464 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.459409    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pkncd" podStartSLOduration=5.3622519650000005 podStartE2EDuration="24.4593918s" totalImagesPullingTime="19.097139835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:05.459063551 +0000 UTC m=+24.757282901" watchObservedRunningTime="2026-07-07 21:59:05.4593918 +0000 UTC m=+24.757611151"
Jul 07 21:59:05.515997 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.515932    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:59:05.517084 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:05.517065    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:59:06.160492 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:06.160361    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T21:59:05.280820495Z","UUID":"7616456a-ba52-4ac2-b6fe-7cd72afdbc03","Handler":null,"Name":"","Endpoint":""}
Jul 07 21:59:06.162183 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:06.162159    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 21:59:06.162368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:06.162204    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 21:59:06.446777 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:06.446516    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jmrp6"
Jul 07 21:59:07.244242 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:07.244206    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:07.244476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:07.244208    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:07.244476 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:07.244339    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:07.244476 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:07.244349    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:07.244476 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:07.244423    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:07.244668 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:07.244517    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:07.452195 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:07.452162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"391f9eff377c6e7f7364b349d5a32cabe87a329b1287e01f9c54a52b683030ca"}
Jul 07 21:59:07.454454 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:07.454429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn" event={"ID":"1581f59e-e7da-4929-b850-b95cd73ff843","Type":"ContainerStarted","Data":"6b1cf238de086f7c2bf2f7cfe1b0c5b36e20da19b7cf7e2fa7250329fbfe5cc6"}
Jul 07 21:59:09.244595 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.244410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:09.245353 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.244413    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:09.245353 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:09.244674    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:09.245353 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.244427    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:09.245353 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:09.244747    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:09.245353 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:09.244829    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:09.461855 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.461820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" event={"ID":"ea829b35-e407-40d7-8997-02024f2228ce","Type":"ContainerStarted","Data":"038cc65a3682d806e9d1b0aadd6d282ac3215d6c8ab7b994b17a0088ec682a3b"}
Jul 07 21:59:09.462060 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.462047    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:59:09.462119 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.462104    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:59:09.463714 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.463684    2567 generic.go:356] "Generic (PLEG): container finished" podID="db63a0f2-4105-4fa5-ae4f-290e1631b761" containerID="566ca1e62588699bda49236306b20d8a28d5a891627ecb99ef9910b9b2e2954d" exitCode=0
Jul 07 21:59:09.463824 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.463727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerDied","Data":"566ca1e62588699bda49236306b20d8a28d5a891627ecb99ef9910b9b2e2954d"}
Jul 07 21:59:09.478003 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.477984    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:59:09.489992 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.489952    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5" podStartSLOduration=9.308172741 podStartE2EDuration="28.489939491s" totalImagesPullingTime="19.18176675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:09.489902736 +0000 UTC m=+28.788122081" watchObservedRunningTime="2026-07-07 21:59:09.489939491 +0000 UTC m=+28.788158841"
Jul 07 21:59:09.492844 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:09.491181    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9wkfn" podStartSLOduration=6.578502261 podStartE2EDuration="28.491168307s" totalImagesPullingTime="21.912666046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:07.474632567 +0000 UTC m=+26.772851919" watchObservedRunningTime="2026-07-07 21:59:09.491168307 +0000 UTC m=+28.789387658"
Jul 07 21:59:10.466275 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.466242    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:59:10.482070 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.482034    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:59:10.957499 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.957298    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrp64"]
Jul 07 21:59:10.957765 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.957588    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:10.957765 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:10.957703    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:10.959500 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.959468    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j4m6v"]
Jul 07 21:59:10.959680 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.959666    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:10.959820 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:10.959802    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:10.963316 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.963289    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l85fh"]
Jul 07 21:59:10.963420 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:10.963385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:10.963497 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:10.963475    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:11.470065 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:11.470032    2567 generic.go:356] "Generic (PLEG): container finished" podID="db63a0f2-4105-4fa5-ae4f-290e1631b761" containerID="ed568387048cdf8515835e57ec326e8f6e62a8dbbab74dfb3a9cb7f8562cd978" exitCode=0
Jul 07 21:59:11.470495 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:11.470127    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerDied","Data":"ed568387048cdf8515835e57ec326e8f6e62a8dbbab74dfb3a9cb7f8562cd978"}
Jul 07 21:59:12.244696 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:12.244662    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:12.244853 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:12.244781    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:13.244334 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:13.244303    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:13.245041 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:13.244316    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:13.245041 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:13.244440    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:13.245041 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:13.244502    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:13.476302 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:13.476225    2567 generic.go:356] "Generic (PLEG): container finished" podID="db63a0f2-4105-4fa5-ae4f-290e1631b761" containerID="f2e396bcbac6e68205ea756d245fb4a857d660b25fa279e50338b9065828895c" exitCode=0
Jul 07 21:59:13.476302 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:13.476264    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerDied","Data":"f2e396bcbac6e68205ea756d245fb4a857d660b25fa279e50338b9065828895c"}
Jul 07 21:59:14.244835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:14.244800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:14.245322 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.244923    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:14.848112 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:14.848072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:14.848112 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:14.848123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:14.848336 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.848246    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:59:14.848336 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.848251    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 21:59:14.848336 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.848310    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs podName:f27fff47-fac3-41e3-888d-51dd9379d416 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:46.848289521 +0000 UTC m=+66.146508863 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs") pod "network-metrics-daemon-j4m6v" (UID: "f27fff47-fac3-41e3-888d-51dd9379d416") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 21:59:14.848336 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.848326    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret podName:e731550a-f9e4-4dcc-8753-211daa613598 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:46.848319646 +0000 UTC m=+66.146538977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret") pod "global-pull-secret-syncer-hrp64" (UID: "e731550a-f9e4-4dcc-8753-211daa613598") : object "kube-system"/"original-pull-secret" not registered
Jul 07 21:59:14.948520 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:14.948477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:14.948708 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.948671    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 21:59:14.948708 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.948691    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 21:59:14.948708 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.948701    2567 projected.go:196] Error preparing data for projected volume kube-api-access-5748z for pod openshift-network-diagnostics/network-check-target-l85fh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:59:14.948862 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:14.948763    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z podName:00fdd688-6629-4841-af58-45a9e14aacc1 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:46.948740693 +0000 UTC m=+66.246960045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5748z" (UniqueName: "kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z") pod "network-check-target-l85fh" (UID: "00fdd688-6629-4841-af58-45a9e14aacc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 21:59:15.248639 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:15.248562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:15.248639 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:15.248584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:15.249071 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:15.248713    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:15.249071 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:15.248825    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:16.244259 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:16.244227    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:16.244451 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:16.244373    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l85fh" podUID="00fdd688-6629-4841-af58-45a9e14aacc1"
Jul 07 21:59:17.247914 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.247846    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:17.248283 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:17.247959    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrp64" podUID="e731550a-f9e4-4dcc-8753-211daa613598"
Jul 07 21:59:17.248283 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.248042    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:17.248283 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:17.248131    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4m6v" podUID="f27fff47-fac3-41e3-888d-51dd9379d416"
Jul 07 21:59:17.532638 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.532460    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-35.ec2.internal" event="NodeReady"
Jul 07 21:59:17.532747 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.532737    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 21:59:17.585447 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.585409    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rcm4p"]
Jul 07 21:59:17.587339 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.587319    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.591558 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.591514    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 21:59:17.591712 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.591696    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c5lw\""
Jul 07 21:59:17.591961 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.591946    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 21:59:17.593083 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.593064    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bfsvp"]
Jul 07 21:59:17.594760 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.594742    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:17.597366 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.597314    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 21:59:17.597366 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.597317    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 21:59:17.597526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.597509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-czs54\""
Jul 07 21:59:17.597986 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.597970    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 21:59:17.607980 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.607955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rcm4p"]
Jul 07 21:59:17.612488 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.612466    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfsvp"]
Jul 07 21:59:17.765086 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.764983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-tmp-dir\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.765086 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.765041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65kqf\" (UniqueName: \"kubernetes.io/projected/98f0faa1-778b-42c0-adf4-44c989bc68e5-kube-api-access-65kqf\") pod \"ingress-canary-bfsvp\" (UID: \"98f0faa1-778b-42c0-adf4-44c989bc68e5\") " pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:17.765301 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.765096    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-config-volume\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.765301 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.765139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-279xs\" (UniqueName: \"kubernetes.io/projected/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-kube-api-access-279xs\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.765301 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.765224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98f0faa1-778b-42c0-adf4-44c989bc68e5-cert\") pod \"ingress-canary-bfsvp\" (UID: \"98f0faa1-778b-42c0-adf4-44c989bc68e5\") " pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:17.765301 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.765255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.866547 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.866490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65kqf\" (UniqueName: \"kubernetes.io/projected/98f0faa1-778b-42c0-adf4-44c989bc68e5-kube-api-access-65kqf\") pod \"ingress-canary-bfsvp\" (UID: \"98f0faa1-778b-42c0-adf4-44c989bc68e5\") " pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:17.866547 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.866545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-config-volume\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.866787 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.866656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-279xs\" (UniqueName: \"kubernetes.io/projected/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-kube-api-access-279xs\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.866787 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.866729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98f0faa1-778b-42c0-adf4-44c989bc68e5-cert\") pod \"ingress-canary-bfsvp\" (UID: \"98f0faa1-778b-42c0-adf4-44c989bc68e5\") " pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:17.866787 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.866752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.866930 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.866793    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-tmp-dir\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.866930 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:17.866897    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 21:59:17.867004 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:17.866977    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls podName:135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d nodeName:}" failed. No retries permitted until 2026-07-07 21:59:18.36695722 +0000 UTC m=+37.665176550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls") pod "dns-default-rcm4p" (UID: "135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d") : secret "dns-default-metrics-tls" not found
Jul 07 21:59:17.867095 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.867076    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-tmp-dir\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.867138 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.867120    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-config-volume\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.870796 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.870777    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98f0faa1-778b-42c0-adf4-44c989bc68e5-cert\") pod \"ingress-canary-bfsvp\" (UID: \"98f0faa1-778b-42c0-adf4-44c989bc68e5\") " pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:17.875857 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.875836    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65kqf\" (UniqueName: \"kubernetes.io/projected/98f0faa1-778b-42c0-adf4-44c989bc68e5-kube-api-access-65kqf\") pod \"ingress-canary-bfsvp\" (UID: \"98f0faa1-778b-42c0-adf4-44c989bc68e5\") " pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:17.876081 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.876063    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-279xs\" (UniqueName: \"kubernetes.io/projected/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-kube-api-access-279xs\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:17.903178 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:17.903153    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfsvp"
Jul 07 21:59:18.033255 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.033189    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfsvp"]
Jul 07 21:59:18.037121 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:18.037092    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f0faa1_778b_42c0_adf4_44c989bc68e5.slice/crio-e3519b3eb744260e0a4e988de74713627b9fe1530e1e39fd0fe3652c820ae972 WatchSource:0}: Error finding container e3519b3eb744260e0a4e988de74713627b9fe1530e1e39fd0fe3652c820ae972: Status 404 returned error can't find the container with id e3519b3eb744260e0a4e988de74713627b9fe1530e1e39fd0fe3652c820ae972
Jul 07 21:59:18.212605 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.212560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:18.244514 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.244488    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:18.247344 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.247326    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 21:59:18.247457 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.247327    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8gff\""
Jul 07 21:59:18.247783 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.247772    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 21:59:18.370194 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.370110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:18.370636 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:18.370278    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 21:59:18.370636 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:18.370362    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls podName:135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d nodeName:}" failed. No retries permitted until 2026-07-07 21:59:19.370339545 +0000 UTC m=+38.668558879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls") pod "dns-default-rcm4p" (UID: "135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d") : secret "dns-default-metrics-tls" not found
Jul 07 21:59:18.389360 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.389320    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:18.490049 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.490013    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfsvp" event={"ID":"98f0faa1-778b-42c0-adf4-44c989bc68e5","Type":"ContainerStarted","Data":"e3519b3eb744260e0a4e988de74713627b9fe1530e1e39fd0fe3652c820ae972"}
Jul 07 21:59:18.493033 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.493003    2567 generic.go:356] "Generic (PLEG): container finished" podID="db63a0f2-4105-4fa5-ae4f-290e1631b761" containerID="1f11ad60ac8f2c7c63fe9795b363044750849bbaaa0328f409e2ce2ad8a9ed6e" exitCode=0
Jul 07 21:59:18.493178 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:18.493046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerDied","Data":"1f11ad60ac8f2c7c63fe9795b363044750849bbaaa0328f409e2ce2ad8a9ed6e"}
Jul 07 21:59:19.245189 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.244927    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:19.245356 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.244967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:19.248304 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.248285    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqsmx\""
Jul 07 21:59:19.248514 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.248488    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 21:59:19.248742 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.248726    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 21:59:19.378412 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.378378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:19.378894 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:19.378555    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 21:59:19.378894 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:19.378613    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls podName:135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d nodeName:}" failed. No retries permitted until 2026-07-07 21:59:21.378599763 +0000 UTC m=+40.676819096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls") pod "dns-default-rcm4p" (UID: "135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d") : secret "dns-default-metrics-tls" not found
Jul 07 21:59:19.499102 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.499011    2567 generic.go:356] "Generic (PLEG): container finished" podID="db63a0f2-4105-4fa5-ae4f-290e1631b761" containerID="1116632d3bd36097dd649f79813595666da7f5cc3945552db2837112b0e43e3b" exitCode=0
Jul 07 21:59:19.499102 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:19.499084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerDied","Data":"1116632d3bd36097dd649f79813595666da7f5cc3945552db2837112b0e43e3b"}
Jul 07 21:59:20.321271 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:20.321181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:20.422708 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:20.422672    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:20.505902 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:20.505875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" event={"ID":"db63a0f2-4105-4fa5-ae4f-290e1631b761","Type":"ContainerStarted","Data":"feaaba0b848c042e583de31e64d0ea12647acff20378f70a247f4d0d7bf7a42e"}
Jul 07 21:59:20.540279 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:20.540231    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gdkwg" podStartSLOduration=10.062234785 podStartE2EDuration="39.540212621s" totalImagesPullingTime="29.477977836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:20.539802011 +0000 UTC m=+39.838021361" watchObservedRunningTime="2026-07-07 21:59:20.540212621 +0000 UTC m=+39.838431972"
Jul 07 21:59:20.683053 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:20.682974    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:20.772913 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:20.772877    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:20.873005 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:20.872972    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:21.395677 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:21.395639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:21.395853 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:21.395747    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 21:59:21.395853 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:21.395798    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls podName:135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d nodeName:}" failed. No retries permitted until 2026-07-07 21:59:25.395785485 +0000 UTC m=+44.694004814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls") pod "dns-default-rcm4p" (UID: "135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d") : secret "dns-default-metrics-tls" not found
Jul 07 21:59:21.509946 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:21.509910    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfsvp" event={"ID":"98f0faa1-778b-42c0-adf4-44c989bc68e5","Type":"ContainerStarted","Data":"7d594d2c46979727e915854a936e183c4c0f98a70607c9e2e1d30bf384a082b7"}
Jul 07 21:59:21.528573 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:21.528512    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bfsvp" podStartSLOduration=2.167809417 podStartE2EDuration="4.528496471s" totalImagesPullingTime="2.360687054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:21.527878927 +0000 UTC m=+40.826098281" watchObservedRunningTime="2026-07-07 21:59:21.528496471 +0000 UTC m=+40.826715800"
Jul 07 21:59:22.074627 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.074593    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"]
Jul 07 21:59:22.108043 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.108012    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-t9xql"]
Jul 07 21:59:22.108195 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.108121    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.111156 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.111129    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 21:59:22.111398 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.111381    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 21:59:22.111473 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.111416    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 21:59:22.111678 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.111660    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d5hb7\""
Jul 07 21:59:22.111745 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.111677    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 21:59:22.121947 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.121924    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f58964cdf-9k4jp"]
Jul 07 21:59:22.122059 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.122043    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.127640 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.127609    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 21:59:22.128377 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.128161    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 21:59:22.128471 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.128400    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 21:59:22.128550 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.128516    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 21:59:22.128612 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.128524    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-slqlm\""
Jul 07 21:59:22.137983 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.137964    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xfgmq"]
Jul 07 21:59:22.138105 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.138089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.140483 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.140465    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 21:59:22.147835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.146053    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 21:59:22.147835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.146256    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 21:59:22.147835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.146490    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 21:59:22.147835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.146672    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 21:59:22.147835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.146824    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 21:59:22.147835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.146979    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2jqmh\""
Jul 07 21:59:22.147835 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.147122    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 21:59:22.163848 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.163817    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:22.167285 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.167264    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"]
Jul 07 21:59:22.167398 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.167299    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xfgmq"]
Jul 07 21:59:22.167398 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.167322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f58964cdf-9k4jp"]
Jul 07 21:59:22.167398 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.167341    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-t9xql"]
Jul 07 21:59:22.167398 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.167382    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.174546 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.174506    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 21:59:22.174649 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.174598    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hdh64\""
Jul 07 21:59:22.174715 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.174688    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 21:59:22.174772 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.174764    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 21:59:22.175043 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.174997    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 21:59:22.180469 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.180450    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 21:59:22.198226 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.198203    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b497d757f-tzkgl"]
Jul 07 21:59:22.201724 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.201701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.201807 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.201729    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.201807 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.201802    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4c2\" (UniqueName: \"kubernetes.io/projected/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-kube-api-access-kd4c2\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.219198 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.219178    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b497d757f-tzkgl"]
Jul 07 21:59:22.219297 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.219262    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.221949 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.221924    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bzmhm\""
Jul 07 21:59:22.222039 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.221956    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 21:59:22.222163 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.222148    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 21:59:22.222235 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.222223    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 21:59:22.232400 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.232377    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 21:59:22.279005 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.278973    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"]
Jul 07 21:59:22.279832 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.279804    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:22.292318 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.292301    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.297982 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.297935    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 21:59:22.298378 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.298356    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 21:59:22.298491 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.298470    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 21:59:22.298625 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.298608    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mttqn\""
Jul 07 21:59:22.298680 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.298667    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 21:59:22.302710 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.302690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s2h8\" (UniqueName: \"kubernetes.io/projected/cad384a6-548d-4dd5-a3fc-808c6db4ae10-kube-api-access-2s2h8\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.302796 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.302754    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clfh\" (UniqueName: \"kubernetes.io/projected/0ceca531-7113-4e27-b88b-fe978af02515-kube-api-access-2clfh\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.302796 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.302786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cad384a6-548d-4dd5-a3fc-808c6db4ae10-snapshots\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.302899 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.302810    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad384a6-548d-4dd5-a3fc-808c6db4ae10-serving-cert\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.302899 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.302842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd4c2\" (UniqueName: \"kubernetes.io/projected/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-kube-api-access-kd4c2\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.302986 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.302964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad384a6-548d-4dd5-a3fc-808c6db4ae10-tmp\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.303046 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303029    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.303098 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.303159 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-stats-auth\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.303194 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ceca531-7113-4e27-b88b-fe978af02515-config\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.303320 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.303361 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303338    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.303404 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303369    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cad384a6-548d-4dd5-a3fc-808c6db4ae10-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.303404 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303396    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-default-certificate\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.303500 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tctt\" (UniqueName: \"kubernetes.io/projected/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-kube-api-access-6tctt\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.303500 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ceca531-7113-4e27-b88b-fe978af02515-serving-cert\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.303626 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cad384a6-548d-4dd5-a3fc-808c6db4ae10-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.303626 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303556    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ceca531-7113-4e27-b88b-fe978af02515-trusted-ca\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.303693 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.303664    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.306498 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.306480    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.314930 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.314905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"]
Jul 07 21:59:22.321732 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.321711    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd4c2\" (UniqueName: \"kubernetes.io/projected/5df4e0ac-5f34-4fac-92b2-dfaf96d5063a-kube-api-access-kd4c2\") pod \"kube-storage-version-migrator-operator-846bf668f7-tsnb8\" (UID: \"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.402396 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.402316    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:22.404264 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/419ced79-d1e4-41f0-a3b9-4783400bc104-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.404368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ceca531-7113-4e27-b88b-fe978af02515-serving-cert\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.404368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ceca531-7113-4e27-b88b-fe978af02515-config\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.404368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cad384a6-548d-4dd5-a3fc-808c6db4ae10-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.404368 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.404573 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.404573 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cad384a6-548d-4dd5-a3fc-808c6db4ae10-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.404573 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cad384a6-548d-4dd5-a3fc-808c6db4ae10-snapshots\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.404573 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404490    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.404573 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.404514    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:22.904495344 +0000 UTC m=+42.202714673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : configmap references non-existent config key: service-ca.crt
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.404587    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/419ced79-d1e4-41f0-a3b9-4783400bc104-config\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-certificates\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad384a6-548d-4dd5-a3fc-808c6db4ae10-tmp\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404707    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9940d32b-7f65-4ed2-b139-dd00c36f7c07-ca-trust-extracted\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404740    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-default-certificate\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.404778    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:22.904762356 +0000 UTC m=+42.202981702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : secret "router-metrics-certs-default" not found
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404813    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-stats-auth\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.404831 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.404834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-installation-pull-secrets\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.405263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405046    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cad384a6-548d-4dd5-a3fc-808c6db4ae10-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.405263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405097    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad384a6-548d-4dd5-a3fc-808c6db4ae10-tmp\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.405263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-bound-sa-token\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.405263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tctt\" (UniqueName: \"kubernetes.io/projected/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-kube-api-access-6tctt\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.405263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405224    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ceca531-7113-4e27-b88b-fe978af02515-config\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.405263 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-trusted-ca\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.405526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405302    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-image-registry-private-configuration\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.405526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405306    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cad384a6-548d-4dd5-a3fc-808c6db4ae10-snapshots\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.405526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9ht5\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-kube-api-access-f9ht5\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.405526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ceca531-7113-4e27-b88b-fe978af02515-trusted-ca\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.405526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s2h8\" (UniqueName: \"kubernetes.io/projected/cad384a6-548d-4dd5-a3fc-808c6db4ae10-kube-api-access-2s2h8\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.405526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cad384a6-548d-4dd5-a3fc-808c6db4ae10-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.405526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmljb\" (UniqueName: \"kubernetes.io/projected/419ced79-d1e4-41f0-a3b9-4783400bc104-kube-api-access-wmljb\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.405896 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405520    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clfh\" (UniqueName: \"kubernetes.io/projected/0ceca531-7113-4e27-b88b-fe978af02515-kube-api-access-2clfh\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.405896 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.405617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad384a6-548d-4dd5-a3fc-808c6db4ae10-serving-cert\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.406166 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.406148    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ceca531-7113-4e27-b88b-fe978af02515-trusted-ca\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.407340 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.407318    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ceca531-7113-4e27-b88b-fe978af02515-serving-cert\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.407461 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.407419    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-stats-auth\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.407868 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.407848    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-default-certificate\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.408036 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.408018    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cad384a6-548d-4dd5-a3fc-808c6db4ae10-serving-cert\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.417135 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.417111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"
Jul 07 21:59:22.417232 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.417220    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clfh\" (UniqueName: \"kubernetes.io/projected/0ceca531-7113-4e27-b88b-fe978af02515-kube-api-access-2clfh\") pod \"console-operator-68b757fb67-t9xql\" (UID: \"0ceca531-7113-4e27-b88b-fe978af02515\") " pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.417489 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.417471    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tctt\" (UniqueName: \"kubernetes.io/projected/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-kube-api-access-6tctt\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.417582 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.417522    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s2h8\" (UniqueName: \"kubernetes.io/projected/cad384a6-548d-4dd5-a3fc-808c6db4ae10-kube-api-access-2s2h8\") pod \"insights-operator-5c847dcfc4-xfgmq\" (UID: \"cad384a6-548d-4dd5-a3fc-808c6db4ae10\") " pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.430361 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.430345    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:22.475350 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.475326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq"
Jul 07 21:59:22.504249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.504044    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:22.506662 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.506635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-certificates\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.506790 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.506680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9940d32b-7f65-4ed2-b139-dd00c36f7c07-ca-trust-extracted\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.506790 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.506717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-installation-pull-secrets\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.506790 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.506741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-bound-sa-token\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.507572 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507299    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-certificates\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.507572 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507324    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9940d32b-7f65-4ed2-b139-dd00c36f7c07-ca-trust-extracted\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.507572 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-trusted-ca\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.507572 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-image-registry-private-configuration\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.507815 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9ht5\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-kube-api-access-f9ht5\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.507815 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmljb\" (UniqueName: \"kubernetes.io/projected/419ced79-d1e4-41f0-a3b9-4783400bc104-kube-api-access-wmljb\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.507815 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/419ced79-d1e4-41f0-a3b9-4783400bc104-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.507959 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507884    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.507959 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.507908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/419ced79-d1e4-41f0-a3b9-4783400bc104-config\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.509271 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.508663    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/419ced79-d1e4-41f0-a3b9-4783400bc104-config\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.509271 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.508702    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-trusted-ca\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.509271 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.508976    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 21:59:22.509271 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.508991    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b497d757f-tzkgl: secret "image-registry-tls" not found
Jul 07 21:59:22.509271 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.509056    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls podName:9940d32b-7f65-4ed2-b139-dd00c36f7c07 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:23.009037535 +0000 UTC m=+42.307256866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls") pod "image-registry-6b497d757f-tzkgl" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07") : secret "image-registry-tls" not found
Jul 07 21:59:22.512386 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.512262    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-installation-pull-secrets\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.512751 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.512399    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/419ced79-d1e4-41f0-a3b9-4783400bc104-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.512751 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.512420    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-image-registry-private-configuration\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.522508 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.522485    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-bound-sa-token\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.525886 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.525863    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9ht5\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-kube-api-access-f9ht5\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:22.526281 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.526259    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmljb\" (UniqueName: \"kubernetes.io/projected/419ced79-d1e4-41f0-a3b9-4783400bc104-kube-api-access-wmljb\") pod \"service-ca-operator-5d46d9ffd4-4zcst\" (UID: \"419ced79-d1e4-41f0-a3b9-4783400bc104\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.596754 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.596718    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8"]
Jul 07 21:59:22.600371 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.600135    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"
Jul 07 21:59:22.601309 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:22.601279    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df4e0ac_5f34_4fac_92b2_dfaf96d5063a.slice/crio-2ad61b38ef3bc6732c78cf2be9af77f545c6bd19527118cde5f0c5c73366606f WatchSource:0}: Error finding container 2ad61b38ef3bc6732c78cf2be9af77f545c6bd19527118cde5f0c5c73366606f: Status 404 returned error can't find the container with id 2ad61b38ef3bc6732c78cf2be9af77f545c6bd19527118cde5f0c5c73366606f
Jul 07 21:59:22.601639 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.601570    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:22.624825 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.624800    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-t9xql"]
Jul 07 21:59:22.627862 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:22.627841    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ceca531_7113_4e27_b88b_fe978af02515.slice/crio-414ab6181b9ed5a3c2ba93ba2820445ab9316fa1c6c49eab79b31a009d8df363 WatchSource:0}: Error finding container 414ab6181b9ed5a3c2ba93ba2820445ab9316fa1c6c49eab79b31a009d8df363: Status 404 returned error can't find the container with id 414ab6181b9ed5a3c2ba93ba2820445ab9316fa1c6c49eab79b31a009d8df363
Jul 07 21:59:22.661097 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.661030    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xfgmq"]
Jul 07 21:59:22.664770 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:22.664740    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad384a6_548d_4dd5_a3fc_808c6db4ae10.slice/crio-e88a4c085387da0bcf96bf52d8a187b9870441e4963ad9fe0ba589e57827d4d0 WatchSource:0}: Error finding container e88a4c085387da0bcf96bf52d8a187b9870441e4963ad9fe0ba589e57827d4d0: Status 404 returned error can't find the container with id e88a4c085387da0bcf96bf52d8a187b9870441e4963ad9fe0ba589e57827d4d0
Jul 07 21:59:22.700144 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.700080    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:22.749841 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.749804    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst"]
Jul 07 21:59:22.755889 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:22.755867    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419ced79_d1e4_41f0_a3b9_4783400bc104.slice/crio-4684ed50881de3e57efa9c6d028c1e97fc5d6727c14e83326f27199c9b976477 WatchSource:0}: Error finding container 4684ed50881de3e57efa9c6d028c1e97fc5d6727c14e83326f27199c9b976477: Status 404 returned error can't find the container with id 4684ed50881de3e57efa9c6d028c1e97fc5d6727c14e83326f27199c9b976477
Jul 07 21:59:22.888063 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.888032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:22.910979 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.910953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.911062 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.910985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:22.911157 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.911113    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:23.911097674 +0000 UTC m=+43.209317004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : configmap references non-existent config key: service-ca.crt
Jul 07 21:59:22.911157 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.911114    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 21:59:22.911157 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:22.911152    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:23.911144789 +0000 UTC m=+43.209364118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : secret "router-metrics-certs-default" not found
Jul 07 21:59:22.993996 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:22.993968    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:23.012299 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:23.012272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:23.012424 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:23.012408    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 21:59:23.012469 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:23.012427    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b497d757f-tzkgl: secret "image-registry-tls" not found
Jul 07 21:59:23.012505 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:23.012474    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls podName:9940d32b-7f65-4ed2-b139-dd00c36f7c07 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:24.012461567 +0000 UTC m=+43.310680901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls") pod "image-registry-6b497d757f-tzkgl" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07") : secret "image-registry-tls" not found
Jul 07 21:59:23.519449 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:23.519378    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst" event={"ID":"419ced79-d1e4-41f0-a3b9-4783400bc104","Type":"ContainerStarted","Data":"4684ed50881de3e57efa9c6d028c1e97fc5d6727c14e83326f27199c9b976477"}
Jul 07 21:59:23.521224 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:23.521153    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq" event={"ID":"cad384a6-548d-4dd5-a3fc-808c6db4ae10","Type":"ContainerStarted","Data":"e88a4c085387da0bcf96bf52d8a187b9870441e4963ad9fe0ba589e57827d4d0"}
Jul 07 21:59:23.522522 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:23.522465    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" event={"ID":"0ceca531-7113-4e27-b88b-fe978af02515","Type":"ContainerStarted","Data":"414ab6181b9ed5a3c2ba93ba2820445ab9316fa1c6c49eab79b31a009d8df363"}
Jul 07 21:59:23.524148 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:23.524075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8" event={"ID":"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a","Type":"ContainerStarted","Data":"2ad61b38ef3bc6732c78cf2be9af77f545c6bd19527118cde5f0c5c73366606f"}
Jul 07 21:59:23.920960 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:23.920310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:23.920960 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:23.920352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:23.920960 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:23.920500    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 21:59:23.920960 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:23.920504    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:25.920481011 +0000 UTC m=+45.218700343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : configmap references non-existent config key: service-ca.crt
Jul 07 21:59:23.920960 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:23.920594    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:25.920579555 +0000 UTC m=+45.218798884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : secret "router-metrics-certs-default" not found
Jul 07 21:59:24.021683 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:24.021641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:24.021854 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:24.021821    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 21:59:24.021854 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:24.021842    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b497d757f-tzkgl: secret "image-registry-tls" not found
Jul 07 21:59:24.022105 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:24.021918    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls podName:9940d32b-7f65-4ed2-b139-dd00c36f7c07 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:26.021895076 +0000 UTC m=+45.320114408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls") pod "image-registry-6b497d757f-tzkgl" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07") : secret "image-registry-tls" not found
Jul 07 21:59:24.250445 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:24.250329    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:24.352081 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:24.352040    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log" limit=1024
Jul 07 21:59:25.434164 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:25.434116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:25.434572 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:25.434298    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 21:59:25.434572 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:25.434380    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls podName:135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d nodeName:}" failed. No retries permitted until 2026-07-07 21:59:33.434363741 +0000 UTC m=+52.732583070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls") pod "dns-default-rcm4p" (UID: "135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d") : secret "dns-default-metrics-tls" not found
Jul 07 21:59:25.938361 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:25.938325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:25.938361 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:25.938369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:25.938670 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:25.938500    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 21:59:25.938670 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:25.938514    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:29.9384954 +0000 UTC m=+49.236714734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : configmap references non-existent config key: service-ca.crt
Jul 07 21:59:25.938670 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:25.938599    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:29.938581846 +0000 UTC m=+49.236801189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : secret "router-metrics-certs-default" not found
Jul 07 21:59:26.039230 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:26.039187    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:26.039427 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:26.039368    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 21:59:26.039427 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:26.039391    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b497d757f-tzkgl: secret "image-registry-tls" not found
Jul 07 21:59:26.039565 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:26.039473    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls podName:9940d32b-7f65-4ed2-b139-dd00c36f7c07 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:30.039451686 +0000 UTC m=+49.337671029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls") pod "image-registry-6b497d757f-tzkgl" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07") : secret "image-registry-tls" not found
Jul 07 21:59:27.537447 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.537321    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst" event={"ID":"419ced79-d1e4-41f0-a3b9-4783400bc104","Type":"ContainerStarted","Data":"0233d2626dffa98b1238eea429d8af6094a83e6b55623527b597bf7ec6e963fd"}
Jul 07 21:59:27.539435 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.539236    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq" event={"ID":"cad384a6-548d-4dd5-a3fc-808c6db4ae10","Type":"ContainerStarted","Data":"784ba59d0597ede233784094e381013af9cb99c5a1c7d0b51f9817655e1998d8"}
Jul 07 21:59:27.540907 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.540886    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/0.log"
Jul 07 21:59:27.541019 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.540925    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ceca531-7113-4e27-b88b-fe978af02515" containerID="e279d9320ce05c5053e3a3bfb6d572474a11e7fc79a84d2b5710635a49eaa438" exitCode=255
Jul 07 21:59:27.541078 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.541008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" event={"ID":"0ceca531-7113-4e27-b88b-fe978af02515","Type":"ContainerDied","Data":"e279d9320ce05c5053e3a3bfb6d572474a11e7fc79a84d2b5710635a49eaa438"}
Jul 07 21:59:27.541194 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.541175    2567 scope.go:117] "RemoveContainer" containerID="e279d9320ce05c5053e3a3bfb6d572474a11e7fc79a84d2b5710635a49eaa438"
Jul 07 21:59:27.542932 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.542909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8" event={"ID":"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a","Type":"ContainerStarted","Data":"8140cc50e97d366cb70840a812554009f67055e888740160612cb60dc0c9d239"}
Jul 07 21:59:27.555204 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.555156    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst" podStartSLOduration=1.149149193 podStartE2EDuration="5.555138094s" totalImagesPullingTime="4.405988901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:27.554146882 +0000 UTC m=+46.852366234" watchObservedRunningTime="2026-07-07 21:59:27.555138094 +0000 UTC m=+46.853357438"
Jul 07 21:59:27.592665 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.591804    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8" podStartSLOduration=1.03883414 podStartE2EDuration="5.59178001s" totalImagesPullingTime="4.55294587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:27.591772863 +0000 UTC m=+46.889992216" watchObservedRunningTime="2026-07-07 21:59:27.59178001 +0000 UTC m=+46.889999363"
Jul 07 21:59:27.612999 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:27.612938    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq" podStartSLOduration=1.121398501 podStartE2EDuration="5.612916865s" totalImagesPullingTime="4.491518364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:27.612420408 +0000 UTC m=+46.910639760" watchObservedRunningTime="2026-07-07 21:59:27.612916865 +0000 UTC m=+46.911136219"
Jul 07 21:59:28.553635 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.553609    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 21:59:28.554085 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.554067    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/0.log"
Jul 07 21:59:28.554164 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.554108    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ceca531-7113-4e27-b88b-fe978af02515" containerID="753a1b08edd23cf55dde1d877f99ce72bfd9a639f76515ab431e0d084b0988e0" exitCode=255
Jul 07 21:59:28.554253 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.554218    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" event={"ID":"0ceca531-7113-4e27-b88b-fe978af02515","Type":"ContainerDied","Data":"753a1b08edd23cf55dde1d877f99ce72bfd9a639f76515ab431e0d084b0988e0"}
Jul 07 21:59:28.566194 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.566165    2567 scope.go:117] "RemoveContainer" containerID="e279d9320ce05c5053e3a3bfb6d572474a11e7fc79a84d2b5710635a49eaa438"
Jul 07 21:59:28.566332 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.566276    2567 scope.go:117] "RemoveContainer" containerID="753a1b08edd23cf55dde1d877f99ce72bfd9a639f76515ab431e0d084b0988e0"
Jul 07 21:59:28.566473 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:28.566451    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-t9xql_openshift-console-operator(0ceca531-7113-4e27-b88b-fe978af02515)\"" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" podUID="0ceca531-7113-4e27-b88b-fe978af02515"
Jul 07 21:59:28.798903 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.798861    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jf64n"]
Jul 07 21:59:28.831870 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.831764    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jf64n"]
Jul 07 21:59:28.832001 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.831890    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.835574 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.835522    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 21:59:28.836142 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.835930    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 21:59:28.837708 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.837686    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lz8kg\""
Jul 07 21:59:28.866302 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.866273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.866302 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.866305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9c7e19e-3417-4884-bcb0-73329e6d5096-crio-socket\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.866526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.866396    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw82r\" (UniqueName: \"kubernetes.io/projected/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-api-access-cw82r\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.866526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.866448    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.866662 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.866549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9c7e19e-3417-4884-bcb0-73329e6d5096-data-volume\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.967709 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.967679    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.967872 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.967713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9c7e19e-3417-4884-bcb0-73329e6d5096-crio-socket\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.967872 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.967763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw82r\" (UniqueName: \"kubernetes.io/projected/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-api-access-cw82r\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.967872 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.967801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.967872 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:28.967837    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:28.967872 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.967862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9c7e19e-3417-4884-bcb0-73329e6d5096-data-volume\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.968116 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:28.967912    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:29.46789564 +0000 UTC m=+48.766114969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:28.968116 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:28.967931    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 21:59:28.968116 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.967977    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a9c7e19e-3417-4884-bcb0-73329e6d5096-crio-socket\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:28.968116 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:28.967998    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:29.467982058 +0000 UTC m=+48.766201405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : configmap "kube-rbac-proxy" not found
Jul 07 21:59:28.968310 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:28.968152    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9c7e19e-3417-4884-bcb0-73329e6d5096-data-volume\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:29.000136 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:29.000107    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw82r\" (UniqueName: \"kubernetes.io/projected/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-api-access-cw82r\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:29.472681 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:29.472645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:29.472832 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:29.472772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:29.472832 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.472810    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:29.472895 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.472876    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:30.47285884 +0000 UTC m=+49.771078170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:29.472932 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.472901    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 21:59:29.472986 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.472975    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:30.472959488 +0000 UTC m=+49.771178818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : configmap "kube-rbac-proxy" not found
Jul 07 21:59:29.558778 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:29.558744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 21:59:29.559130 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:29.559065    2567 scope.go:117] "RemoveContainer" containerID="753a1b08edd23cf55dde1d877f99ce72bfd9a639f76515ab431e0d084b0988e0"
Jul 07 21:59:29.559244 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.559224    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-t9xql_openshift-console-operator(0ceca531-7113-4e27-b88b-fe978af02515)\"" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" podUID="0ceca531-7113-4e27-b88b-fe978af02515"
Jul 07 21:59:29.977486 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:29.977454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:29.977486 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:29.977488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:29.977700 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.977657    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:37.977636507 +0000 UTC m=+57.275855852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : configmap references non-existent config key: service-ca.crt
Jul 07 21:59:29.977700 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.977662    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 21:59:29.977773 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:29.977714    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:37.977701606 +0000 UTC m=+57.275920951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : secret "router-metrics-certs-default" not found
Jul 07 21:59:30.078489 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:30.078452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:30.078683 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:30.078633    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 21:59:30.078683 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:30.078651    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b497d757f-tzkgl: secret "image-registry-tls" not found
Jul 07 21:59:30.078756 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:30.078712    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls podName:9940d32b-7f65-4ed2-b139-dd00c36f7c07 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:38.078693473 +0000 UTC m=+57.376912804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls") pod "image-registry-6b497d757f-tzkgl" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07") : secret "image-registry-tls" not found
Jul 07 21:59:30.482638 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:30.482608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:30.482790 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:30.482692    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:30.482790 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:30.482748    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:30.482790 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:30.482785    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 21:59:30.482892 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:30.482810    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:32.482793598 +0000 UTC m=+51.781012928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:30.482892 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:30.482827    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:32.482816347 +0000 UTC m=+51.781035680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : configmap "kube-rbac-proxy" not found
Jul 07 21:59:31.238619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:31.238590    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mpgz9_efee0fac-b0f6-48cb-bc56-7102d99df282/dns-node-resolver/0.log"
Jul 07 21:59:32.227509 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:32.227477    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9vcl9_0d7e7a42-1558-456a-be23-2c6b973ad1a4/node-ca/0.log"
Jul 07 21:59:32.430526 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:32.430484    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:32.430919 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:32.430590    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:32.430959 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:32.430928    2567 scope.go:117] "RemoveContainer" containerID="753a1b08edd23cf55dde1d877f99ce72bfd9a639f76515ab431e0d084b0988e0"
Jul 07 21:59:32.431101 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:32.431080    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-t9xql_openshift-console-operator(0ceca531-7113-4e27-b88b-fe978af02515)\"" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" podUID="0ceca531-7113-4e27-b88b-fe978af02515"
Jul 07 21:59:32.502942 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:32.502858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:32.503050 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:32.503015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:32.503050 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:32.503027    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 21:59:32.503126 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:32.503103    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:36.503079961 +0000 UTC m=+55.801299291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : configmap "kube-rbac-proxy" not found
Jul 07 21:59:32.503176 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:32.503159    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:32.503228 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:32.503216    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:36.503201475 +0000 UTC m=+55.801420805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:32.835494 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:32.835461    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfsvp_98f0faa1-778b-42c0-adf4-44c989bc68e5/serve-healthcheck-canary/0.log"
Jul 07 21:59:33.510967 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:33.510931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:33.511401 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:33.511081    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 21:59:33.511401 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:33.511145    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls podName:135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d nodeName:}" failed. No retries permitted until 2026-07-07 21:59:49.511129228 +0000 UTC m=+68.809348557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls") pod "dns-default-rcm4p" (UID: "135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d") : secret "dns-default-metrics-tls" not found
Jul 07 21:59:33.634629 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:33.634595    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-tsnb8_5df4e0ac-5f34-4fac-92b2-dfaf96d5063a/kube-storage-version-migrator-operator/0.log"
Jul 07 21:59:36.537282 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:36.537247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:36.537744 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:36.537359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:36.537744 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:36.537398    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:36.537744 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:36.537473    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls podName:a9c7e19e-3417-4884-bcb0-73329e6d5096 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:44.537458726 +0000 UTC m=+63.835678054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jf64n" (UID: "a9c7e19e-3417-4884-bcb0-73329e6d5096") : secret "insights-runtime-extractor-tls" not found
Jul 07 21:59:36.537876 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:36.537856    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a9c7e19e-3417-4884-bcb0-73329e6d5096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:38.050716 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:38.050678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:38.050716 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:38.050711    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:38.051200 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:38.050839    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 21:59:38.051200 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:38.050860    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:54.050843375 +0000 UTC m=+73.349062718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : configmap references non-existent config key: service-ca.crt
Jul 07 21:59:38.051200 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:38.050886    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs podName:3fec479e-1fb0-4c6a-a8ee-e7b8171b6439 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:54.050875224 +0000 UTC m=+73.349094557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs") pod "router-default-f58964cdf-9k4jp" (UID: "3fec479e-1fb0-4c6a-a8ee-e7b8171b6439") : secret "router-metrics-certs-default" not found
Jul 07 21:59:38.151925 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:38.151892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:38.152092 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:38.152013    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 21:59:38.152092 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:38.152026    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b497d757f-tzkgl: secret "image-registry-tls" not found
Jul 07 21:59:38.152092 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:38.152073    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls podName:9940d32b-7f65-4ed2-b139-dd00c36f7c07 nodeName:}" failed. No retries permitted until 2026-07-07 21:59:54.152060519 +0000 UTC m=+73.450279849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls") pod "image-registry-6b497d757f-tzkgl" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07") : secret "image-registry-tls" not found
Jul 07 21:59:42.490559 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:42.490513    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmhl5"
Jul 07 21:59:44.611296 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:44.611247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:44.613684 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:44.613653    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a9c7e19e-3417-4884-bcb0-73329e6d5096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jf64n\" (UID: \"a9c7e19e-3417-4884-bcb0-73329e6d5096\") " pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:44.745957 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:44.745923    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lz8kg\""
Jul 07 21:59:44.754182 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:44.754163    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jf64n"
Jul 07 21:59:44.882383 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:44.882316    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jf64n"]
Jul 07 21:59:44.884814 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:44.884775    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c7e19e_3417_4884_bcb0_73329e6d5096.slice/crio-21ceac1a13335fe9428fb808e4128a08c7f7e14c29b7c0a5b80e7abc06208abe WatchSource:0}: Error finding container 21ceac1a13335fe9428fb808e4128a08c7f7e14c29b7c0a5b80e7abc06208abe: Status 404 returned error can't find the container with id 21ceac1a13335fe9428fb808e4128a08c7f7e14c29b7c0a5b80e7abc06208abe
Jul 07 21:59:45.247863 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:45.247784    2567 scope.go:117] "RemoveContainer" containerID="753a1b08edd23cf55dde1d877f99ce72bfd9a639f76515ab431e0d084b0988e0"
Jul 07 21:59:45.602395 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:45.602319    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 21:59:45.602586 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:45.602414    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" event={"ID":"0ceca531-7113-4e27-b88b-fe978af02515","Type":"ContainerStarted","Data":"cd05f4b736e97ca4346bd49bd3bbbdec2d60128d26c8f6e2969bdd1a3cf2adce"}
Jul 07 21:59:45.604557 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:45.604469    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:45.606132 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:45.606082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf64n" event={"ID":"a9c7e19e-3417-4884-bcb0-73329e6d5096","Type":"ContainerStarted","Data":"21ceac1a13335fe9428fb808e4128a08c7f7e14c29b7c0a5b80e7abc06208abe"}
Jul 07 21:59:45.622825 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:45.621913    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-t9xql" podStartSLOduration=19.0940601 podStartE2EDuration="23.621898193s" totalImagesPullingTime="4.527838093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:45.621205857 +0000 UTC m=+64.919425213" watchObservedRunningTime="2026-07-07 21:59:45.621898193 +0000 UTC m=+64.920117522"
Jul 07 21:59:46.017363 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:46.013637    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-t9xql"
Jul 07 21:59:46.933439 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:46.933399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:46.933865 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:46.933450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:46.936683 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:46.936426    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 21:59:46.936683 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:46.936501    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 21:59:46.947152 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:46.947123    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e731550a-f9e4-4dcc-8753-211daa613598-original-pull-secret\") pod \"global-pull-secret-syncer-hrp64\" (UID: \"e731550a-f9e4-4dcc-8753-211daa613598\") " pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:46.947152 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:46.947148    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f27fff47-fac3-41e3-888d-51dd9379d416-metrics-certs\") pod \"network-metrics-daemon-j4m6v\" (UID: \"f27fff47-fac3-41e3-888d-51dd9379d416\") " pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:47.034387 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.034344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:47.037122 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.037099    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 21:59:47.049060 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.049037    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 21:59:47.058384 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.058361    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5748z\" (UniqueName: \"kubernetes.io/projected/00fdd688-6629-4841-af58-45a9e14aacc1-kube-api-access-5748z\") pod \"network-check-target-l85fh\" (UID: \"00fdd688-6629-4841-af58-45a9e14aacc1\") " pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:47.161056 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.161019    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqsmx\""
Jul 07 21:59:47.164481 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.164454    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrp64"
Jul 07 21:59:47.168587 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.168562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4m6v"
Jul 07 21:59:47.355934 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.355903    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8gff\""
Jul 07 21:59:47.363369 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:47.363343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:48.822085 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:48.822051    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j4m6v"]
Jul 07 21:59:48.825982 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:48.825952    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27fff47_fac3_41e3_888d_51dd9379d416.slice/crio-39a55e02edcd5ddb78f5bad307db140c905d18243d360018f872470e3f6df0b2 WatchSource:0}: Error finding container 39a55e02edcd5ddb78f5bad307db140c905d18243d360018f872470e3f6df0b2: Status 404 returned error can't find the container with id 39a55e02edcd5ddb78f5bad307db140c905d18243d360018f872470e3f6df0b2
Jul 07 21:59:49.045162 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.045135    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l85fh"]
Jul 07 21:59:49.048898 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:49.048872    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fdd688_6629_4841_af58_45a9e14aacc1.slice/crio-79effad074e67a4dcac484514f1e4f49438545ceb9562641111a8167b656695b WatchSource:0}: Error finding container 79effad074e67a4dcac484514f1e4f49438545ceb9562641111a8167b656695b: Status 404 returned error can't find the container with id 79effad074e67a4dcac484514f1e4f49438545ceb9562641111a8167b656695b
Jul 07 21:59:49.055328 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.055309    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrp64"]
Jul 07 21:59:49.057246 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:49.057220    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode731550a_f9e4_4dcc_8753_211daa613598.slice/crio-d67e5694307862a27ea9cc82be7847e1ad0eaf710c64dd6fa1ad258339829f38 WatchSource:0}: Error finding container d67e5694307862a27ea9cc82be7847e1ad0eaf710c64dd6fa1ad258339829f38: Status 404 returned error can't find the container with id d67e5694307862a27ea9cc82be7847e1ad0eaf710c64dd6fa1ad258339829f38
Jul 07 21:59:49.554621 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.554587    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:49.557366 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.557335    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d-metrics-tls\") pod \"dns-default-rcm4p\" (UID: \"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d\") " pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:49.624113 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.624080    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrp64" event={"ID":"e731550a-f9e4-4dcc-8753-211daa613598","Type":"ContainerStarted","Data":"d67e5694307862a27ea9cc82be7847e1ad0eaf710c64dd6fa1ad258339829f38"}
Jul 07 21:59:49.625344 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.625310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4m6v" event={"ID":"f27fff47-fac3-41e3-888d-51dd9379d416","Type":"ContainerStarted","Data":"39a55e02edcd5ddb78f5bad307db140c905d18243d360018f872470e3f6df0b2"}
Jul 07 21:59:49.626587 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.626558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l85fh" event={"ID":"00fdd688-6629-4841-af58-45a9e14aacc1","Type":"ContainerStarted","Data":"79effad074e67a4dcac484514f1e4f49438545ceb9562641111a8167b656695b"}
Jul 07 21:59:49.629390 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.629363    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf64n" event={"ID":"a9c7e19e-3417-4884-bcb0-73329e6d5096","Type":"ContainerStarted","Data":"6fd43fd2b333c92ace36684f91b279ed5f131cdddf8378db355977ddf74ddbed"}
Jul 07 21:59:49.700268 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.700234    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c5lw\""
Jul 07 21:59:49.708521 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:49.708486    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:50.030412 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:50.030372    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rcm4p"]
Jul 07 21:59:50.177305 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:50.177225    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135699d8_a1c1_44b8_9f3f_71e5a5ca3d8d.slice/crio-bbef8297bd534623968e64a7ac7ff62ac5137fc4ab6b4b755491bcc78fd4ff1e WatchSource:0}: Error finding container bbef8297bd534623968e64a7ac7ff62ac5137fc4ab6b4b755491bcc78fd4ff1e: Status 404 returned error can't find the container with id bbef8297bd534623968e64a7ac7ff62ac5137fc4ab6b4b755491bcc78fd4ff1e
Jul 07 21:59:50.637041 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:50.637002    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rcm4p" event={"ID":"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d","Type":"ContainerStarted","Data":"bbef8297bd534623968e64a7ac7ff62ac5137fc4ab6b4b755491bcc78fd4ff1e"}
Jul 07 21:59:50.639222 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:50.639196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4m6v" event={"ID":"f27fff47-fac3-41e3-888d-51dd9379d416","Type":"ContainerStarted","Data":"d086f89629cc533ef6ae357e72d8e1016f1c958da4f36488dc3aa6f1a8e29af5"}
Jul 07 21:59:50.639357 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:50.639238    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4m6v" event={"ID":"f27fff47-fac3-41e3-888d-51dd9379d416","Type":"ContainerStarted","Data":"425e2da8554136883a45a71deb6e63a473185798ed21c85f6464873f310dbf9c"}
Jul 07 21:59:50.659962 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:50.659917    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j4m6v" podStartSLOduration=68.286090236 podStartE2EDuration="1m9.659902209s" totalImagesPullingTime="1.373811973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:50.658814553 +0000 UTC m=+69.957033906" watchObservedRunningTime="2026-07-07 21:59:50.659902209 +0000 UTC m=+69.958121559"
Jul 07 21:59:51.646750 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:51.646703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf64n" event={"ID":"a9c7e19e-3417-4884-bcb0-73329e6d5096","Type":"ContainerStarted","Data":"c75d4cc54c8108316066b4f3cd281a2f3ef3c01cd4dc4e99e8d16c3ad515f762"}
Jul 07 21:59:53.638467 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.638432    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"]
Jul 07 21:59:53.640523 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.640503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.643638 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.643613    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 21:59:53.645295 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.645272    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 21:59:53.645399 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.645329    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 21:59:53.645399 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.645329    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rvhm5\""
Jul 07 21:59:53.648233 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.647893    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 21:59:53.671265 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.671224    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"]
Jul 07 21:59:53.673295 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.673265    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"]
Jul 07 21:59:53.673421 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.673358    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.676195 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.676176    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 21:59:53.696814 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.696788    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"]
Jul 07 21:59:53.709077 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.709050    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b497d757f-tzkgl"]
Jul 07 21:59:53.709320 ip-10-0-128-35 kubenswrapper[2567]: E0707 21:59:53.709295    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6b497d757f-tzkgl" podUID="9940d32b-7f65-4ed2-b139-dd00c36f7c07"
Jul 07 21:59:53.767851 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.767816    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-2w99d"]
Jul 07 21:59:53.770078 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.770047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2w99d"
Jul 07 21:59:53.772898 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.772873    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 21:59:53.773000 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.772908    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tb8bm\""
Jul 07 21:59:53.773196 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.773180    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 21:59:53.787962 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.787937    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2w99d"]
Jul 07 21:59:53.792236 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.792212    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26ade19e-e027-4582-864d-14f96f81dab4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c6f88cf6-lklll\" (UID: \"26ade19e-e027-4582-864d-14f96f81dab4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.792354 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.792249    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.792407 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.792324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-tmp\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.792461 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.792392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp8pw\" (UniqueName: \"kubernetes.io/projected/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-kube-api-access-kp8pw\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.792515 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.792495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b29gl\" (UniqueName: \"kubernetes.io/projected/26ade19e-e027-4582-864d-14f96f81dab4-kube-api-access-b29gl\") pod \"managed-serviceaccount-addon-agent-6c6f88cf6-lklll\" (UID: \"26ade19e-e027-4582-864d-14f96f81dab4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.835832 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.835800    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f8c66bb86-8z548"]
Jul 07 21:59:53.837991 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.837965    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.856885 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.856828    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f8c66bb86-8z548"]
Jul 07 21:59:53.893210 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.893109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b29gl\" (UniqueName: \"kubernetes.io/projected/26ade19e-e027-4582-864d-14f96f81dab4-kube-api-access-b29gl\") pod \"managed-serviceaccount-addon-agent-6c6f88cf6-lklll\" (UID: \"26ade19e-e027-4582-864d-14f96f81dab4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.893210 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.893177    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26ade19e-e027-4582-864d-14f96f81dab4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c6f88cf6-lklll\" (UID: \"26ade19e-e027-4582-864d-14f96f81dab4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.893400 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.893217    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.893400 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.893259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7mtq\" (UniqueName: \"kubernetes.io/projected/a31cc548-4b33-40a4-a9d5-2aacb0769c41-kube-api-access-h7mtq\") pod \"downloads-685bfb5f64-2w99d\" (UID: \"a31cc548-4b33-40a4-a9d5-2aacb0769c41\") " pod="openshift-console/downloads-685bfb5f64-2w99d"
Jul 07 21:59:53.893400 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.893300    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-tmp\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.893400 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.893326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp8pw\" (UniqueName: \"kubernetes.io/projected/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-kube-api-access-kp8pw\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.893783 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.893754    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-tmp\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.896431 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.896402    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26ade19e-e027-4582-864d-14f96f81dab4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c6f88cf6-lklll\" (UID: \"26ade19e-e027-4582-864d-14f96f81dab4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.896431 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.896406    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.911629 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.911589    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp8pw\" (UniqueName: \"kubernetes.io/projected/3ddc9a01-aef5-4716-9d2c-ea95c3d81f76-kube-api-access-kp8pw\") pod \"klusterlet-addon-workmgr-9c776d6b7-vdkvl\" (UID: \"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.912498 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.912472    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b29gl\" (UniqueName: \"kubernetes.io/projected/26ade19e-e027-4582-864d-14f96f81dab4-kube-api-access-b29gl\") pod \"managed-serviceaccount-addon-agent-6c6f88cf6-lklll\" (UID: \"26ade19e-e027-4582-864d-14f96f81dab4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.960190 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.960158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"
Jul 07 21:59:53.985073 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.984971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 21:59:53.994109 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-registry-tls\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.994249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mtq\" (UniqueName: \"kubernetes.io/projected/a31cc548-4b33-40a4-a9d5-2aacb0769c41-kube-api-access-h7mtq\") pod \"downloads-685bfb5f64-2w99d\" (UID: \"a31cc548-4b33-40a4-a9d5-2aacb0769c41\") " pod="openshift-console/downloads-685bfb5f64-2w99d"
Jul 07 21:59:53.994249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-bound-sa-token\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.994249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994172    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bccd42ad-cdf2-487d-a03a-d688cf0098e8-installation-pull-secrets\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.994249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bccd42ad-cdf2-487d-a03a-d688cf0098e8-image-registry-private-configuration\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.994249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-556cb\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-kube-api-access-556cb\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.994249 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bccd42ad-cdf2-487d-a03a-d688cf0098e8-registry-certificates\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.994577 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bccd42ad-cdf2-487d-a03a-d688cf0098e8-trusted-ca\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:53.994577 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:53.994347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bccd42ad-cdf2-487d-a03a-d688cf0098e8-ca-trust-extracted\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.009238 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.009213    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7mtq\" (UniqueName: \"kubernetes.io/projected/a31cc548-4b33-40a4-a9d5-2aacb0769c41-kube-api-access-h7mtq\") pod \"downloads-685bfb5f64-2w99d\" (UID: \"a31cc548-4b33-40a4-a9d5-2aacb0769c41\") " pod="openshift-console/downloads-685bfb5f64-2w99d"
Jul 07 21:59:54.082917 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.082875    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2w99d"
Jul 07 21:59:54.095447 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-bound-sa-token\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.095619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bccd42ad-cdf2-487d-a03a-d688cf0098e8-installation-pull-secrets\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.095619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095496    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bccd42ad-cdf2-487d-a03a-d688cf0098e8-image-registry-private-configuration\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.095619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095521    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-556cb\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-kube-api-access-556cb\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.095619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bccd42ad-cdf2-487d-a03a-d688cf0098e8-registry-certificates\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.095619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:54.095912 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:54.095912 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bccd42ad-cdf2-487d-a03a-d688cf0098e8-trusted-ca\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.095912 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bccd42ad-cdf2-487d-a03a-d688cf0098e8-ca-trust-extracted\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.095912 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.095754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-registry-tls\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.096380 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.096253    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bccd42ad-cdf2-487d-a03a-d688cf0098e8-ca-trust-extracted\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.096583 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.096500    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bccd42ad-cdf2-487d-a03a-d688cf0098e8-registry-certificates\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.096704 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.096635    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bccd42ad-cdf2-487d-a03a-d688cf0098e8-trusted-ca\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.096940 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.096897    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-service-ca-bundle\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:54.098397 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.098373    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bccd42ad-cdf2-487d-a03a-d688cf0098e8-installation-pull-secrets\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.098727 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.098711    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bccd42ad-cdf2-487d-a03a-d688cf0098e8-image-registry-private-configuration\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.098925 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.098909    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fec479e-1fb0-4c6a-a8ee-e7b8171b6439-metrics-certs\") pod \"router-default-f58964cdf-9k4jp\" (UID: \"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439\") " pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:54.099200 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.099182    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-registry-tls\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.109606 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.109584    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-bound-sa-token\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.110020 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.110003    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-556cb\" (UniqueName: \"kubernetes.io/projected/bccd42ad-cdf2-487d-a03a-d688cf0098e8-kube-api-access-556cb\") pod \"image-registry-f8c66bb86-8z548\" (UID: \"bccd42ad-cdf2-487d-a03a-d688cf0098e8\") " pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.151274 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.151164    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bzmhm\""
Jul 07 21:59:54.159130 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.159101    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:54.196371 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.196337    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:54.199079 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.199057    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"image-registry-6b497d757f-tzkgl\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") " pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:54.265517 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.265489    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2jqmh\""
Jul 07 21:59:54.273771 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.273746    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:54.662353 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.662322    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:54.671752 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.671728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:54.801024 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.800989    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9940d32b-7f65-4ed2-b139-dd00c36f7c07-ca-trust-extracted\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801225 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801072    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-image-registry-private-configuration\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801225 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801095    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-installation-pull-secrets\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801225 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801127    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-trusted-ca\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801225 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801153    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-certificates\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801443 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801299    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9940d32b-7f65-4ed2-b139-dd00c36f7c07-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 21:59:54.801554 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801473    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 21:59:54.801633 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801549    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801633 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801585    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9ht5\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-kube-api-access-f9ht5\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801633 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801621    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-bound-sa-token\") pod \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\" (UID: \"9940d32b-7f65-4ed2-b139-dd00c36f7c07\") "
Jul 07 21:59:54.801785 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801701    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 21:59:54.802033 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.801902    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9940d32b-7f65-4ed2-b139-dd00c36f7c07-ca-trust-extracted\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:54.802137 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.802041    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-trusted-ca\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:54.802137 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.802056    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-certificates\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:54.804012 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.803964    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 21:59:54.804213 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.804187    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 21:59:54.804296 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.804259    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 21:59:54.804408 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.804382    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-kube-api-access-f9ht5" (OuterVolumeSpecName: "kube-api-access-f9ht5") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "kube-api-access-f9ht5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 21:59:54.804466 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.804431    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9940d32b-7f65-4ed2-b139-dd00c36f7c07" (UID: "9940d32b-7f65-4ed2-b139-dd00c36f7c07"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 21:59:54.902966 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.902924    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9ht5\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-kube-api-access-f9ht5\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:54.902966 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.902966    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-bound-sa-token\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:54.903154 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.902983    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-image-registry-private-configuration\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:54.903154 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.902992    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9940d32b-7f65-4ed2-b139-dd00c36f7c07-installation-pull-secrets\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:54.903154 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:54.903000    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9940d32b-7f65-4ed2-b139-dd00c36f7c07-registry-tls\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 21:59:55.672190 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:55.671489    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b497d757f-tzkgl"
Jul 07 21:59:55.716034 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:55.715981    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b497d757f-tzkgl"]
Jul 07 21:59:55.722906 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:55.722634    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b497d757f-tzkgl"]
Jul 07 21:59:55.830747 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:55.830333    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f8c66bb86-8z548"]
Jul 07 21:59:55.901185 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:55.901149    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f58964cdf-9k4jp"]
Jul 07 21:59:55.909835 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:55.909380    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fec479e_1fb0_4c6a_a8ee_e7b8171b6439.slice/crio-08dff36da73480fe7e719c3af756e7e0d27836f460db0a50643a08fdad57adab WatchSource:0}: Error finding container 08dff36da73480fe7e719c3af756e7e0d27836f460db0a50643a08fdad57adab: Status 404 returned error can't find the container with id 08dff36da73480fe7e719c3af756e7e0d27836f460db0a50643a08fdad57adab
Jul 07 21:59:56.044338 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.044309    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"]
Jul 07 21:59:56.046957 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:56.046916    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddc9a01_aef5_4716_9d2c_ea95c3d81f76.slice/crio-ead48dd98da34b768f83f26013aecc3b6d2dc2a73480908ff7ff4dd445863b5e WatchSource:0}: Error finding container ead48dd98da34b768f83f26013aecc3b6d2dc2a73480908ff7ff4dd445863b5e: Status 404 returned error can't find the container with id ead48dd98da34b768f83f26013aecc3b6d2dc2a73480908ff7ff4dd445863b5e
Jul 07 21:59:56.052547 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.052503    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll"]
Jul 07 21:59:56.052629 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.052575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2w99d"]
Jul 07 21:59:56.054459 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:56.054433    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26ade19e_e027_4582_864d_14f96f81dab4.slice/crio-253c1dbf8ec12ef2cfb0c07cbe2e6c07bad5f45fb3755fbd15ad0dedacf37c25 WatchSource:0}: Error finding container 253c1dbf8ec12ef2cfb0c07cbe2e6c07bad5f45fb3755fbd15ad0dedacf37c25: Status 404 returned error can't find the container with id 253c1dbf8ec12ef2cfb0c07cbe2e6c07bad5f45fb3755fbd15ad0dedacf37c25
Jul 07 21:59:56.055084 ip-10-0-128-35 kubenswrapper[2567]: W0707 21:59:56.055066    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31cc548_4b33_40a4_a9d5_2aacb0769c41.slice/crio-7016a35944c2f65c708bdd9483d90040673c2ec5ea079a3446f6a42709240a2d WatchSource:0}: Error finding container 7016a35944c2f65c708bdd9483d90040673c2ec5ea079a3446f6a42709240a2d: Status 404 returned error can't find the container with id 7016a35944c2f65c708bdd9483d90040673c2ec5ea079a3446f6a42709240a2d
Jul 07 21:59:56.680956 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.680918    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l85fh" event={"ID":"00fdd688-6629-4841-af58-45a9e14aacc1","Type":"ContainerStarted","Data":"cd00b06359de7fd6f74fe33e05fe26b1f852afa3ed7429965219ad34ecfcc8f4"}
Jul 07 21:59:56.681636 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.681615    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 21:59:56.684697 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.684667    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2w99d" event={"ID":"a31cc548-4b33-40a4-a9d5-2aacb0769c41","Type":"ContainerStarted","Data":"7016a35944c2f65c708bdd9483d90040673c2ec5ea079a3446f6a42709240a2d"}
Jul 07 21:59:56.687852 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.687355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f58964cdf-9k4jp" event={"ID":"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439","Type":"ContainerStarted","Data":"269ed2dbe83409449c9b2533501dd7e744e06a08aaeb87d00f347bfaad98f012"}
Jul 07 21:59:56.687852 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.687406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f58964cdf-9k4jp" event={"ID":"3fec479e-1fb0-4c6a-a8ee-e7b8171b6439","Type":"ContainerStarted","Data":"08dff36da73480fe7e719c3af756e7e0d27836f460db0a50643a08fdad57adab"}
Jul 07 21:59:56.689889 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.689280    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f8c66bb86-8z548" event={"ID":"bccd42ad-cdf2-487d-a03a-d688cf0098e8","Type":"ContainerStarted","Data":"b8c31a08a26a55d3b9074a483c9c4320ab5cde075a20729bc3853b31d25099d0"}
Jul 07 21:59:56.689889 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.689324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f8c66bb86-8z548" event={"ID":"bccd42ad-cdf2-487d-a03a-d688cf0098e8","Type":"ContainerStarted","Data":"a01e3fb7d810f056af87c3d663b7dc5ffebd0564edeb7659b00b73c811473536"}
Jul 07 21:59:56.689889 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.689837    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 21:59:56.694725 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.694274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jf64n" event={"ID":"a9c7e19e-3417-4884-bcb0-73329e6d5096","Type":"ContainerStarted","Data":"c8ca6a52bf17ce77f6425128ed6135305c4e37a496e6b463e1ed7953c165097e"}
Jul 07 21:59:56.698843 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.698194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rcm4p" event={"ID":"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d","Type":"ContainerStarted","Data":"67a280f0bd7016adad9b4c73f0aa5e4c4c84cd5d340b36b7bc517b533f20bf90"}
Jul 07 21:59:56.698843 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.698265    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rcm4p" event={"ID":"135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d","Type":"ContainerStarted","Data":"ae3f37d78c0aa24c20cb2245e5a25d60a6ca39e241d83d665e3c25635c92cbd8"}
Jul 07 21:59:56.698843 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.698804    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rcm4p"
Jul 07 21:59:56.702204 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.701647    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l85fh" podStartSLOduration=69.180912387 podStartE2EDuration="1m15.701628605s" totalImagesPullingTime="6.520716218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:56.700014686 +0000 UTC m=+75.998234037" watchObservedRunningTime="2026-07-07 21:59:56.701628605 +0000 UTC m=+75.999847954"
Jul 07 21:59:56.703189 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.703127    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl" event={"ID":"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76","Type":"ContainerStarted","Data":"ead48dd98da34b768f83f26013aecc3b6d2dc2a73480908ff7ff4dd445863b5e"}
Jul 07 21:59:56.705548 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.705137    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrp64" event={"ID":"e731550a-f9e4-4dcc-8753-211daa613598","Type":"ContainerStarted","Data":"05455e3d5db8644bd0fdb0be116f9bec8568ef6c827ed58e9ab843114f68d4d2"}
Jul 07 21:59:56.709131 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.709089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll" event={"ID":"26ade19e-e027-4582-864d-14f96f81dab4","Type":"ContainerStarted","Data":"253c1dbf8ec12ef2cfb0c07cbe2e6c07bad5f45fb3755fbd15ad0dedacf37c25"}
Jul 07 21:59:56.726330 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.726274    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jf64n" podStartSLOduration=18.168811183 podStartE2EDuration="28.726259875s" totalImagesPullingTime="10.557448692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:59:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:56.725282139 +0000 UTC m=+76.023501527" watchObservedRunningTime="2026-07-07 21:59:56.726259875 +0000 UTC m=+76.024479229"
Jul 07 21:59:56.747693 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.746240    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rcm4p" podStartSLOduration=34.365444294 podStartE2EDuration="39.746220319s" totalImagesPullingTime="5.380776025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:56.745060816 +0000 UTC m=+76.043280166" watchObservedRunningTime="2026-07-07 21:59:56.746220319 +0000 UTC m=+76.044439670"
Jul 07 21:59:56.792781 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.791338    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f58964cdf-9k4jp" podStartSLOduration=34.791317294 podStartE2EDuration="34.791317294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:56.769238466 +0000 UTC m=+76.067457831" watchObservedRunningTime="2026-07-07 21:59:56.791317294 +0000 UTC m=+76.089536648"
Jul 07 21:59:56.792781 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.791921    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f8c66bb86-8z548" podStartSLOduration=3.7919058789999998 podStartE2EDuration="3.791905879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:56.790647446 +0000 UTC m=+76.088866797" watchObservedRunningTime="2026-07-07 21:59:56.791905879 +0000 UTC m=+76.090125231"
Jul 07 21:59:56.809619 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:56.807883    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hrp64" podStartSLOduration=69.288958988 podStartE2EDuration="1m15.807865202s" totalImagesPullingTime="6.518906214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 21:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 21:59:56.807671678 +0000 UTC m=+76.105891217" watchObservedRunningTime="2026-07-07 21:59:56.807865202 +0000 UTC m=+76.106084552"
Jul 07 21:59:57.252310 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:57.252087    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9940d32b-7f65-4ed2-b139-dd00c36f7c07" path="/var/lib/kubelet/pods/9940d32b-7f65-4ed2-b139-dd00c36f7c07/volumes"
Jul 07 21:59:57.274389 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:57.274319    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:57.277336 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:57.277312    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:57.716911 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:57.716879    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 21:59:57.718133 ip-10-0-128-35 kubenswrapper[2567]: I0707 21:59:57.718109    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f58964cdf-9k4jp"
Jul 07 22:00:01.738628 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:01.738576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl" event={"ID":"3ddc9a01-aef5-4716-9d2c-ea95c3d81f76","Type":"ContainerStarted","Data":"0354717f715f70fdcfb76adf7bc5c8ed3e4ba7436ccef4cb0ff3415c85c48ab8"}
Jul 07 22:00:01.739061 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:01.738740    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 22:00:01.740811 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:01.740782    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll" event={"ID":"26ade19e-e027-4582-864d-14f96f81dab4","Type":"ContainerStarted","Data":"d09345e4c7aecf4fc388fb1107d86a4478517af7c7f321b6b89e2943a88deb49"}
Jul 07 22:00:01.741409 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:01.741384    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl"
Jul 07 22:00:01.768145 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:01.768079    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c776d6b7-vdkvl" podStartSLOduration=3.918474931 podStartE2EDuration="8.768061642s" totalImagesPullingTime="4.849586711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:00:01.766675773 +0000 UTC m=+81.064895119" watchObservedRunningTime="2026-07-07 22:00:01.768061642 +0000 UTC m=+81.066280995"
Jul 07 22:00:01.786637 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:01.786580    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c6f88cf6-lklll" podStartSLOduration=3.957956863 podStartE2EDuration="8.786566788s" totalImagesPullingTime="4.828609925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:00:01.785885461 +0000 UTC m=+81.084104813" watchObservedRunningTime="2026-07-07 22:00:01.786566788 +0000 UTC m=+81.084786142"
Jul 07 22:00:07.727995 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:07.727962    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rcm4p"
Jul 07 22:00:11.464041 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.464004    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dxj9k"]
Jul 07 22:00:11.621045 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.621009    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.623778 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.623752    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 22:00:11.623908 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.623810    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 22:00:11.623908 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.623878    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 22:00:11.624028 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.623906    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 22:00:11.625072 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.624946    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 22:00:11.625072 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.624951    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kt52f\""
Jul 07 22:00:11.625072 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.625022    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 22:00:11.631063 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631040    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-textfile\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631150 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631150 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-sys\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631238 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-wtmp\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631238 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-metrics-client-ca\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631335 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4fh\" (UniqueName: \"kubernetes.io/projected/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-kube-api-access-kp4fh\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631335 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631268    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631335 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-root\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.631466 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.631373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-tls\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732489 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732489 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-sys\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732489    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-wtmp\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-metrics-client-ca\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4fh\" (UniqueName: \"kubernetes.io/projected/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-kube-api-access-kp4fh\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732606    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-sys\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-root\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732671    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-root\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-tls\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.732749 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732736    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-textfile\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.733257 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.732687    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-wtmp\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.733257 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.733249    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.733611 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.733593    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-metrics-client-ca\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.733736 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.733710    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-textfile\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.735543 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.735504    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.735885 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.735862    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-node-exporter-tls\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.742709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.742686    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4fh\" (UniqueName: \"kubernetes.io/projected/2ca0bb30-7001-4bf1-99ca-58ed330c60cd-kube-api-access-kp4fh\") pod \"node-exporter-dxj9k\" (UID: \"2ca0bb30-7001-4bf1-99ca-58ed330c60cd\") " pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:11.932159 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:11.932128    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dxj9k"
Jul 07 22:00:13.209433 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:00:13.209393    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca0bb30_7001_4bf1_99ca_58ed330c60cd.slice/crio-ddc0cfcf4911c7f64c67fc0698ed2d7b81a2b86fe919a9b7d1048ccfbb5d6a9c WatchSource:0}: Error finding container ddc0cfcf4911c7f64c67fc0698ed2d7b81a2b86fe919a9b7d1048ccfbb5d6a9c: Status 404 returned error can't find the container with id ddc0cfcf4911c7f64c67fc0698ed2d7b81a2b86fe919a9b7d1048ccfbb5d6a9c
Jul 07 22:00:13.790901 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:13.790821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxj9k" event={"ID":"2ca0bb30-7001-4bf1-99ca-58ed330c60cd","Type":"ContainerStarted","Data":"ddc0cfcf4911c7f64c67fc0698ed2d7b81a2b86fe919a9b7d1048ccfbb5d6a9c"}
Jul 07 22:00:13.792599 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:13.792572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2w99d" event={"ID":"a31cc548-4b33-40a4-a9d5-2aacb0769c41","Type":"ContainerStarted","Data":"b65f51ef9cdb9d2f6648401bb46843e02135a9570372086353a876ab391dc177"}
Jul 07 22:00:13.792827 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:13.792810    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-2w99d"
Jul 07 22:00:13.794260 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:13.794236    2567 patch_prober.go:28] interesting pod/downloads-685bfb5f64-2w99d container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.17:8080/\": dial tcp 10.132.0.17:8080: connect: connection refused" start-of-body=
Jul 07 22:00:13.794386 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:13.794284    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-2w99d" podUID="a31cc548-4b33-40a4-a9d5-2aacb0769c41" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.17:8080/\": dial tcp 10.132.0.17:8080: connect: connection refused"
Jul 07 22:00:13.813385 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:13.813301    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-2w99d" podStartSLOduration=3.304820684 podStartE2EDuration="20.8132884s" totalImagesPullingTime="17.508467716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 21:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:00:13.811896248 +0000 UTC m=+93.110115599" watchObservedRunningTime="2026-07-07 22:00:13.8132884 +0000 UTC m=+93.111507750"
Jul 07 22:00:14.799423 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:14.799383    2567 generic.go:356] "Generic (PLEG): container finished" podID="2ca0bb30-7001-4bf1-99ca-58ed330c60cd" containerID="e5443a7c58049fbb43572c1f0cb9ba55c1c99e1e0bee47cc6c16cbeff76ef293" exitCode=0
Jul 07 22:00:14.799969 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:14.799481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxj9k" event={"ID":"2ca0bb30-7001-4bf1-99ca-58ed330c60cd","Type":"ContainerDied","Data":"e5443a7c58049fbb43572c1f0cb9ba55c1c99e1e0bee47cc6c16cbeff76ef293"}
Jul 07 22:00:14.804823 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:14.804801    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-2w99d"
Jul 07 22:00:15.806820 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:15.806774    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxj9k" event={"ID":"2ca0bb30-7001-4bf1-99ca-58ed330c60cd","Type":"ContainerStarted","Data":"abf8a4beee3fec81cad94eeda6d1f7782997aa0341d369cff2c782338524acde"}
Jul 07 22:00:15.807393 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:15.806853    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxj9k" event={"ID":"2ca0bb30-7001-4bf1-99ca-58ed330c60cd","Type":"ContainerStarted","Data":"0a4e3445cfc3d55999473d58871bc0d9968c2df0d50ab1559e97dc818f042710"}
Jul 07 22:00:15.827796 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:15.827740    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dxj9k" podStartSLOduration=3.559018729 podStartE2EDuration="4.82772267s" totalImagesPullingTime="1.164632613s" totalInitContainerRuntime="104.071328ms" isStatefulPod=true podCreationTimestamp="2026-07-07 22:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:00:15.827482315 +0000 UTC m=+95.125701665" watchObservedRunningTime="2026-07-07 22:00:15.82772267 +0000 UTC m=+95.125942020"
Jul 07 22:00:18.729754 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:18.729721    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f8c66bb86-8z548"
Jul 07 22:00:28.727622 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:28.727583    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l85fh"
Jul 07 22:00:33.876724 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:33.876693    2567 generic.go:356] "Generic (PLEG): container finished" podID="cad384a6-548d-4dd5-a3fc-808c6db4ae10" containerID="784ba59d0597ede233784094e381013af9cb99c5a1c7d0b51f9817655e1998d8" exitCode=0
Jul 07 22:00:33.877144 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:33.876779    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq" event={"ID":"cad384a6-548d-4dd5-a3fc-808c6db4ae10","Type":"ContainerDied","Data":"784ba59d0597ede233784094e381013af9cb99c5a1c7d0b51f9817655e1998d8"}
Jul 07 22:00:33.877144 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:33.877120    2567 scope.go:117] "RemoveContainer" containerID="784ba59d0597ede233784094e381013af9cb99c5a1c7d0b51f9817655e1998d8"
Jul 07 22:00:33.878398 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:33.878378    2567 generic.go:356] "Generic (PLEG): container finished" podID="419ced79-d1e4-41f0-a3b9-4783400bc104" containerID="0233d2626dffa98b1238eea429d8af6094a83e6b55623527b597bf7ec6e963fd" exitCode=0
Jul 07 22:00:33.878492 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:33.878410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst" event={"ID":"419ced79-d1e4-41f0-a3b9-4783400bc104","Type":"ContainerDied","Data":"0233d2626dffa98b1238eea429d8af6094a83e6b55623527b597bf7ec6e963fd"}
Jul 07 22:00:33.878669 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:33.878658    2567 scope.go:117] "RemoveContainer" containerID="0233d2626dffa98b1238eea429d8af6094a83e6b55623527b597bf7ec6e963fd"
Jul 07 22:00:34.884009 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:34.883969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xfgmq" event={"ID":"cad384a6-548d-4dd5-a3fc-808c6db4ae10","Type":"ContainerStarted","Data":"461c1a03bebc336096c704d6eb7cf18505c35c411a610689ad4eb8b34fc2da47"}
Jul 07 22:00:34.885888 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:34.885862    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4zcst" event={"ID":"419ced79-d1e4-41f0-a3b9-4783400bc104","Type":"ContainerStarted","Data":"2d980e901bf5bee2e6a88d04112262e8b4d98e83173fc64e41257124d17c1814"}
Jul 07 22:00:37.897909 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:37.897877    2567 generic.go:356] "Generic (PLEG): container finished" podID="5df4e0ac-5f34-4fac-92b2-dfaf96d5063a" containerID="8140cc50e97d366cb70840a812554009f67055e888740160612cb60dc0c9d239" exitCode=0
Jul 07 22:00:37.898272 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:37.897949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8" event={"ID":"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a","Type":"ContainerDied","Data":"8140cc50e97d366cb70840a812554009f67055e888740160612cb60dc0c9d239"}
Jul 07 22:00:37.898312 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:37.898298    2567 scope.go:117] "RemoveContainer" containerID="8140cc50e97d366cb70840a812554009f67055e888740160612cb60dc0c9d239"
Jul 07 22:00:38.903408 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:00:38.903374    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-tsnb8" event={"ID":"5df4e0ac-5f34-4fac-92b2-dfaf96d5063a","Type":"ContainerStarted","Data":"36747e0d1e57da86404176392f8ca8245a23d7cd7872e08c5881400463a4ab73"}
Jul 07 22:02:31.512051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.512016    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"]
Jul 07 22:02:31.514058 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.514042    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.518001 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.517971    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 22:02:31.518178 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.518165    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d7dk\""
Jul 07 22:02:31.518903 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.518883    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 22:02:31.526308 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.526285    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"]
Jul 07 22:02:31.598473 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.598438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.598653 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.598499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8pg\" (UniqueName: \"kubernetes.io/projected/4cfdd16d-7210-4330-a262-3e5628bd96ba-kube-api-access-bc8pg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.598653 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.598522    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.699385 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.699355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.699592 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.699415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8pg\" (UniqueName: \"kubernetes.io/projected/4cfdd16d-7210-4330-a262-3e5628bd96ba-kube-api-access-bc8pg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.699592 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.699439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.699780 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.699757    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.699844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.699783    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.708400 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.708376    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8pg\" (UniqueName: \"kubernetes.io/projected/4cfdd16d-7210-4330-a262-3e5628bd96ba-kube-api-access-bc8pg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.823192 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.823114    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:31.951666 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:31.951484    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"]
Jul 07 22:02:31.954316 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:02:31.954284    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfdd16d_7210_4330_a262_3e5628bd96ba.slice/crio-e581a6169598b181159b3a827728ffaea8c091800b498f645daf3a6beea9ef9f WatchSource:0}: Error finding container e581a6169598b181159b3a827728ffaea8c091800b498f645daf3a6beea9ef9f: Status 404 returned error can't find the container with id e581a6169598b181159b3a827728ffaea8c091800b498f645daf3a6beea9ef9f
Jul 07 22:02:32.289425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:32.289391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g" event={"ID":"4cfdd16d-7210-4330-a262-3e5628bd96ba","Type":"ContainerStarted","Data":"e581a6169598b181159b3a827728ffaea8c091800b498f645daf3a6beea9ef9f"}
Jul 07 22:02:37.310511 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:37.310478    2567 generic.go:356] "Generic (PLEG): container finished" podID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerID="6b113a3a1f15618c70e50b9fcde673b123295bebd0c56a0d6bda738606e37144" exitCode=0
Jul 07 22:02:37.310882 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:37.310565    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g" event={"ID":"4cfdd16d-7210-4330-a262-3e5628bd96ba","Type":"ContainerDied","Data":"6b113a3a1f15618c70e50b9fcde673b123295bebd0c56a0d6bda738606e37144"}
Jul 07 22:02:40.323682 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:40.323643    2567 generic.go:356] "Generic (PLEG): container finished" podID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerID="d149410c244533bf7f6a8f2cb64ac5f304f995501550001ef8c77bf6f1843c64" exitCode=0
Jul 07 22:02:40.324025 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:40.323715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g" event={"ID":"4cfdd16d-7210-4330-a262-3e5628bd96ba","Type":"ContainerDied","Data":"d149410c244533bf7f6a8f2cb64ac5f304f995501550001ef8c77bf6f1843c64"}
Jul 07 22:02:49.363806 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:49.363769    2567 generic.go:356] "Generic (PLEG): container finished" podID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerID="f159c8a8118ba7ef323786609b847c769382b025443459111beddd1d4f2d69bc" exitCode=0
Jul 07 22:02:49.364162 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:49.363821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g" event={"ID":"4cfdd16d-7210-4330-a262-3e5628bd96ba","Type":"ContainerDied","Data":"f159c8a8118ba7ef323786609b847c769382b025443459111beddd1d4f2d69bc"}
Jul 07 22:02:50.487098 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.487073    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:50.554832 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.554802    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc8pg\" (UniqueName: \"kubernetes.io/projected/4cfdd16d-7210-4330-a262-3e5628bd96ba-kube-api-access-bc8pg\") pod \"4cfdd16d-7210-4330-a262-3e5628bd96ba\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") "
Jul 07 22:02:50.555021 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.554849    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-util\") pod \"4cfdd16d-7210-4330-a262-3e5628bd96ba\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") "
Jul 07 22:02:50.555021 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.554926    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-bundle\") pod \"4cfdd16d-7210-4330-a262-3e5628bd96ba\" (UID: \"4cfdd16d-7210-4330-a262-3e5628bd96ba\") "
Jul 07 22:02:50.555597 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.555569    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-bundle" (OuterVolumeSpecName: "bundle") pod "4cfdd16d-7210-4330-a262-3e5628bd96ba" (UID: "4cfdd16d-7210-4330-a262-3e5628bd96ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:02:50.557180 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.557160    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cfdd16d-7210-4330-a262-3e5628bd96ba-kube-api-access-bc8pg" (OuterVolumeSpecName: "kube-api-access-bc8pg") pod "4cfdd16d-7210-4330-a262-3e5628bd96ba" (UID: "4cfdd16d-7210-4330-a262-3e5628bd96ba"). InnerVolumeSpecName "kube-api-access-bc8pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:02:50.561400 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.561372    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-util" (OuterVolumeSpecName: "util") pod "4cfdd16d-7210-4330-a262-3e5628bd96ba" (UID: "4cfdd16d-7210-4330-a262-3e5628bd96ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:02:50.655709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.655627    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc8pg\" (UniqueName: \"kubernetes.io/projected/4cfdd16d-7210-4330-a262-3e5628bd96ba-kube-api-access-bc8pg\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:02:50.655709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.655655    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-util\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:02:50.655709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:50.655666    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cfdd16d-7210-4330-a262-3e5628bd96ba-bundle\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:02:51.372887 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:51.372850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g" event={"ID":"4cfdd16d-7210-4330-a262-3e5628bd96ba","Type":"ContainerDied","Data":"e581a6169598b181159b3a827728ffaea8c091800b498f645daf3a6beea9ef9f"}
Jul 07 22:02:51.372887 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:51.372880    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hfd5g"
Jul 07 22:02:51.372887 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:51.372896    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e581a6169598b181159b3a827728ffaea8c091800b498f645daf3a6beea9ef9f"
Jul 07 22:02:54.564127 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564089    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"]
Jul 07 22:02:54.564731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564439    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerName="pull"
Jul 07 22:02:54.564731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564456    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerName="pull"
Jul 07 22:02:54.564731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564473    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerName="util"
Jul 07 22:02:54.564731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564480    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerName="util"
Jul 07 22:02:54.564731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564510    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerName="extract"
Jul 07 22:02:54.564731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564518    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerName="extract"
Jul 07 22:02:54.564731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.564606    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cfdd16d-7210-4330-a262-3e5628bd96ba" containerName="extract"
Jul 07 22:02:54.608098 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.608058    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"]
Jul 07 22:02:54.608246 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.608189    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:54.611062 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.611038    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p46mv\""
Jul 07 22:02:54.611226 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.611209    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:02:54.611376 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.611360    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 22:02:54.682797 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.682759    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lstlk\" (UniqueName: \"kubernetes.io/projected/34831652-3c3b-4392-b298-dc78e6474aeb-kube-api-access-lstlk\") pod \"cert-manager-operator-controller-manager-55c444bf86-79jht\" (UID: \"34831652-3c3b-4392-b298-dc78e6474aeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:54.682797 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.682796    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34831652-3c3b-4392-b298-dc78e6474aeb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79jht\" (UID: \"34831652-3c3b-4392-b298-dc78e6474aeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:54.783741 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.783712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lstlk\" (UniqueName: \"kubernetes.io/projected/34831652-3c3b-4392-b298-dc78e6474aeb-kube-api-access-lstlk\") pod \"cert-manager-operator-controller-manager-55c444bf86-79jht\" (UID: \"34831652-3c3b-4392-b298-dc78e6474aeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:54.783902 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.783748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34831652-3c3b-4392-b298-dc78e6474aeb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79jht\" (UID: \"34831652-3c3b-4392-b298-dc78e6474aeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:54.784163 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.784144    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34831652-3c3b-4392-b298-dc78e6474aeb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79jht\" (UID: \"34831652-3c3b-4392-b298-dc78e6474aeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:54.796027 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.795996    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lstlk\" (UniqueName: \"kubernetes.io/projected/34831652-3c3b-4392-b298-dc78e6474aeb-kube-api-access-lstlk\") pod \"cert-manager-operator-controller-manager-55c444bf86-79jht\" (UID: \"34831652-3c3b-4392-b298-dc78e6474aeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:54.917083 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:54.917001    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"
Jul 07 22:02:55.075290 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:55.075257    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht"]
Jul 07 22:02:55.078102 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:02:55.078074    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34831652_3c3b_4392_b298_dc78e6474aeb.slice/crio-a0accf7d60ad60e71ad3fd157e6067a64bda264cfe316c8422852055fe493ad9 WatchSource:0}: Error finding container a0accf7d60ad60e71ad3fd157e6067a64bda264cfe316c8422852055fe493ad9: Status 404 returned error can't find the container with id a0accf7d60ad60e71ad3fd157e6067a64bda264cfe316c8422852055fe493ad9
Jul 07 22:02:55.387907 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:55.387870    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht" event={"ID":"34831652-3c3b-4392-b298-dc78e6474aeb","Type":"ContainerStarted","Data":"a0accf7d60ad60e71ad3fd157e6067a64bda264cfe316c8422852055fe493ad9"}
Jul 07 22:02:57.398093 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:57.398060    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht" event={"ID":"34831652-3c3b-4392-b298-dc78e6474aeb","Type":"ContainerStarted","Data":"dcb221e859514b0012f75014c2729f4d54510ae07943d3275cc4f565abef2fb7"}
Jul 07 22:02:57.424143 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:57.424087    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79jht" podStartSLOduration=1.262864496 podStartE2EDuration="3.424066355s" totalImagesPullingTime="2.161201859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:02:57.423786697 +0000 UTC m=+256.722006048" watchObservedRunningTime="2026-07-07 22:02:57.424066355 +0000 UTC m=+256.722285707"
Jul 07 22:02:58.458177 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.458140    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"]
Jul 07 22:02:58.460556 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.460509    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.464250 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.464206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 22:02:58.464250 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.464206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 22:02:58.465414 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.465394    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d7dk\""
Jul 07 22:02:58.474338 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.474317    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"]
Jul 07 22:02:58.518939 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.518909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjf8z\" (UniqueName: \"kubernetes.io/projected/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-kube-api-access-pjf8z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.519103 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.518952    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.519103 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.518991    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.619498 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.619463    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.619713 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.619509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjf8z\" (UniqueName: \"kubernetes.io/projected/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-kube-api-access-pjf8z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.619713 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.619564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.619881 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.619859    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.619941 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.619894    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.631929 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.631906    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjf8z\" (UniqueName: \"kubernetes.io/projected/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-kube-api-access-pjf8z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.775234 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.775192    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:02:58.916873 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:58.916808    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"]
Jul 07 22:02:58.919080 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:02:58.919054    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef3b1de_1424_4c5c_9c68_0ceb15b4ea81.slice/crio-76d48690459b182929488f3bdd9192f364020c680ded3eb94f34d79c97914b99 WatchSource:0}: Error finding container 76d48690459b182929488f3bdd9192f364020c680ded3eb94f34d79c97914b99: Status 404 returned error can't find the container with id 76d48690459b182929488f3bdd9192f364020c680ded3eb94f34d79c97914b99
Jul 07 22:02:59.406927 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:59.406889    2567 generic.go:356] "Generic (PLEG): container finished" podID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerID="1e5a7f99ce40c70439d9d44987cc063762a155d4d6677ce842130ea53b50c429" exitCode=0
Jul 07 22:02:59.407088 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:59.406954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c" event={"ID":"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81","Type":"ContainerDied","Data":"1e5a7f99ce40c70439d9d44987cc063762a155d4d6677ce842130ea53b50c429"}
Jul 07 22:02:59.407088 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:02:59.406994    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c" event={"ID":"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81","Type":"ContainerStarted","Data":"76d48690459b182929488f3bdd9192f364020c680ded3eb94f34d79c97914b99"}
Jul 07 22:03:02.421912 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:02.421879    2567 generic.go:356] "Generic (PLEG): container finished" podID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerID="cb67000e7aae12194b6f8a151482001bf57cff937f555c32ade44a3bd9a7d0c9" exitCode=0
Jul 07 22:03:02.422305 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:02.421945    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c" event={"ID":"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81","Type":"ContainerDied","Data":"cb67000e7aae12194b6f8a151482001bf57cff937f555c32ade44a3bd9a7d0c9"}
Jul 07 22:03:03.427389 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:03.427358    2567 generic.go:356] "Generic (PLEG): container finished" podID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerID="5eede39194551d758c64c3177b8d706099fa140470b1b4e36f210601661c4139" exitCode=0
Jul 07 22:03:03.427837 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:03.427409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c" event={"ID":"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81","Type":"ContainerDied","Data":"5eede39194551d758c64c3177b8d706099fa140470b1b4e36f210601661c4139"}
Jul 07 22:03:04.557873 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.557847    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:03:04.669506 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.669467    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjf8z\" (UniqueName: \"kubernetes.io/projected/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-kube-api-access-pjf8z\") pod \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") "
Jul 07 22:03:04.669506 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.669510    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-bundle\") pod \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") "
Jul 07 22:03:04.669746 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.669577    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-util\") pod \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\" (UID: \"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81\") "
Jul 07 22:03:04.669984 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.669947    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-bundle" (OuterVolumeSpecName: "bundle") pod "2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" (UID: "2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:03:04.671736 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.671710    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-kube-api-access-pjf8z" (OuterVolumeSpecName: "kube-api-access-pjf8z") pod "2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" (UID: "2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81"). InnerVolumeSpecName "kube-api-access-pjf8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:03:04.674555 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.674517    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-util" (OuterVolumeSpecName: "util") pod "2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" (UID: "2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:03:04.770985 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.770953    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-util\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:03:04.770985 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.770985    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjf8z\" (UniqueName: \"kubernetes.io/projected/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-kube-api-access-pjf8z\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:03:04.771174 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:04.770999    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81-bundle\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:03:05.436607 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:05.436572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c" event={"ID":"2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81","Type":"ContainerDied","Data":"76d48690459b182929488f3bdd9192f364020c680ded3eb94f34d79c97914b99"}
Jul 07 22:03:05.436607 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:05.436593    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcl59c"
Jul 07 22:03:05.436858 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:05.436617    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76d48690459b182929488f3bdd9192f364020c680ded3eb94f34d79c97914b99"
Jul 07 22:03:12.343593 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343554    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"]
Jul 07 22:03:12.344051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343806    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerName="extract"
Jul 07 22:03:12.344051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343816    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerName="extract"
Jul 07 22:03:12.344051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343829    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerName="pull"
Jul 07 22:03:12.344051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343836    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerName="pull"
Jul 07 22:03:12.344051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343849    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerName="util"
Jul 07 22:03:12.344051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343854    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerName="util"
Jul 07 22:03:12.344051 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.343897    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef3b1de-1424-4c5c-9c68-0ceb15b4ea81" containerName="extract"
Jul 07 22:03:12.346092 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.346076    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.349033 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.349000    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mhr9k\""
Jul 07 22:03:12.350194 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.350172    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 22:03:12.350194 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.350192    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:03:12.357456 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.357437    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"]
Jul 07 22:03:12.431293 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.431259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl4pc\" (UniqueName: \"kubernetes.io/projected/34778705-f473-4227-be85-d5a4712bb544-kube-api-access-zl4pc\") pod \"openshift-lws-operator-fd8ccff4c-wqqzx\" (UID: \"34778705-f473-4227-be85-d5a4712bb544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.431491 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.431322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34778705-f473-4227-be85-d5a4712bb544-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wqqzx\" (UID: \"34778705-f473-4227-be85-d5a4712bb544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.532715 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.532687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl4pc\" (UniqueName: \"kubernetes.io/projected/34778705-f473-4227-be85-d5a4712bb544-kube-api-access-zl4pc\") pod \"openshift-lws-operator-fd8ccff4c-wqqzx\" (UID: \"34778705-f473-4227-be85-d5a4712bb544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.532875 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.532729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34778705-f473-4227-be85-d5a4712bb544-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wqqzx\" (UID: \"34778705-f473-4227-be85-d5a4712bb544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.533107 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.533087    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34778705-f473-4227-be85-d5a4712bb544-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wqqzx\" (UID: \"34778705-f473-4227-be85-d5a4712bb544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.544371 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.544346    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl4pc\" (UniqueName: \"kubernetes.io/projected/34778705-f473-4227-be85-d5a4712bb544-kube-api-access-zl4pc\") pod \"openshift-lws-operator-fd8ccff4c-wqqzx\" (UID: \"34778705-f473-4227-be85-d5a4712bb544\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.655562 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.655460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"
Jul 07 22:03:12.806305 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:12.806281    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx"]
Jul 07 22:03:12.808601 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:03:12.808565    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34778705_f473_4227_be85_d5a4712bb544.slice/crio-c91c8cd5833fd474d9d3410b71a15eb658ad3e0ee2e2f35919106bb5126bc216 WatchSource:0}: Error finding container c91c8cd5833fd474d9d3410b71a15eb658ad3e0ee2e2f35919106bb5126bc216: Status 404 returned error can't find the container with id c91c8cd5833fd474d9d3410b71a15eb658ad3e0ee2e2f35919106bb5126bc216
Jul 07 22:03:13.470862 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:13.470830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx" event={"ID":"34778705-f473-4227-be85-d5a4712bb544","Type":"ContainerStarted","Data":"c91c8cd5833fd474d9d3410b71a15eb658ad3e0ee2e2f35919106bb5126bc216"}
Jul 07 22:03:15.480944 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:15.480908    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx" event={"ID":"34778705-f473-4227-be85-d5a4712bb544","Type":"ContainerStarted","Data":"6db86392171b21dfcf1f1777f909c8d03b5641c56c567a2e155721d6d0584c4c"}
Jul 07 22:03:15.499830 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:15.499776    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqqzx" podStartSLOduration=1.604284517 podStartE2EDuration="3.499760524s" totalImagesPullingTime="1.895476007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:03:15.498392978 +0000 UTC m=+274.796612330" watchObservedRunningTime="2026-07-07 22:03:15.499760524 +0000 UTC m=+274.797979875"
Jul 07 22:03:18.348791 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.348754    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"]
Jul 07 22:03:18.351570 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.351553    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.354456 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.354437    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d7dk\""
Jul 07 22:03:18.355859 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.355834    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 22:03:18.355957 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.355841    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 22:03:18.362171 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.362150    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"]
Jul 07 22:03:18.480751 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.480715    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.480751 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.480749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6c7q\" (UniqueName: \"kubernetes.io/projected/6534523f-da4e-48f0-befa-c133f2305d34-kube-api-access-n6c7q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.480953 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.480823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.581856 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.581821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.582029 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.581879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.582029 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.581997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6c7q\" (UniqueName: \"kubernetes.io/projected/6534523f-da4e-48f0-befa-c133f2305d34-kube-api-access-n6c7q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.582226 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.582208    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.582269 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.582258    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.591693 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.591668    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6c7q\" (UniqueName: \"kubernetes.io/projected/6534523f-da4e-48f0-befa-c133f2305d34-kube-api-access-n6c7q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.660665 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.660587    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:18.803676 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:18.803555    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"]
Jul 07 22:03:18.806135 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:03:18.806108    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6534523f_da4e_48f0_befa_c133f2305d34.slice/crio-4b88f0bf3808294aac3c042f72e715cbe44d8062aefd1b5515d1cc739c9a8c19 WatchSource:0}: Error finding container 4b88f0bf3808294aac3c042f72e715cbe44d8062aefd1b5515d1cc739c9a8c19: Status 404 returned error can't find the container with id 4b88f0bf3808294aac3c042f72e715cbe44d8062aefd1b5515d1cc739c9a8c19
Jul 07 22:03:19.497522 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:19.497492    2567 generic.go:356] "Generic (PLEG): container finished" podID="6534523f-da4e-48f0-befa-c133f2305d34" containerID="43c2f80e9b47a91bc424edbd882258f30032c69f66fd2f3e729466e7ea7c58bf" exitCode=0
Jul 07 22:03:19.498002 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:19.497558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h" event={"ID":"6534523f-da4e-48f0-befa-c133f2305d34","Type":"ContainerDied","Data":"43c2f80e9b47a91bc424edbd882258f30032c69f66fd2f3e729466e7ea7c58bf"}
Jul 07 22:03:19.498002 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:19.497592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h" event={"ID":"6534523f-da4e-48f0-befa-c133f2305d34","Type":"ContainerStarted","Data":"4b88f0bf3808294aac3c042f72e715cbe44d8062aefd1b5515d1cc739c9a8c19"}
Jul 07 22:03:20.502790 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:20.502706    2567 generic.go:356] "Generic (PLEG): container finished" podID="6534523f-da4e-48f0-befa-c133f2305d34" containerID="6cdb9028c8bd55a4ea7da1522c9fadd116575ffee82db97c27251688c72afead" exitCode=0
Jul 07 22:03:20.502790 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:20.502766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h" event={"ID":"6534523f-da4e-48f0-befa-c133f2305d34","Type":"ContainerDied","Data":"6cdb9028c8bd55a4ea7da1522c9fadd116575ffee82db97c27251688c72afead"}
Jul 07 22:03:21.509038 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:21.509003    2567 generic.go:356] "Generic (PLEG): container finished" podID="6534523f-da4e-48f0-befa-c133f2305d34" containerID="548dbc7c661107b369abbe5fa2c8cda9bea1341cf65209bb4f1b04fc54d9bb6c" exitCode=0
Jul 07 22:03:21.509394 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:21.509069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h" event={"ID":"6534523f-da4e-48f0-befa-c133f2305d34","Type":"ContainerDied","Data":"548dbc7c661107b369abbe5fa2c8cda9bea1341cf65209bb4f1b04fc54d9bb6c"}
Jul 07 22:03:22.635665 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.635640    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:22.815105 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.815023    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-bundle\") pod \"6534523f-da4e-48f0-befa-c133f2305d34\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") "
Jul 07 22:03:22.815105 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.815063    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6c7q\" (UniqueName: \"kubernetes.io/projected/6534523f-da4e-48f0-befa-c133f2305d34-kube-api-access-n6c7q\") pod \"6534523f-da4e-48f0-befa-c133f2305d34\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") "
Jul 07 22:03:22.815105 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.815093    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-util\") pod \"6534523f-da4e-48f0-befa-c133f2305d34\" (UID: \"6534523f-da4e-48f0-befa-c133f2305d34\") "
Jul 07 22:03:22.815984 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.815951    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-bundle" (OuterVolumeSpecName: "bundle") pod "6534523f-da4e-48f0-befa-c133f2305d34" (UID: "6534523f-da4e-48f0-befa-c133f2305d34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:03:22.817297 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.817264    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6534523f-da4e-48f0-befa-c133f2305d34-kube-api-access-n6c7q" (OuterVolumeSpecName: "kube-api-access-n6c7q") pod "6534523f-da4e-48f0-befa-c133f2305d34" (UID: "6534523f-da4e-48f0-befa-c133f2305d34"). InnerVolumeSpecName "kube-api-access-n6c7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:03:22.821016 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.820946    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-util" (OuterVolumeSpecName: "util") pod "6534523f-da4e-48f0-befa-c133f2305d34" (UID: "6534523f-da4e-48f0-befa-c133f2305d34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:03:22.915838 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.915794    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-bundle\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:03:22.915838 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.915835    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6c7q\" (UniqueName: \"kubernetes.io/projected/6534523f-da4e-48f0-befa-c133f2305d34-kube-api-access-n6c7q\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:03:22.915838 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:22.915846    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6534523f-da4e-48f0-befa-c133f2305d34-util\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:03:23.519088 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:23.519017    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h"
Jul 07 22:03:23.519219 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:23.519017    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrt79h" event={"ID":"6534523f-da4e-48f0-befa-c133f2305d34","Type":"ContainerDied","Data":"4b88f0bf3808294aac3c042f72e715cbe44d8062aefd1b5515d1cc739c9a8c19"}
Jul 07 22:03:23.519219 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:23.519132    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b88f0bf3808294aac3c042f72e715cbe44d8062aefd1b5515d1cc739c9a8c19"
Jul 07 22:03:31.745885 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.745854    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"]
Jul 07 22:03:31.746354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.746258    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534523f-da4e-48f0-befa-c133f2305d34" containerName="extract"
Jul 07 22:03:31.746354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.746276    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534523f-da4e-48f0-befa-c133f2305d34" containerName="extract"
Jul 07 22:03:31.746354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.746294    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534523f-da4e-48f0-befa-c133f2305d34" containerName="util"
Jul 07 22:03:31.746354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.746304    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534523f-da4e-48f0-befa-c133f2305d34" containerName="util"
Jul 07 22:03:31.746354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.746330    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534523f-da4e-48f0-befa-c133f2305d34" containerName="pull"
Jul 07 22:03:31.746354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.746337    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534523f-da4e-48f0-befa-c133f2305d34" containerName="pull"
Jul 07 22:03:31.746671 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.746404    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6534523f-da4e-48f0-befa-c133f2305d34" containerName="extract"
Jul 07 22:03:31.748416 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.748394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.758770 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.758752    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 22:03:31.759943 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.759930    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 22:03:31.760052 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.760034    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 22:03:31.760682 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.760669    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 22:03:31.768645 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.768625    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m6z9x\""
Jul 07 22:03:31.773942 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.773920    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"]
Jul 07 22:03:31.776217 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.776197    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbks\" (UniqueName: \"kubernetes.io/projected/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-kube-api-access-9fbks\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.776317 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.776258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.776317 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.776302    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.776400 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.776328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-tmp\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.776400 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.776387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-manifests\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.877596 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.877556    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.877771 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.877609    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.877771 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.877633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-tmp\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.877771 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.877656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-manifests\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.877771 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.877715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbks\" (UniqueName: \"kubernetes.io/projected/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-kube-api-access-9fbks\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.878170 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.878139    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-manifests\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.880128 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.880104    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-tmp\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.880269 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.880255    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.880314 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.880292    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:31.901465 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:31.901438    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbks\" (UniqueName: \"kubernetes.io/projected/a81e4e8d-03a8-4d7c-b5af-5c216b9c477f-kube-api-access-9fbks\") pod \"opendatahub-operator-controller-manager-6dd55458bc-fgll2\" (UID: \"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:32.058853 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:32.058815    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:32.202572 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:32.202520    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"]
Jul 07 22:03:32.204826 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:03:32.204797    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81e4e8d_03a8_4d7c_b5af_5c216b9c477f.slice/crio-971ce7b9ba77a33adbe344ff3421997f51fe59005ee13a38b8a4efd8e14d7792 WatchSource:0}: Error finding container 971ce7b9ba77a33adbe344ff3421997f51fe59005ee13a38b8a4efd8e14d7792: Status 404 returned error can't find the container with id 971ce7b9ba77a33adbe344ff3421997f51fe59005ee13a38b8a4efd8e14d7792
Jul 07 22:03:32.557054 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:32.557013    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2" event={"ID":"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f","Type":"ContainerStarted","Data":"971ce7b9ba77a33adbe344ff3421997f51fe59005ee13a38b8a4efd8e14d7792"}
Jul 07 22:03:36.575378 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:36.575341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2" event={"ID":"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f","Type":"ContainerStarted","Data":"ef30709ca187bda913fbff0e6b18b2706b8dfab0883bace40ae0bd60a826bb68"}
Jul 07 22:03:37.580701 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:37.580666    2567 generic.go:356] "Generic (PLEG): container finished" podID="a81e4e8d-03a8-4d7c-b5af-5c216b9c477f" containerID="ef30709ca187bda913fbff0e6b18b2706b8dfab0883bace40ae0bd60a826bb68" exitCode=0
Jul 07 22:03:37.581090 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:37.580714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2" event={"ID":"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f","Type":"ContainerDied","Data":"ef30709ca187bda913fbff0e6b18b2706b8dfab0883bace40ae0bd60a826bb68"}
Jul 07 22:03:38.587393 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:38.587360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2" event={"ID":"a81e4e8d-03a8-4d7c-b5af-5c216b9c477f","Type":"ContainerStarted","Data":"1e3363c3198e7690812bd715e9536e994fc4729eb45852b7ab11d77e8ff6afbc"}
Jul 07 22:03:38.587876 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:38.587483    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:38.615204 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:38.615149    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2" podStartSLOduration=2.8748519420000003 podStartE2EDuration="7.615128348s" totalImagesPullingTime="3.667490174s" totalInitContainerRuntime="1.072786232s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:03:38.611516459 +0000 UTC m=+297.909735820" watchObservedRunningTime="2026-07-07 22:03:38.615128348 +0000 UTC m=+297.913347701"
Jul 07 22:03:41.089729 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:41.089704    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:03:41.091504 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:41.091481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:03:41.100651 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:41.100630    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 22:03:49.594397 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:49.594367    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dd55458bc-fgll2"
Jul 07 22:03:52.626340 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.626305    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"]
Jul 07 22:03:52.629544 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.629513    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.632361 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:52.632330    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-l4kfg\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l4kfg\"" type="*v1.Secret"
Jul 07 22:03:52.632691 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:52.632663    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret"
Jul 07 22:03:52.632896 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:52.632868    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-98fbf9c8c-psf28\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0" pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.632896 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:52.632885    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret"
Jul 07 22:03:52.654387 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.654358    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"]
Jul 07 22:03:52.747066 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.747022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-tmp\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.747066 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.747068    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-tls-certs\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.747294 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.747100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97v4\" (UniqueName: \"kubernetes.io/projected/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-kube-api-access-j97v4\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.848115 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.848075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-tmp\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.848115 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.848129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-tls-certs\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.848404 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.848182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j97v4\" (UniqueName: \"kubernetes.io/projected/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-kube-api-access-j97v4\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.850629 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.850600    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-tmp\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.863291 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.863258    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97v4\" (UniqueName: \"kubernetes.io/projected/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-kube-api-access-j97v4\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:52.871736 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.871706    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kltts"]
Jul 07 22:03:52.874021 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.874006    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:52.877791 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.877726    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 22:03:52.877791 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.877763    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hfdgm\""
Jul 07 22:03:52.885591 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.885569    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kltts"]
Jul 07 22:03:52.949481 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.949448    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:52.949697 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:52.949493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvsch\" (UniqueName: \"kubernetes.io/projected/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-kube-api-access-xvsch\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:53.049980 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.049939    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:53.050146 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.049990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvsch\" (UniqueName: \"kubernetes.io/projected/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-kube-api-access-xvsch\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:53.050146 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:53.050094    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 22:03:53.050222 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:53.050172    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert podName:b2a51b0c-d6e6-48d2-98c4-3d840f64540d nodeName:}" failed. No retries permitted until 2026-07-07 22:03:53.550153968 +0000 UTC m=+312.848373297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert") pod "odh-model-controller-7998c67dc4-kltts" (UID: "b2a51b0c-d6e6-48d2-98c4-3d840f64540d") : secret "odh-model-controller-webhook-cert" not found
Jul 07 22:03:53.065167 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.065132    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvsch\" (UniqueName: \"kubernetes.io/projected/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-kube-api-access-xvsch\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:53.554730 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.554698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:53.554938 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:53.554857    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 22:03:53.554938 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:53.554922    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert podName:b2a51b0c-d6e6-48d2-98c4-3d840f64540d nodeName:}" failed. No retries permitted until 2026-07-07 22:03:54.554904734 +0000 UTC m=+313.853124067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert") pod "odh-model-controller-7998c67dc4-kltts" (UID: "b2a51b0c-d6e6-48d2-98c4-3d840f64540d") : secret "odh-model-controller-webhook-cert" not found
Jul 07 22:03:53.586049 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.586021    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 22:03:53.590878 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.590851    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0-tls-certs\") pod \"kube-auth-proxy-98fbf9c8c-psf28\" (UID: \"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0\") " pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:53.756964 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.756925    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r7vvd"]
Jul 07 22:03:53.759593 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.759569    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:53.762725 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.762702    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 22:03:53.769783 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.769765    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l4kfg\""
Jul 07 22:03:53.784595 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.784513    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r7vvd"]
Jul 07 22:03:53.839035 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.838949    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"
Jul 07 22:03:53.857519 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.857482    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwzpb\" (UniqueName: \"kubernetes.io/projected/5c037267-7dc1-47b2-9a35-4235feedb537-kube-api-access-jwzpb\") pod \"model-serving-api-54d89bd5fc-r7vvd\" (UID: \"5c037267-7dc1-47b2-9a35-4235feedb537\") " pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:53.857682 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.857659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c037267-7dc1-47b2-9a35-4235feedb537-tls-certs\") pod \"model-serving-api-54d89bd5fc-r7vvd\" (UID: \"5c037267-7dc1-47b2-9a35-4235feedb537\") " pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:53.959065 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.959032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c037267-7dc1-47b2-9a35-4235feedb537-tls-certs\") pod \"model-serving-api-54d89bd5fc-r7vvd\" (UID: \"5c037267-7dc1-47b2-9a35-4235feedb537\") " pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:53.959292 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.959130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzpb\" (UniqueName: \"kubernetes.io/projected/5c037267-7dc1-47b2-9a35-4235feedb537-kube-api-access-jwzpb\") pod \"model-serving-api-54d89bd5fc-r7vvd\" (UID: \"5c037267-7dc1-47b2-9a35-4235feedb537\") " pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:53.959292 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:53.959185    2567 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 07 22:03:53.959292 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:03:53.959249    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c037267-7dc1-47b2-9a35-4235feedb537-tls-certs podName:5c037267-7dc1-47b2-9a35-4235feedb537 nodeName:}" failed. No retries permitted until 2026-07-07 22:03:54.459235659 +0000 UTC m=+313.757454991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5c037267-7dc1-47b2-9a35-4235feedb537-tls-certs") pod "model-serving-api-54d89bd5fc-r7vvd" (UID: "5c037267-7dc1-47b2-9a35-4235feedb537") : secret "model-serving-api-tls" not found
Jul 07 22:03:53.979115 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.979070    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwzpb\" (UniqueName: \"kubernetes.io/projected/5c037267-7dc1-47b2-9a35-4235feedb537-kube-api-access-jwzpb\") pod \"model-serving-api-54d89bd5fc-r7vvd\" (UID: \"5c037267-7dc1-47b2-9a35-4235feedb537\") " pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:53.992944 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.992922    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28"]
Jul 07 22:03:53.995245 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:03:53.995214    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b0e6a3_b861_4a2e_9ed1_b7bae84583a0.slice/crio-6de1155a68ea2ca569adc4a9ddc9e48c098bd4f1ac7ac4f6456d51a0c1d89eaf WatchSource:0}: Error finding container 6de1155a68ea2ca569adc4a9ddc9e48c098bd4f1ac7ac4f6456d51a0c1d89eaf: Status 404 returned error can't find the container with id 6de1155a68ea2ca569adc4a9ddc9e48c098bd4f1ac7ac4f6456d51a0c1d89eaf
Jul 07 22:03:53.997145 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:53.997128    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:03:54.173600 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.173493    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 22:03:54.327118 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.327086    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"]
Jul 07 22:03:54.330000 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.329979    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.335381 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.335359    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 22:03:54.335619 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.335604    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 22:03:54.335711 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.335642    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w6bjz\""
Jul 07 22:03:54.335880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.335865    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 22:03:54.336130 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.336115    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 22:03:54.353584 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.353562    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"]
Jul 07 22:03:54.463809 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-cacerts\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.463809 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463800    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.463999 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.463999 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw6p8\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-kube-api-access-vw6p8\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.463999 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c037267-7dc1-47b2-9a35-4235feedb537-tls-certs\") pod \"model-serving-api-54d89bd5fc-r7vvd\" (UID: \"5c037267-7dc1-47b2-9a35-4235feedb537\") " pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:54.463999 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-token\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.463999 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d404bb-9f89-4f37-96ff-de41f6e5e016-local-certs\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.464157 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.463998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.466492 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.466468    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c037267-7dc1-47b2-9a35-4235feedb537-tls-certs\") pod \"model-serving-api-54d89bd5fc-r7vvd\" (UID: \"5c037267-7dc1-47b2-9a35-4235feedb537\") " pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:54.565034 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.564997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:54.565206 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.565054    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.565206 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.565087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.565206 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.565109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw6p8\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-kube-api-access-vw6p8\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.565206 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.565157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-token\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.565206 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.565188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d404bb-9f89-4f37-96ff-de41f6e5e016-local-certs\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.565485 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.565242    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.565485 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.565286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-cacerts\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.566905 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.566871    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.568033 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.567998    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.568193 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.568172    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-cacerts\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.568375 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.568351    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2a51b0c-d6e6-48d2-98c4-3d840f64540d-cert\") pod \"odh-model-controller-7998c67dc4-kltts\" (UID: \"b2a51b0c-d6e6-48d2-98c4-3d840f64540d\") " pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:54.568489 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.568466    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d404bb-9f89-4f37-96ff-de41f6e5e016-local-certs\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.568643 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.568623    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.576286 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.576263    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-token\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.576881 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.576859    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw6p8\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-kube-api-access-vw6p8\") pod \"istiod-openshift-gateway-7574459656-nbjzt\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.641771 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.641727    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:03:54.660878 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.660833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28" event={"ID":"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0","Type":"ContainerStarted","Data":"6de1155a68ea2ca569adc4a9ddc9e48c098bd4f1ac7ac4f6456d51a0c1d89eaf"}
Jul 07 22:03:54.672250 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.672195    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:03:54.683710 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.683613    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:03:54.839253 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.832785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"]
Jul 07 22:03:54.885684 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:54.885661    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kltts"]
Jul 07 22:03:54.888155 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:03:54.888127    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a51b0c_d6e6_48d2_98c4_3d840f64540d.slice/crio-cbee72a245552317d450ab729cfb1c3a81fd636bc04019570d821b142b3847d2 WatchSource:0}: Error finding container cbee72a245552317d450ab729cfb1c3a81fd636bc04019570d821b142b3847d2: Status 404 returned error can't find the container with id cbee72a245552317d450ab729cfb1c3a81fd636bc04019570d821b142b3847d2
Jul 07 22:03:55.073225 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:55.073190    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r7vvd"]
Jul 07 22:03:55.077658 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:03:55.077614    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c037267_7dc1_47b2_9a35_4235feedb537.slice/crio-fc6b240f0289251969a933402891d7cbf2804a0dee51b07a3a1166d950924c73 WatchSource:0}: Error finding container fc6b240f0289251969a933402891d7cbf2804a0dee51b07a3a1166d950924c73: Status 404 returned error can't find the container with id fc6b240f0289251969a933402891d7cbf2804a0dee51b07a3a1166d950924c73
Jul 07 22:03:55.669151 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:55.669108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd" event={"ID":"5c037267-7dc1-47b2-9a35-4235feedb537","Type":"ContainerStarted","Data":"fc6b240f0289251969a933402891d7cbf2804a0dee51b07a3a1166d950924c73"}
Jul 07 22:03:55.670381 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:55.670345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kltts" event={"ID":"b2a51b0c-d6e6-48d2-98c4-3d840f64540d","Type":"ContainerStarted","Data":"cbee72a245552317d450ab729cfb1c3a81fd636bc04019570d821b142b3847d2"}
Jul 07 22:03:55.671769 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:55.671741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt" event={"ID":"70d404bb-9f89-4f37-96ff-de41f6e5e016","Type":"ContainerStarted","Data":"c43cfe7c7f93c5e930610d7c74a2bf62bfeac4f5f343dea9c9f72496ad4bd8e8"}
Jul 07 22:03:59.641097 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:59.641046    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:03:59.641507 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:03:59.641138    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:04:00.702179 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.702138    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt" event={"ID":"70d404bb-9f89-4f37-96ff-de41f6e5e016","Type":"ContainerStarted","Data":"7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589"}
Jul 07 22:04:00.702649 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.702302    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:04:00.704079 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.704042    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28" event={"ID":"b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0","Type":"ContainerStarted","Data":"c586ca3ff5e7af076a8d4dd0398d52e2eb1a3e164657b3ff72b611d52d7f4926"}
Jul 07 22:04:00.704351 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.704323    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-nbjzt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 22:04:00.704467 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.704374    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt" podUID="70d404bb-9f89-4f37-96ff-de41f6e5e016" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 22:04:00.705597 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.705569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd" event={"ID":"5c037267-7dc1-47b2-9a35-4235feedb537","Type":"ContainerStarted","Data":"bd272afee12d3de908e6dbf0cf13cdd3a790ba983b56f33b9dc6d61ea06b7ef5"}
Jul 07 22:04:00.705721 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.705704    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:04:00.706991 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.706972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kltts" event={"ID":"b2a51b0c-d6e6-48d2-98c4-3d840f64540d","Type":"ContainerStarted","Data":"c4566f6ef01d47146f6cd4c392115bf9e8b73ed53048e4879c4f3d9bf6be999d"}
Jul 07 22:04:00.707082 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.707037    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:04:00.758870 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.757993    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt" podStartSLOduration=1.960814386 podStartE2EDuration="6.757972106s" totalImagesPullingTime="4.79715772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:00.75473491 +0000 UTC m=+320.052954263" watchObservedRunningTime="2026-07-07 22:04:00.757972106 +0000 UTC m=+320.056191460"
Jul 07 22:04:00.778711 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.778653    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kltts" podStartSLOduration=3.987331594 podStartE2EDuration="8.778637805s" totalImagesPullingTime="4.791306211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:00.775735155 +0000 UTC m=+320.073954509" watchObservedRunningTime="2026-07-07 22:04:00.778637805 +0000 UTC m=+320.076857155"
Jul 07 22:04:00.806230 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.806176    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd" podStartSLOduration=3.24201325 podStartE2EDuration="7.806160586s" totalImagesPullingTime="4.564147336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:00.804245598 +0000 UTC m=+320.102464949" watchObservedRunningTime="2026-07-07 22:04:00.806160586 +0000 UTC m=+320.104380281"
Jul 07 22:04:00.841786 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:00.841738    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-98fbf9c8c-psf28" podStartSLOduration=3.198267553 podStartE2EDuration="8.841721548s" totalImagesPullingTime="5.643453995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:00.839864398 +0000 UTC m=+320.138083744" watchObservedRunningTime="2026-07-07 22:04:00.841721548 +0000 UTC m=+320.139940899"
Jul 07 22:04:01.712078 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:01.712051    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:04:04.677099 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.677062    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"]
Jul 07 22:04:04.682176 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.682150    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:04.685160 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.685129    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"]
Jul 07 22:04:04.686433 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.686411    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-blgc9\""
Jul 07 22:04:04.686433 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.686423    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 22:04:04.687190 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.687173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:04.689695 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.689672    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 22:04:04.689917 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.689901    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7mshb\""
Jul 07 22:04:04.697218 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.697189    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"]
Jul 07 22:04:04.700084 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.699694    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"]
Jul 07 22:04:04.766781 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.766743    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skg4f\" (UniqueName: \"kubernetes.io/projected/612ec492-4ba7-44e5-8720-c91044c6ea04-kube-api-access-skg4f\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:04.766781 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.766788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:04.767055 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.766819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v67f\" (UniqueName: \"kubernetes.io/projected/27483891-ffe9-498b-a5f9-4883492a5a64-kube-api-access-5v67f\") pod \"llmisvc-controller-manager-777c6bd7d5-4cc5b\" (UID: \"27483891-ffe9-498b-a5f9-4883492a5a64\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:04.767055 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.766853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27483891-ffe9-498b-a5f9-4883492a5a64-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4cc5b\" (UID: \"27483891-ffe9-498b-a5f9-4883492a5a64\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:04.868110 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.868070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skg4f\" (UniqueName: \"kubernetes.io/projected/612ec492-4ba7-44e5-8720-c91044c6ea04-kube-api-access-skg4f\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:04.868110 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.868117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:04.868383 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.868144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v67f\" (UniqueName: \"kubernetes.io/projected/27483891-ffe9-498b-a5f9-4883492a5a64-kube-api-access-5v67f\") pod \"llmisvc-controller-manager-777c6bd7d5-4cc5b\" (UID: \"27483891-ffe9-498b-a5f9-4883492a5a64\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:04.868383 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.868166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27483891-ffe9-498b-a5f9-4883492a5a64-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4cc5b\" (UID: \"27483891-ffe9-498b-a5f9-4883492a5a64\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:04.868383 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:04.868274    2567 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 22:04:04.868383 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:04.868278    2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 07 22:04:04.868383 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:04.868343    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert podName:612ec492-4ba7-44e5-8720-c91044c6ea04 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:05.368324473 +0000 UTC m=+324.666543815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert") pod "kserve-controller-manager-d6f4b65b8-wppzc" (UID: "612ec492-4ba7-44e5-8720-c91044c6ea04") : secret "kserve-webhook-server-cert" not found
Jul 07 22:04:04.868383 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:04.868370    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27483891-ffe9-498b-a5f9-4883492a5a64-cert podName:27483891-ffe9-498b-a5f9-4883492a5a64 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:05.368362368 +0000 UTC m=+324.666581702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27483891-ffe9-498b-a5f9-4883492a5a64-cert") pod "llmisvc-controller-manager-777c6bd7d5-4cc5b" (UID: "27483891-ffe9-498b-a5f9-4883492a5a64") : secret "llmisvc-webhook-server-cert" not found
Jul 07 22:04:04.888107 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.888080    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v67f\" (UniqueName: \"kubernetes.io/projected/27483891-ffe9-498b-a5f9-4883492a5a64-kube-api-access-5v67f\") pod \"llmisvc-controller-manager-777c6bd7d5-4cc5b\" (UID: \"27483891-ffe9-498b-a5f9-4883492a5a64\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:04.895939 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:04.895913    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skg4f\" (UniqueName: \"kubernetes.io/projected/612ec492-4ba7-44e5-8720-c91044c6ea04-kube-api-access-skg4f\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:05.372927 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:05.372892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:05.372927 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:05.372946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27483891-ffe9-498b-a5f9-4883492a5a64-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4cc5b\" (UID: \"27483891-ffe9-498b-a5f9-4883492a5a64\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:05.373156 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:05.373047    2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 07 22:04:05.373156 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:05.373124    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert podName:612ec492-4ba7-44e5-8720-c91044c6ea04 nodeName:}" failed. No retries permitted until 2026-07-07 22:04:06.373108227 +0000 UTC m=+325.671327555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert") pod "kserve-controller-manager-d6f4b65b8-wppzc" (UID: "612ec492-4ba7-44e5-8720-c91044c6ea04") : secret "kserve-webhook-server-cert" not found
Jul 07 22:04:05.375370 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:05.375353    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27483891-ffe9-498b-a5f9-4883492a5a64-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4cc5b\" (UID: \"27483891-ffe9-498b-a5f9-4883492a5a64\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:05.603748 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:05.603708    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:05.745275 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:05.745252    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"]
Jul 07 22:04:05.747620 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:04:05.747594    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27483891_ffe9_498b_a5f9_4883492a5a64.slice/crio-197a33d03fbeaaef40e48b1200a25618e62fc20dc664f315388b623347fdfd16 WatchSource:0}: Error finding container 197a33d03fbeaaef40e48b1200a25618e62fc20dc664f315388b623347fdfd16: Status 404 returned error can't find the container with id 197a33d03fbeaaef40e48b1200a25618e62fc20dc664f315388b623347fdfd16
Jul 07 22:04:06.383345 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:06.383308    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:06.386178 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:06.386145    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/612ec492-4ba7-44e5-8720-c91044c6ea04-cert\") pod \"kserve-controller-manager-d6f4b65b8-wppzc\" (UID: \"612ec492-4ba7-44e5-8720-c91044c6ea04\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:06.495928 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:06.495895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:06.737253 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:06.737152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b" event={"ID":"27483891-ffe9-498b-a5f9-4883492a5a64","Type":"ContainerStarted","Data":"197a33d03fbeaaef40e48b1200a25618e62fc20dc664f315388b623347fdfd16"}
Jul 07 22:04:07.063639 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:07.063596    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"]
Jul 07 22:04:07.065462 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:04:07.065431    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612ec492_4ba7_44e5_8720_c91044c6ea04.slice/crio-da0184d2071947fcfffb85055234010d3bee3da8c4dac27d7e3c22d8f8ca7f5f WatchSource:0}: Error finding container da0184d2071947fcfffb85055234010d3bee3da8c4dac27d7e3c22d8f8ca7f5f: Status 404 returned error can't find the container with id da0184d2071947fcfffb85055234010d3bee3da8c4dac27d7e3c22d8f8ca7f5f
Jul 07 22:04:07.746804 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:07.746763    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc" event={"ID":"612ec492-4ba7-44e5-8720-c91044c6ea04","Type":"ContainerStarted","Data":"da0184d2071947fcfffb85055234010d3bee3da8c4dac27d7e3c22d8f8ca7f5f"}
Jul 07 22:04:09.760252 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:09.760208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b" event={"ID":"27483891-ffe9-498b-a5f9-4883492a5a64","Type":"ContainerStarted","Data":"3f4793a8812199ce5268fb7f65f914762478b0ca370f3cc152692a8e5c72cd97"}
Jul 07 22:04:09.760690 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:09.760315    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:09.781426 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:09.781362    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b" podStartSLOduration=2.431021693 podStartE2EDuration="5.781347605s" totalImagesPullingTime="3.350325912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:09.779704515 +0000 UTC m=+329.077923867" watchObservedRunningTime="2026-07-07 22:04:09.781347605 +0000 UTC m=+329.079566955"
Jul 07 22:04:10.766479 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:10.766437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc" event={"ID":"612ec492-4ba7-44e5-8720-c91044c6ea04","Type":"ContainerStarted","Data":"df458a97ed3a623e604962c5d76016ca32bae5f1a6a68b781fbf96a7671b6dfe"}
Jul 07 22:04:10.766969 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:10.766811    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:10.784727 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:10.784671    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc" podStartSLOduration=3.928906727 podStartE2EDuration="6.784651774s" totalImagesPullingTime="2.855745047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:10.783916604 +0000 UTC m=+330.082135956" watchObservedRunningTime="2026-07-07 22:04:10.784651774 +0000 UTC m=+330.082871126"
Jul 07 22:04:11.713554 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:11.713495    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kltts"
Jul 07 22:04:11.715788 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:11.715766    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-r7vvd"
Jul 07 22:04:20.373787 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.373756    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"]
Jul 07 22:04:20.374226 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.373935    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt" podUID="70d404bb-9f89-4f37-96ff-de41f6e5e016" containerName="discovery" containerID="cri-o://7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589" gracePeriod=30
Jul 07 22:04:20.615126 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.615098    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:04:20.711863 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.711773    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-dns-cert\") pod \"70d404bb-9f89-4f37-96ff-de41f6e5e016\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") "
Jul 07 22:04:20.711863 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.711818    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d404bb-9f89-4f37-96ff-de41f6e5e016-local-certs\") pod \"70d404bb-9f89-4f37-96ff-de41f6e5e016\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") "
Jul 07 22:04:20.711863 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.711863    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw6p8\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-kube-api-access-vw6p8\") pod \"70d404bb-9f89-4f37-96ff-de41f6e5e016\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") "
Jul 07 22:04:20.712163 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.711942    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-ca-configmap\") pod \"70d404bb-9f89-4f37-96ff-de41f6e5e016\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") "
Jul 07 22:04:20.712163 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.711983    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-cacerts\") pod \"70d404bb-9f89-4f37-96ff-de41f6e5e016\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") "
Jul 07 22:04:20.712163 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.712019    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-kubeconfig\") pod \"70d404bb-9f89-4f37-96ff-de41f6e5e016\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") "
Jul 07 22:04:20.712163 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.712040    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-token\") pod \"70d404bb-9f89-4f37-96ff-de41f6e5e016\" (UID: \"70d404bb-9f89-4f37-96ff-de41f6e5e016\") "
Jul 07 22:04:20.712376 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.712336    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "70d404bb-9f89-4f37-96ff-de41f6e5e016" (UID: "70d404bb-9f89-4f37-96ff-de41f6e5e016"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:04:20.714472 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.714437    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-token" (OuterVolumeSpecName: "istio-token") pod "70d404bb-9f89-4f37-96ff-de41f6e5e016" (UID: "70d404bb-9f89-4f37-96ff-de41f6e5e016"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:04:20.714624 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.714468    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-kube-api-access-vw6p8" (OuterVolumeSpecName: "kube-api-access-vw6p8") pod "70d404bb-9f89-4f37-96ff-de41f6e5e016" (UID: "70d404bb-9f89-4f37-96ff-de41f6e5e016"). InnerVolumeSpecName "kube-api-access-vw6p8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:04:20.714690 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.714661    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d404bb-9f89-4f37-96ff-de41f6e5e016-local-certs" (OuterVolumeSpecName: "local-certs") pod "70d404bb-9f89-4f37-96ff-de41f6e5e016" (UID: "70d404bb-9f89-4f37-96ff-de41f6e5e016"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:04:20.714690 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.714659    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-cacerts" (OuterVolumeSpecName: "cacerts") pod "70d404bb-9f89-4f37-96ff-de41f6e5e016" (UID: "70d404bb-9f89-4f37-96ff-de41f6e5e016"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:04:20.714799 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.714782    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "70d404bb-9f89-4f37-96ff-de41f6e5e016" (UID: "70d404bb-9f89-4f37-96ff-de41f6e5e016"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:04:20.714838 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.714800    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "70d404bb-9f89-4f37-96ff-de41f6e5e016" (UID: "70d404bb-9f89-4f37-96ff-de41f6e5e016"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:04:20.813123 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.813085    2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-cacerts\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:20.813123 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.813118    2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-kubeconfig\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:20.813123 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.813130    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-token\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:20.813358 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.813138    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-dns-cert\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:20.813358 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.813146    2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d404bb-9f89-4f37-96ff-de41f6e5e016-local-certs\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:20.813358 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.813154    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw6p8\" (UniqueName: \"kubernetes.io/projected/70d404bb-9f89-4f37-96ff-de41f6e5e016-kube-api-access-vw6p8\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:20.813358 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.813164    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70d404bb-9f89-4f37-96ff-de41f6e5e016-istio-csr-ca-configmap\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:20.814279 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.814254    2567 generic.go:356] "Generic (PLEG): container finished" podID="70d404bb-9f89-4f37-96ff-de41f6e5e016" containerID="7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589" exitCode=0
Jul 07 22:04:20.814345 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.814321    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"
Jul 07 22:04:20.814418 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.814329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt" event={"ID":"70d404bb-9f89-4f37-96ff-de41f6e5e016","Type":"ContainerDied","Data":"7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589"}
Jul 07 22:04:20.814475 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.814463    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt" event={"ID":"70d404bb-9f89-4f37-96ff-de41f6e5e016","Type":"ContainerDied","Data":"c43cfe7c7f93c5e930610d7c74a2bf62bfeac4f5f343dea9c9f72496ad4bd8e8"}
Jul 07 22:04:20.814514 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.814488    2567 scope.go:117] "RemoveContainer" containerID="7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589"
Jul 07 22:04:20.823346 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.823330    2567 scope.go:117] "RemoveContainer" containerID="7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589"
Jul 07 22:04:20.823631 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:20.823612    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589\": container with ID starting with 7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589 not found: ID does not exist" containerID="7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589"
Jul 07 22:04:20.823684 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.823638    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589"} err="failed to get container status \"7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589\": rpc error: code = NotFound desc = could not find container \"7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589\": container with ID starting with 7c83643d1252f430160b3572fe7b812c834a4771474295def15ddd5eab25b589 not found: ID does not exist"
Jul 07 22:04:20.836177 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.836157    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"]
Jul 07 22:04:20.841147 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:20.841123    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nbjzt"]
Jul 07 22:04:21.251215 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:21.251184    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d404bb-9f89-4f37-96ff-de41f6e5e016" path="/var/lib/kubelet/pods/70d404bb-9f89-4f37-96ff-de41f6e5e016/volumes"
Jul 07 22:04:40.768567 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:40.768464    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4cc5b"
Jul 07 22:04:41.776417 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:41.776391    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wppzc"
Jul 07 22:04:53.538802 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.538763    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xzkt"]
Jul 07 22:04:53.539273 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.539196    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d404bb-9f89-4f37-96ff-de41f6e5e016" containerName="discovery"
Jul 07 22:04:53.539273 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.539214    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d404bb-9f89-4f37-96ff-de41f6e5e016" containerName="discovery"
Jul 07 22:04:53.539385 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.539315    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d404bb-9f89-4f37-96ff-de41f6e5e016" containerName="discovery"
Jul 07 22:04:53.547093 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.547070    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt"
Jul 07 22:04:53.551339 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.551312    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 22:04:53.551339 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.551333    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 22:04:53.551622 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.551603    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nznr5\""
Jul 07 22:04:53.555177 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.555152    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xzkt"]
Jul 07 22:04:53.674815 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.674779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxtt9\" (UniqueName: \"kubernetes.io/projected/d6e577ee-ed05-4e18-986f-be3a6dd84981-kube-api-access-rxtt9\") pod \"kuadrant-operator-catalog-7xzkt\" (UID: \"d6e577ee-ed05-4e18-986f-be3a6dd84981\") " pod="kuadrant-system/kuadrant-operator-catalog-7xzkt"
Jul 07 22:04:53.776163 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.776120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxtt9\" (UniqueName: \"kubernetes.io/projected/d6e577ee-ed05-4e18-986f-be3a6dd84981-kube-api-access-rxtt9\") pod \"kuadrant-operator-catalog-7xzkt\" (UID: \"d6e577ee-ed05-4e18-986f-be3a6dd84981\") " pod="kuadrant-system/kuadrant-operator-catalog-7xzkt"
Jul 07 22:04:53.785767 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.785736    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxtt9\" (UniqueName: \"kubernetes.io/projected/d6e577ee-ed05-4e18-986f-be3a6dd84981-kube-api-access-rxtt9\") pod \"kuadrant-operator-catalog-7xzkt\" (UID: \"d6e577ee-ed05-4e18-986f-be3a6dd84981\") " pod="kuadrant-system/kuadrant-operator-catalog-7xzkt"
Jul 07 22:04:53.858900 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.858808    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt"
Jul 07 22:04:53.903020 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.902982    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xzkt"]
Jul 07 22:04:53.996373 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:53.996351    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xzkt"]
Jul 07 22:04:53.998579 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:04:53.998553    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e577ee_ed05_4e18_986f_be3a6dd84981.slice/crio-4227232ae8925f5435cbe41fd9649798eeaf1f4840e0b2c57b8c21e82eeb6f9f WatchSource:0}: Error finding container 4227232ae8925f5435cbe41fd9649798eeaf1f4840e0b2c57b8c21e82eeb6f9f: Status 404 returned error can't find the container with id 4227232ae8925f5435cbe41fd9649798eeaf1f4840e0b2c57b8c21e82eeb6f9f
Jul 07 22:04:54.115301 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.115223    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgt87"]
Jul 07 22:04:54.120160 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.120142    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:04:54.127796 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.127771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgt87"]
Jul 07 22:04:54.179372 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.179333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29scp\" (UniqueName: \"kubernetes.io/projected/c11e4022-b037-4eed-9bcd-bdb93128b249-kube-api-access-29scp\") pod \"kuadrant-operator-catalog-mgt87\" (UID: \"c11e4022-b037-4eed-9bcd-bdb93128b249\") " pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:04:54.279839 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.279809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29scp\" (UniqueName: \"kubernetes.io/projected/c11e4022-b037-4eed-9bcd-bdb93128b249-kube-api-access-29scp\") pod \"kuadrant-operator-catalog-mgt87\" (UID: \"c11e4022-b037-4eed-9bcd-bdb93128b249\") " pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:04:54.289186 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.289167    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29scp\" (UniqueName: \"kubernetes.io/projected/c11e4022-b037-4eed-9bcd-bdb93128b249-kube-api-access-29scp\") pod \"kuadrant-operator-catalog-mgt87\" (UID: \"c11e4022-b037-4eed-9bcd-bdb93128b249\") " pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:04:54.430118 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.430038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:04:54.568938 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.568910    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mgt87"]
Jul 07 22:04:54.601804 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:04:54.601776    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11e4022_b037_4eed_9bcd_bdb93128b249.slice/crio-2cb0b01524ff1b9a1e95e10b8860827d238bc561d32b75bf74258b818e17c6ef WatchSource:0}: Error finding container 2cb0b01524ff1b9a1e95e10b8860827d238bc561d32b75bf74258b818e17c6ef: Status 404 returned error can't find the container with id 2cb0b01524ff1b9a1e95e10b8860827d238bc561d32b75bf74258b818e17c6ef
Jul 07 22:04:54.971065 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.971033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mgt87" event={"ID":"c11e4022-b037-4eed-9bcd-bdb93128b249","Type":"ContainerStarted","Data":"2cb0b01524ff1b9a1e95e10b8860827d238bc561d32b75bf74258b818e17c6ef"}
Jul 07 22:04:54.972293 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:54.972273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt" event={"ID":"d6e577ee-ed05-4e18-986f-be3a6dd84981","Type":"ContainerStarted","Data":"4227232ae8925f5435cbe41fd9649798eeaf1f4840e0b2c57b8c21e82eeb6f9f"}
Jul 07 22:04:56.985410 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:56.985372    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt" event={"ID":"d6e577ee-ed05-4e18-986f-be3a6dd84981","Type":"ContainerStarted","Data":"bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0"}
Jul 07 22:04:56.985944 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:56.985426    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt" podUID="d6e577ee-ed05-4e18-986f-be3a6dd84981" containerName="registry-server" containerID="cri-o://bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0" gracePeriod=2
Jul 07 22:04:56.986970 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:56.986946    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mgt87" event={"ID":"c11e4022-b037-4eed-9bcd-bdb93128b249","Type":"ContainerStarted","Data":"f2a6b5674d99fbdf51093d807d1babcf6d22f063710f03ffec17c50804074854"}
Jul 07 22:04:57.004438 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.004397    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt" podStartSLOduration=1.5256158279999998 podStartE2EDuration="4.004383652s" totalImagesPullingTime="2.478767824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:57.002897836 +0000 UTC m=+376.301117187" watchObservedRunningTime="2026-07-07 22:04:57.004383652 +0000 UTC m=+376.302603003"
Jul 07 22:04:57.019831 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.019790    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mgt87" podStartSLOduration=1.147419199 podStartE2EDuration="3.019777846s" totalImagesPullingTime="1.872358647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:04:57.018375403 +0000 UTC m=+376.316594753" watchObservedRunningTime="2026-07-07 22:04:57.019777846 +0000 UTC m=+376.317997197"
Jul 07 22:04:57.227047 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.227016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt"
Jul 07 22:04:57.306850 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.306811    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxtt9\" (UniqueName: \"kubernetes.io/projected/d6e577ee-ed05-4e18-986f-be3a6dd84981-kube-api-access-rxtt9\") pod \"d6e577ee-ed05-4e18-986f-be3a6dd84981\" (UID: \"d6e577ee-ed05-4e18-986f-be3a6dd84981\") "
Jul 07 22:04:57.309124 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.309084    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e577ee-ed05-4e18-986f-be3a6dd84981-kube-api-access-rxtt9" (OuterVolumeSpecName: "kube-api-access-rxtt9") pod "d6e577ee-ed05-4e18-986f-be3a6dd84981" (UID: "d6e577ee-ed05-4e18-986f-be3a6dd84981"). InnerVolumeSpecName "kube-api-access-rxtt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:04:57.407894 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.407852    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxtt9\" (UniqueName: \"kubernetes.io/projected/d6e577ee-ed05-4e18-986f-be3a6dd84981-kube-api-access-rxtt9\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:04:57.992840 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.992802    2567 generic.go:356] "Generic (PLEG): container finished" podID="d6e577ee-ed05-4e18-986f-be3a6dd84981" containerID="bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0" exitCode=0
Jul 07 22:04:57.993245 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.992861    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt"
Jul 07 22:04:57.993245 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.992885    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt" event={"ID":"d6e577ee-ed05-4e18-986f-be3a6dd84981","Type":"ContainerDied","Data":"bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0"}
Jul 07 22:04:57.993245 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.992935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xzkt" event={"ID":"d6e577ee-ed05-4e18-986f-be3a6dd84981","Type":"ContainerDied","Data":"4227232ae8925f5435cbe41fd9649798eeaf1f4840e0b2c57b8c21e82eeb6f9f"}
Jul 07 22:04:57.993245 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:57.992957    2567 scope.go:117] "RemoveContainer" containerID="bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0"
Jul 07 22:04:58.002305 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:58.002290    2567 scope.go:117] "RemoveContainer" containerID="bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0"
Jul 07 22:04:58.002562 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:04:58.002545    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0\": container with ID starting with bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0 not found: ID does not exist" containerID="bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0"
Jul 07 22:04:58.002614 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:58.002569    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0"} err="failed to get container status \"bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0\": rpc error: code = NotFound desc = could not find container \"bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0\": container with ID starting with bb543fd19862caef63b6abba31e80c7af8f5cc1c52680a6137d86fcdcf07d6f0 not found: ID does not exist"
Jul 07 22:04:58.015236 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:58.015213    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xzkt"]
Jul 07 22:04:58.019411 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:58.019390    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xzkt"]
Jul 07 22:04:59.249815 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:04:59.249786    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e577ee-ed05-4e18-986f-be3a6dd84981" path="/var/lib/kubelet/pods/d6e577ee-ed05-4e18-986f-be3a6dd84981/volumes"
Jul 07 22:05:04.430622 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:04.430576    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:05:04.431039 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:04.430641    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:05:04.453797 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:04.453763    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:05:05.048711 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:05.048685    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mgt87"
Jul 07 22:05:09.368069 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.368034    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"]
Jul 07 22:05:09.368445 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.368327    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6e577ee-ed05-4e18-986f-be3a6dd84981" containerName="registry-server"
Jul 07 22:05:09.368445 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.368337    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6e577ee-ed05-4e18-986f-be3a6dd84981" containerName="registry-server"
Jul 07 22:05:09.368445 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.368405    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6e577ee-ed05-4e18-986f-be3a6dd84981" containerName="registry-server"
Jul 07 22:05:09.371551 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.371512    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.374643 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.374611    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tb8gm\""
Jul 07 22:05:09.384843 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.384820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"]
Jul 07 22:05:09.511855 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.511823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.512026 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.511875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkcbg\" (UniqueName: \"kubernetes.io/projected/97f719e0-a780-40d7-9f45-f65543e1e148-kube-api-access-xkcbg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.512026 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.511939    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.613054 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.612998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkcbg\" (UniqueName: \"kubernetes.io/projected/97f719e0-a780-40d7-9f45-f65543e1e148-kube-api-access-xkcbg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.613255 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.613069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.613255 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.613121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.613459 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.613429    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.613614 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.613500    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.622428 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.622371    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkcbg\" (UniqueName: \"kubernetes.io/projected/97f719e0-a780-40d7-9f45-f65543e1e148-kube-api-access-xkcbg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.680434 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.680400    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:09.756650 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.756621    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"]
Jul 07 22:05:09.760364 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.760346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:09.770448 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.770424    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"]
Jul 07 22:05:09.821136 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.820992    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"]
Jul 07 22:05:09.823824 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:09.823802    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f719e0_a780_40d7_9f45_f65543e1e148.slice/crio-4c54b221017bc329fbcada858d1b8c1e116d39a8576d2dac010f0f2cb48ce485 WatchSource:0}: Error finding container 4c54b221017bc329fbcada858d1b8c1e116d39a8576d2dac010f0f2cb48ce485: Status 404 returned error can't find the container with id 4c54b221017bc329fbcada858d1b8c1e116d39a8576d2dac010f0f2cb48ce485
Jul 07 22:05:09.915688 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.915446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkgdm\" (UniqueName: \"kubernetes.io/projected/4f1e9631-4521-44dd-970b-cdb6143eee52-kube-api-access-vkgdm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:09.915688 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.915606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:09.915688 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:09.915691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.016734 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.016697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.016935 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.016770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.016935 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.016824    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkgdm\" (UniqueName: \"kubernetes.io/projected/4f1e9631-4521-44dd-970b-cdb6143eee52-kube-api-access-vkgdm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.017163 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.017137    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.017228 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.017146    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.026205 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.026178    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkgdm\" (UniqueName: \"kubernetes.io/projected/4f1e9631-4521-44dd-970b-cdb6143eee52-kube-api-access-vkgdm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.050396 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.050365    2567 generic.go:356] "Generic (PLEG): container finished" podID="97f719e0-a780-40d7-9f45-f65543e1e148" containerID="c4c52a319d3f2ae4ceeff254362dff1868345676d5c7d0e87f651281ce4e8837" exitCode=0
Jul 07 22:05:10.050554 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.050436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878" event={"ID":"97f719e0-a780-40d7-9f45-f65543e1e148","Type":"ContainerDied","Data":"c4c52a319d3f2ae4ceeff254362dff1868345676d5c7d0e87f651281ce4e8837"}
Jul 07 22:05:10.050554 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.050487    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878" event={"ID":"97f719e0-a780-40d7-9f45-f65543e1e148","Type":"ContainerStarted","Data":"4c54b221017bc329fbcada858d1b8c1e116d39a8576d2dac010f0f2cb48ce485"}
Jul 07 22:05:10.072563 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.072520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:10.163599 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.163569    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"]
Jul 07 22:05:10.168184 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.168159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.181615 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.181586    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"]
Jul 07 22:05:10.212284 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.212265    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"]
Jul 07 22:05:10.213836 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:10.213811    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1e9631_4521_44dd_970b_cdb6143eee52.slice/crio-68ae54f244438605b6182661a4ae06740b167fc63d821fe69c6d141272e0e156 WatchSource:0}: Error finding container 68ae54f244438605b6182661a4ae06740b167fc63d821fe69c6d141272e0e156: Status 404 returned error can't find the container with id 68ae54f244438605b6182661a4ae06740b167fc63d821fe69c6d141272e0e156
Jul 07 22:05:10.319839 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.319813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.319961 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.319877    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.320001 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.319959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgsgh\" (UniqueName: \"kubernetes.io/projected/3c1f7168-eab8-4b21-8b4c-9e223025c89f-kube-api-access-qgsgh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.421425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.421342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.421425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.421405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgsgh\" (UniqueName: \"kubernetes.io/projected/3c1f7168-eab8-4b21-8b4c-9e223025c89f-kube-api-access-qgsgh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.421849 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.421427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.421849 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.421818    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.421989 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.421853    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.431703 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.431681    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgsgh\" (UniqueName: \"kubernetes.io/projected/3c1f7168-eab8-4b21-8b4c-9e223025c89f-kube-api-access-qgsgh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.479121 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.479091    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:10.623185 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.623158    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"]
Jul 07 22:05:10.630976 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:10.630945    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1f7168_eab8_4b21_8b4c_9e223025c89f.slice/crio-d6b05af5037bbe1bc9c2edef4d12a1d4d05ac60a7702dae725cad73045025f7a WatchSource:0}: Error finding container d6b05af5037bbe1bc9c2edef4d12a1d4d05ac60a7702dae725cad73045025f7a: Status 404 returned error can't find the container with id d6b05af5037bbe1bc9c2edef4d12a1d4d05ac60a7702dae725cad73045025f7a
Jul 07 22:05:10.764949 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.764922    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"]
Jul 07 22:05:10.768258 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.768237    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:10.777796 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.777768    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"]
Jul 07 22:05:10.926425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.926337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rl72\" (UniqueName: \"kubernetes.io/projected/11035410-8054-4835-a84a-97750e736c6c-kube-api-access-8rl72\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:10.926425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.926405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:10.926425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:10.926427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.027112 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.027078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.027112 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.027115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.027287 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.027165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rl72\" (UniqueName: \"kubernetes.io/projected/11035410-8054-4835-a84a-97750e736c6c-kube-api-access-8rl72\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.027453 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.027434    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.027493 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.027469    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.036809 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.036776    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rl72\" (UniqueName: \"kubernetes.io/projected/11035410-8054-4835-a84a-97750e736c6c-kube-api-access-8rl72\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.056610 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.056581    2567 generic.go:356] "Generic (PLEG): container finished" podID="97f719e0-a780-40d7-9f45-f65543e1e148" containerID="97aad7f1fec48039320001f0f8d610862015810f1caa4b03aff00b68dd0ac60f" exitCode=0
Jul 07 22:05:11.056814 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.056663    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878" event={"ID":"97f719e0-a780-40d7-9f45-f65543e1e148","Type":"ContainerDied","Data":"97aad7f1fec48039320001f0f8d610862015810f1caa4b03aff00b68dd0ac60f"}
Jul 07 22:05:11.058293 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.058270    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerID="915bcb01897defd139927ec349be5b6661ed3dc013330f6c2bc056f67673f7de" exitCode=0
Jul 07 22:05:11.058355 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.058336    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv" event={"ID":"3c1f7168-eab8-4b21-8b4c-9e223025c89f","Type":"ContainerDied","Data":"915bcb01897defd139927ec349be5b6661ed3dc013330f6c2bc056f67673f7de"}
Jul 07 22:05:11.058408 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.058382    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv" event={"ID":"3c1f7168-eab8-4b21-8b4c-9e223025c89f","Type":"ContainerStarted","Data":"d6b05af5037bbe1bc9c2edef4d12a1d4d05ac60a7702dae725cad73045025f7a"}
Jul 07 22:05:11.060022 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.059997    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerID="3d04f92686b940ec276198f1dac0d98d0ad554a3e6791dd33c0e4785427cd965" exitCode=0
Jul 07 22:05:11.060143 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.060075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg" event={"ID":"4f1e9631-4521-44dd-970b-cdb6143eee52","Type":"ContainerDied","Data":"3d04f92686b940ec276198f1dac0d98d0ad554a3e6791dd33c0e4785427cd965"}
Jul 07 22:05:11.060143 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.060106    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg" event={"ID":"4f1e9631-4521-44dd-970b-cdb6143eee52","Type":"ContainerStarted","Data":"68ae54f244438605b6182661a4ae06740b167fc63d821fe69c6d141272e0e156"}
Jul 07 22:05:11.142143 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.142113    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:11.285477 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:11.285455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"]
Jul 07 22:05:11.287005 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:11.286985    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11035410_8054_4835_a84a_97750e736c6c.slice/crio-b58a48117b37e4ee79789bb0780320a5ece301dfbfc84930d52fb0eb7c910e3a WatchSource:0}: Error finding container b58a48117b37e4ee79789bb0780320a5ece301dfbfc84930d52fb0eb7c910e3a: Status 404 returned error can't find the container with id b58a48117b37e4ee79789bb0780320a5ece301dfbfc84930d52fb0eb7c910e3a
Jul 07 22:05:12.066465 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:12.066437    2567 generic.go:356] "Generic (PLEG): container finished" podID="97f719e0-a780-40d7-9f45-f65543e1e148" containerID="6e497e0529becbc02b07576a19218ead99e14dd7a07a4ad92d4a9ad75548ba75" exitCode=0
Jul 07 22:05:12.066859 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:12.066520    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878" event={"ID":"97f719e0-a780-40d7-9f45-f65543e1e148","Type":"ContainerDied","Data":"6e497e0529becbc02b07576a19218ead99e14dd7a07a4ad92d4a9ad75548ba75"}
Jul 07 22:05:12.068161 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:12.068142    2567 generic.go:356] "Generic (PLEG): container finished" podID="11035410-8054-4835-a84a-97750e736c6c" containerID="0f1c549250880229925466b6eb147cebf0c4c7fc7c97ae19abd17cd94cc50fcb" exitCode=0
Jul 07 22:05:12.068260 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:12.068217    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6" event={"ID":"11035410-8054-4835-a84a-97750e736c6c","Type":"ContainerDied","Data":"0f1c549250880229925466b6eb147cebf0c4c7fc7c97ae19abd17cd94cc50fcb"}
Jul 07 22:05:12.068260 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:12.068255    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6" event={"ID":"11035410-8054-4835-a84a-97750e736c6c","Type":"ContainerStarted","Data":"b58a48117b37e4ee79789bb0780320a5ece301dfbfc84930d52fb0eb7c910e3a"}
Jul 07 22:05:13.074833 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.074800    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerID="5fefb6a118a92d117f3aacdadeaf78e62267b73be9ca51adb101c7af8adf6ba1" exitCode=0
Jul 07 22:05:13.075250 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.074886    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv" event={"ID":"3c1f7168-eab8-4b21-8b4c-9e223025c89f","Type":"ContainerDied","Data":"5fefb6a118a92d117f3aacdadeaf78e62267b73be9ca51adb101c7af8adf6ba1"}
Jul 07 22:05:13.076780 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.076759    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerID="b6f9c44ece511ac02d99a076cf6b98fb0c7a72f458d1ecd0763b9a52e63ef089" exitCode=0
Jul 07 22:05:13.076903 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.076833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg" event={"ID":"4f1e9631-4521-44dd-970b-cdb6143eee52","Type":"ContainerDied","Data":"b6f9c44ece511ac02d99a076cf6b98fb0c7a72f458d1ecd0763b9a52e63ef089"}
Jul 07 22:05:13.078639 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.078614    2567 generic.go:356] "Generic (PLEG): container finished" podID="11035410-8054-4835-a84a-97750e736c6c" containerID="4f2908762f4957118e956cd84b2354a1b4c77a017335d8b1163a43f490f1684b" exitCode=0
Jul 07 22:05:13.078747 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.078690    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6" event={"ID":"11035410-8054-4835-a84a-97750e736c6c","Type":"ContainerDied","Data":"4f2908762f4957118e956cd84b2354a1b4c77a017335d8b1163a43f490f1684b"}
Jul 07 22:05:13.223417 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.223389    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:13.347268 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.347238    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-util\") pod \"97f719e0-a780-40d7-9f45-f65543e1e148\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") "
Jul 07 22:05:13.347407 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.347284    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkcbg\" (UniqueName: \"kubernetes.io/projected/97f719e0-a780-40d7-9f45-f65543e1e148-kube-api-access-xkcbg\") pod \"97f719e0-a780-40d7-9f45-f65543e1e148\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") "
Jul 07 22:05:13.347407 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.347317    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-bundle\") pod \"97f719e0-a780-40d7-9f45-f65543e1e148\" (UID: \"97f719e0-a780-40d7-9f45-f65543e1e148\") "
Jul 07 22:05:13.347840 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.347813    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-bundle" (OuterVolumeSpecName: "bundle") pod "97f719e0-a780-40d7-9f45-f65543e1e148" (UID: "97f719e0-a780-40d7-9f45-f65543e1e148"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:13.349438 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.349414    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97f719e0-a780-40d7-9f45-f65543e1e148-kube-api-access-xkcbg" (OuterVolumeSpecName: "kube-api-access-xkcbg") pod "97f719e0-a780-40d7-9f45-f65543e1e148" (UID: "97f719e0-a780-40d7-9f45-f65543e1e148"). InnerVolumeSpecName "kube-api-access-xkcbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:05:13.353140 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.353121    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-util" (OuterVolumeSpecName: "util") pod "97f719e0-a780-40d7-9f45-f65543e1e148" (UID: "97f719e0-a780-40d7-9f45-f65543e1e148"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:13.448796 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.448761    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-util\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:13.448796 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.448792    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkcbg\" (UniqueName: \"kubernetes.io/projected/97f719e0-a780-40d7-9f45-f65543e1e148-kube-api-access-xkcbg\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:13.448796 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:13.448801    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97f719e0-a780-40d7-9f45-f65543e1e148-bundle\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:14.086100 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.086065    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerID="51fbc84a5cb96b766201c4275ccf7ca22685ddb9876bdd06ee7754fb3771887b" exitCode=0
Jul 07 22:05:14.086501 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.086146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv" event={"ID":"3c1f7168-eab8-4b21-8b4c-9e223025c89f","Type":"ContainerDied","Data":"51fbc84a5cb96b766201c4275ccf7ca22685ddb9876bdd06ee7754fb3771887b"}
Jul 07 22:05:14.088179 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.088153    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerID="922b5ee5d5a5ff61db32b522d535a6275ee4ffbba8e2990c2174e7c8221db508" exitCode=0
Jul 07 22:05:14.088292 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.088226    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg" event={"ID":"4f1e9631-4521-44dd-970b-cdb6143eee52","Type":"ContainerDied","Data":"922b5ee5d5a5ff61db32b522d535a6275ee4ffbba8e2990c2174e7c8221db508"}
Jul 07 22:05:14.090226 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.090203    2567 generic.go:356] "Generic (PLEG): container finished" podID="11035410-8054-4835-a84a-97750e736c6c" containerID="cea4be3be97e25d3917acab5c8f8709d2f12394f89a2c56c69a0fd25f04888e0" exitCode=0
Jul 07 22:05:14.090348 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.090297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6" event={"ID":"11035410-8054-4835-a84a-97750e736c6c","Type":"ContainerDied","Data":"cea4be3be97e25d3917acab5c8f8709d2f12394f89a2c56c69a0fd25f04888e0"}
Jul 07 22:05:14.091930 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.091912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878" event={"ID":"97f719e0-a780-40d7-9f45-f65543e1e148","Type":"ContainerDied","Data":"4c54b221017bc329fbcada858d1b8c1e116d39a8576d2dac010f0f2cb48ce485"}
Jul 07 22:05:14.091930 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.091927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878"
Jul 07 22:05:14.092063 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:14.091941    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c54b221017bc329fbcada858d1b8c1e116d39a8576d2dac010f0f2cb48ce485"
Jul 07 22:05:15.275435 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.275358    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:15.298162 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.298141    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:15.309962 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.309942    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:15.365363 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.365287    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rl72\" (UniqueName: \"kubernetes.io/projected/11035410-8054-4835-a84a-97750e736c6c-kube-api-access-8rl72\") pod \"11035410-8054-4835-a84a-97750e736c6c\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") "
Jul 07 22:05:15.365363 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.365318    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-bundle\") pod \"11035410-8054-4835-a84a-97750e736c6c\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") "
Jul 07 22:05:15.365609 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.365395    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-util\") pod \"11035410-8054-4835-a84a-97750e736c6c\" (UID: \"11035410-8054-4835-a84a-97750e736c6c\") "
Jul 07 22:05:15.366032 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.365995    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-bundle" (OuterVolumeSpecName: "bundle") pod "11035410-8054-4835-a84a-97750e736c6c" (UID: "11035410-8054-4835-a84a-97750e736c6c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:15.367467 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.367445    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11035410-8054-4835-a84a-97750e736c6c-kube-api-access-8rl72" (OuterVolumeSpecName: "kube-api-access-8rl72") pod "11035410-8054-4835-a84a-97750e736c6c" (UID: "11035410-8054-4835-a84a-97750e736c6c"). InnerVolumeSpecName "kube-api-access-8rl72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:05:15.370206 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.370185    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-util" (OuterVolumeSpecName: "util") pod "11035410-8054-4835-a84a-97750e736c6c" (UID: "11035410-8054-4835-a84a-97750e736c6c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:15.465910 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.465865    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-bundle\") pod \"4f1e9631-4521-44dd-970b-cdb6143eee52\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") "
Jul 07 22:05:15.466092 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.465931    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-bundle\") pod \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") "
Jul 07 22:05:15.466092 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.465954    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-util\") pod \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") "
Jul 07 22:05:15.466092 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.465977    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkgdm\" (UniqueName: \"kubernetes.io/projected/4f1e9631-4521-44dd-970b-cdb6143eee52-kube-api-access-vkgdm\") pod \"4f1e9631-4521-44dd-970b-cdb6143eee52\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") "
Jul 07 22:05:15.466092 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.466002    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgsgh\" (UniqueName: \"kubernetes.io/projected/3c1f7168-eab8-4b21-8b4c-9e223025c89f-kube-api-access-qgsgh\") pod \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\" (UID: \"3c1f7168-eab8-4b21-8b4c-9e223025c89f\") "
Jul 07 22:05:15.466092 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.466034    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-util\") pod \"4f1e9631-4521-44dd-970b-cdb6143eee52\" (UID: \"4f1e9631-4521-44dd-970b-cdb6143eee52\") "
Jul 07 22:05:15.466354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.466235    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-util\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.466354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.466253    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rl72\" (UniqueName: \"kubernetes.io/projected/11035410-8054-4835-a84a-97750e736c6c-kube-api-access-8rl72\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.466354 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.466268    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11035410-8054-4835-a84a-97750e736c6c-bundle\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.466496 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.466470    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-bundle" (OuterVolumeSpecName: "bundle") pod "4f1e9631-4521-44dd-970b-cdb6143eee52" (UID: "4f1e9631-4521-44dd-970b-cdb6143eee52"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:15.466701 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.466677    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-bundle" (OuterVolumeSpecName: "bundle") pod "3c1f7168-eab8-4b21-8b4c-9e223025c89f" (UID: "3c1f7168-eab8-4b21-8b4c-9e223025c89f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:15.468821 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.468792    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1f7168-eab8-4b21-8b4c-9e223025c89f-kube-api-access-qgsgh" (OuterVolumeSpecName: "kube-api-access-qgsgh") pod "3c1f7168-eab8-4b21-8b4c-9e223025c89f" (UID: "3c1f7168-eab8-4b21-8b4c-9e223025c89f"). InnerVolumeSpecName "kube-api-access-qgsgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:05:15.468923 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.468831    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1e9631-4521-44dd-970b-cdb6143eee52-kube-api-access-vkgdm" (OuterVolumeSpecName: "kube-api-access-vkgdm") pod "4f1e9631-4521-44dd-970b-cdb6143eee52" (UID: "4f1e9631-4521-44dd-970b-cdb6143eee52"). InnerVolumeSpecName "kube-api-access-vkgdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:05:15.471938 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.471902    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-util" (OuterVolumeSpecName: "util") pod "3c1f7168-eab8-4b21-8b4c-9e223025c89f" (UID: "3c1f7168-eab8-4b21-8b4c-9e223025c89f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:15.472026 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.472008    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-util" (OuterVolumeSpecName: "util") pod "4f1e9631-4521-44dd-970b-cdb6143eee52" (UID: "4f1e9631-4521-44dd-970b-cdb6143eee52"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:15.567605 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.567563    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-bundle\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.567605 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.567600    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-bundle\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.567605 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.567609    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c1f7168-eab8-4b21-8b4c-9e223025c89f-util\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.567824 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.567617    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkgdm\" (UniqueName: \"kubernetes.io/projected/4f1e9631-4521-44dd-970b-cdb6143eee52-kube-api-access-vkgdm\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.567824 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.567628    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgsgh\" (UniqueName: \"kubernetes.io/projected/3c1f7168-eab8-4b21-8b4c-9e223025c89f-kube-api-access-qgsgh\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:15.567824 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:15.567636    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1e9631-4521-44dd-970b-cdb6143eee52-util\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:16.103889 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.103854    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv" event={"ID":"3c1f7168-eab8-4b21-8b4c-9e223025c89f","Type":"ContainerDied","Data":"d6b05af5037bbe1bc9c2edef4d12a1d4d05ac60a7702dae725cad73045025f7a"}
Jul 07 22:05:16.104071 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.103913    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6b05af5037bbe1bc9c2edef4d12a1d4d05ac60a7702dae725cad73045025f7a"
Jul 07 22:05:16.104071 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.103861    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv"
Jul 07 22:05:16.105791 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.105753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg" event={"ID":"4f1e9631-4521-44dd-970b-cdb6143eee52","Type":"ContainerDied","Data":"68ae54f244438605b6182661a4ae06740b167fc63d821fe69c6d141272e0e156"}
Jul 07 22:05:16.105894 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.105798    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68ae54f244438605b6182661a4ae06740b167fc63d821fe69c6d141272e0e156"
Jul 07 22:05:16.105894 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.105769    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg"
Jul 07 22:05:16.107732 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.107713    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6"
Jul 07 22:05:16.107839 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.107708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6" event={"ID":"11035410-8054-4835-a84a-97750e736c6c","Type":"ContainerDied","Data":"b58a48117b37e4ee79789bb0780320a5ece301dfbfc84930d52fb0eb7c910e3a"}
Jul 07 22:05:16.107839 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:16.107832    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b58a48117b37e4ee79789bb0780320a5ece301dfbfc84930d52fb0eb7c910e3a"
Jul 07 22:05:26.515146 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515111    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"]
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515414    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f719e0-a780-40d7-9f45-f65543e1e148" containerName="pull"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515425    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f719e0-a780-40d7-9f45-f65543e1e148" containerName="pull"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515436    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerName="extract"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515441    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerName="extract"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515448    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f719e0-a780-40d7-9f45-f65543e1e148" containerName="util"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515454    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f719e0-a780-40d7-9f45-f65543e1e148" containerName="util"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515462    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerName="util"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515467    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerName="util"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515472    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11035410-8054-4835-a84a-97750e736c6c" containerName="extract"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515477    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="11035410-8054-4835-a84a-97750e736c6c" containerName="extract"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515483    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11035410-8054-4835-a84a-97750e736c6c" containerName="util"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515488    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="11035410-8054-4835-a84a-97750e736c6c" containerName="util"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515494    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerName="pull"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515499    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerName="pull"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515517    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f719e0-a780-40d7-9f45-f65543e1e148" containerName="extract"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515523    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f719e0-a780-40d7-9f45-f65543e1e148" containerName="extract"
Jul 07 22:05:26.515546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515550    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerName="pull"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515558    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerName="pull"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515568    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11035410-8054-4835-a84a-97750e736c6c" containerName="pull"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515573    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="11035410-8054-4835-a84a-97750e736c6c" containerName="pull"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515579    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerName="extract"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515585    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerName="extract"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515593    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerName="util"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515597    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerName="util"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515644    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97f719e0-a780-40d7-9f45-f65543e1e148" containerName="extract"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515653    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1f7168-eab8-4b21-8b4c-9e223025c89f" containerName="extract"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515658    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="11035410-8054-4835-a84a-97750e736c6c" containerName="extract"
Jul 07 22:05:26.516043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.515664    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1e9631-4521-44dd-970b-cdb6143eee52" containerName="extract"
Jul 07 22:05:26.520029 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.520012    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"
Jul 07 22:05:26.522901 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.522879    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-h8jhv\""
Jul 07 22:05:26.537273 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.537246    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"]
Jul 07 22:05:26.660641 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.660594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85fmk\" (UniqueName: \"kubernetes.io/projected/56c007dd-9adb-45b2-b6b3-c2de1e44d414-kube-api-access-85fmk\") pod \"authorino-operator-75cc8d5cb7-xgzhh\" (UID: \"56c007dd-9adb-45b2-b6b3-c2de1e44d414\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"
Jul 07 22:05:26.761984 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.761949    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85fmk\" (UniqueName: \"kubernetes.io/projected/56c007dd-9adb-45b2-b6b3-c2de1e44d414-kube-api-access-85fmk\") pod \"authorino-operator-75cc8d5cb7-xgzhh\" (UID: \"56c007dd-9adb-45b2-b6b3-c2de1e44d414\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"
Jul 07 22:05:26.772283 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.772210    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85fmk\" (UniqueName: \"kubernetes.io/projected/56c007dd-9adb-45b2-b6b3-c2de1e44d414-kube-api-access-85fmk\") pod \"authorino-operator-75cc8d5cb7-xgzhh\" (UID: \"56c007dd-9adb-45b2-b6b3-c2de1e44d414\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"
Jul 07 22:05:26.830118 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.830085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"
Jul 07 22:05:26.958739 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:26.958713    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"]
Jul 07 22:05:26.961374 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:26.961350    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c007dd_9adb_45b2_b6b3_c2de1e44d414.slice/crio-2a38553f9b880e89cc498960a2f01373c4b7a7721b2985a7b69eaa7ba1739365 WatchSource:0}: Error finding container 2a38553f9b880e89cc498960a2f01373c4b7a7721b2985a7b69eaa7ba1739365: Status 404 returned error can't find the container with id 2a38553f9b880e89cc498960a2f01373c4b7a7721b2985a7b69eaa7ba1739365
Jul 07 22:05:27.158917 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:27.158833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh" event={"ID":"56c007dd-9adb-45b2-b6b3-c2de1e44d414","Type":"ContainerStarted","Data":"2a38553f9b880e89cc498960a2f01373c4b7a7721b2985a7b69eaa7ba1739365"}
Jul 07 22:05:29.756471 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:29.756432    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"]
Jul 07 22:05:29.758750 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:29.758731    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:29.761767 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:29.761737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fkbk8\""
Jul 07 22:05:29.777679 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:29.777658    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"]
Jul 07 22:05:29.784044 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:29.784020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bld2m\" (UniqueName: \"kubernetes.io/projected/21396759-2ba1-4bf0-9d63-b59540fc30f8-kube-api-access-bld2m\") pod \"limitador-operator-controller-manager-859d7b78bd-w96dt\" (UID: \"21396759-2ba1-4bf0-9d63-b59540fc30f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:29.884511 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:29.884481    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bld2m\" (UniqueName: \"kubernetes.io/projected/21396759-2ba1-4bf0-9d63-b59540fc30f8-kube-api-access-bld2m\") pod \"limitador-operator-controller-manager-859d7b78bd-w96dt\" (UID: \"21396759-2ba1-4bf0-9d63-b59540fc30f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:29.899590 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:29.899562    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bld2m\" (UniqueName: \"kubernetes.io/projected/21396759-2ba1-4bf0-9d63-b59540fc30f8-kube-api-access-bld2m\") pod \"limitador-operator-controller-manager-859d7b78bd-w96dt\" (UID: \"21396759-2ba1-4bf0-9d63-b59540fc30f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:30.068316 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:30.068228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:30.177264 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:30.177232    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh" event={"ID":"56c007dd-9adb-45b2-b6b3-c2de1e44d414","Type":"ContainerStarted","Data":"7d9463ac0fe86208de7a3361a96a50e6e15a1e3fd452d34760d78de1c0544f6a"}
Jul 07 22:05:30.177437 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:30.177333    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"
Jul 07 22:05:30.203203 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:30.203155    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh" podStartSLOduration=1.899004049 podStartE2EDuration="4.203139585s" totalImagesPullingTime="2.304135536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:05:30.201985198 +0000 UTC m=+409.500204553" watchObservedRunningTime="2026-07-07 22:05:30.203139585 +0000 UTC m=+409.501358935"
Jul 07 22:05:30.208734 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:30.208711    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"]
Jul 07 22:05:30.210406 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:30.210378    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21396759_2ba1_4bf0_9d63_b59540fc30f8.slice/crio-1f4725d9f28c20fc215a6a1a3b6cc190127e6ef3b2ab185dc39debe66c0f483a WatchSource:0}: Error finding container 1f4725d9f28c20fc215a6a1a3b6cc190127e6ef3b2ab185dc39debe66c0f483a: Status 404 returned error can't find the container with id 1f4725d9f28c20fc215a6a1a3b6cc190127e6ef3b2ab185dc39debe66c0f483a
Jul 07 22:05:31.187880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:31.187836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt" event={"ID":"21396759-2ba1-4bf0-9d63-b59540fc30f8","Type":"ContainerStarted","Data":"1f4725d9f28c20fc215a6a1a3b6cc190127e6ef3b2ab185dc39debe66c0f483a"}
Jul 07 22:05:32.195482 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.195445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt" event={"ID":"21396759-2ba1-4bf0-9d63-b59540fc30f8","Type":"ContainerStarted","Data":"3282cfc1bdefcf63ec89e199eaa087c2b4156828455f6f12e6e0eb6447677666"}
Jul 07 22:05:32.195871 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.195596    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:32.218948 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.218857    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt" podStartSLOduration=1.465164492 podStartE2EDuration="3.21884167s" totalImagesPullingTime="1.753677178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:05:32.216036954 +0000 UTC m=+411.514256300" watchObservedRunningTime="2026-07-07 22:05:32.21884167 +0000 UTC m=+411.517061060"
Jul 07 22:05:32.636742 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.636709    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"]
Jul 07 22:05:32.639013 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.638993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"
Jul 07 22:05:32.642174 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.642144    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 22:05:32.642707 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.642687    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n649w\""
Jul 07 22:05:32.664892 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.664871    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"]
Jul 07 22:05:32.705364 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.705341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8kxk\" (UniqueName: \"kubernetes.io/projected/9f765ce5-19d7-4410-8c9a-17c8edb044f3-kube-api-access-b8kxk\") pod \"dns-operator-controller-manager-864dd78c4c-kh5m9\" (UID: \"9f765ce5-19d7-4410-8c9a-17c8edb044f3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"
Jul 07 22:05:32.806188 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.806154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8kxk\" (UniqueName: \"kubernetes.io/projected/9f765ce5-19d7-4410-8c9a-17c8edb044f3-kube-api-access-b8kxk\") pod \"dns-operator-controller-manager-864dd78c4c-kh5m9\" (UID: \"9f765ce5-19d7-4410-8c9a-17c8edb044f3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"
Jul 07 22:05:32.822119 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.822086    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8kxk\" (UniqueName: \"kubernetes.io/projected/9f765ce5-19d7-4410-8c9a-17c8edb044f3-kube-api-access-b8kxk\") pod \"dns-operator-controller-manager-864dd78c4c-kh5m9\" (UID: \"9f765ce5-19d7-4410-8c9a-17c8edb044f3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"
Jul 07 22:05:32.948610 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:32.948503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"
Jul 07 22:05:33.096756 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:33.096723    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"]
Jul 07 22:05:33.099172 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:33.099142    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f765ce5_19d7_4410_8c9a_17c8edb044f3.slice/crio-47008d7e545b3e54928dd404fe8035de3903aadc4bd1eccd3f1b965340188672 WatchSource:0}: Error finding container 47008d7e545b3e54928dd404fe8035de3903aadc4bd1eccd3f1b965340188672: Status 404 returned error can't find the container with id 47008d7e545b3e54928dd404fe8035de3903aadc4bd1eccd3f1b965340188672
Jul 07 22:05:33.202372 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:33.202263    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9" event={"ID":"9f765ce5-19d7-4410-8c9a-17c8edb044f3","Type":"ContainerStarted","Data":"47008d7e545b3e54928dd404fe8035de3903aadc4bd1eccd3f1b965340188672"}
Jul 07 22:05:36.222867 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.222832    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9" event={"ID":"9f765ce5-19d7-4410-8c9a-17c8edb044f3","Type":"ContainerStarted","Data":"6782d00075ab630f8674d171a0121a4518604f3369623116a23a585160c4b999"}
Jul 07 22:05:36.223242 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.222963    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"
Jul 07 22:05:36.257809 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.257760    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9" podStartSLOduration=2.190668166 podStartE2EDuration="4.257743254s" totalImagesPullingTime="2.067075088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:05:36.256229596 +0000 UTC m=+415.554448947" watchObservedRunningTime="2026-07-07 22:05:36.257743254 +0000 UTC m=+415.555962604"
Jul 07 22:05:36.739461 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.739429    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"]
Jul 07 22:05:36.742705 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.742690    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:36.745279 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.745256    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k5wq7\""
Jul 07 22:05:36.760844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.760822    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"]
Jul 07 22:05:36.834995 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.834952    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3766d3c5-da71-4b55-a403-2b15113af684-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:36.835173 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.834998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44rwq\" (UniqueName: \"kubernetes.io/projected/3766d3c5-da71-4b55-a403-2b15113af684-kube-api-access-44rwq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:36.936381 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.936339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3766d3c5-da71-4b55-a403-2b15113af684-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:36.936617 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.936388    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44rwq\" (UniqueName: \"kubernetes.io/projected/3766d3c5-da71-4b55-a403-2b15113af684-kube-api-access-44rwq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:36.936781 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.936757    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3766d3c5-da71-4b55-a403-2b15113af684-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:36.946506 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:36.946483    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44rwq\" (UniqueName: \"kubernetes.io/projected/3766d3c5-da71-4b55-a403-2b15113af684-kube-api-access-44rwq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:37.052890 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:37.052858    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:37.194187 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:37.194159    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"]
Jul 07 22:05:37.194818 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:37.194780    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3766d3c5_da71_4b55_a403_2b15113af684.slice/crio-c8af781cdd8013458c7fd1d59ef6021040e09a057df54c603f9503d2d528035c WatchSource:0}: Error finding container c8af781cdd8013458c7fd1d59ef6021040e09a057df54c603f9503d2d528035c: Status 404 returned error can't find the container with id c8af781cdd8013458c7fd1d59ef6021040e09a057df54c603f9503d2d528035c
Jul 07 22:05:37.230417 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:37.230383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57" event={"ID":"3766d3c5-da71-4b55-a403-2b15113af684","Type":"ContainerStarted","Data":"c8af781cdd8013458c7fd1d59ef6021040e09a057df54c603f9503d2d528035c"}
Jul 07 22:05:41.190386 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:41.190353    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgzhh"
Jul 07 22:05:43.205104 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:43.205076    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:43.266525 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:43.266490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57" event={"ID":"3766d3c5-da71-4b55-a403-2b15113af684","Type":"ContainerStarted","Data":"b68df6611ba64b455bbc203737a0f5281a10a1debe33946bedd73ad038cc9993"}
Jul 07 22:05:43.266725 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:43.266579    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:43.287582 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:43.287499    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57" podStartSLOduration=1.367908158 podStartE2EDuration="7.287483685s" totalImagesPullingTime="5.919575527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:05:43.285517661 +0000 UTC m=+422.583737023" watchObservedRunningTime="2026-07-07 22:05:43.287483685 +0000 UTC m=+422.585703036"
Jul 07 22:05:45.926903 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:45.926867    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"]
Jul 07 22:05:45.930476 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:45.930459    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:45.933663 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:45.933639    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 22:05:45.933663 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:45.933636    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tb8gm\""
Jul 07 22:05:45.933841 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:45.933676    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 22:05:45.944304 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:45.944281    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"]
Jul 07 22:05:46.018077 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.018044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ztq\" (UniqueName: \"kubernetes.io/projected/edbc7aa2-af11-4860-bc1f-04a53469b1f7-kube-api-access-q6ztq\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.018264 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.018123    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbc7aa2-af11-4860-bc1f-04a53469b1f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.018264 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.018162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/edbc7aa2-af11-4860-bc1f-04a53469b1f7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.118895 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.118855    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbc7aa2-af11-4860-bc1f-04a53469b1f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.119086 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.118904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/edbc7aa2-af11-4860-bc1f-04a53469b1f7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.119086 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.118965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ztq\" (UniqueName: \"kubernetes.io/projected/edbc7aa2-af11-4860-bc1f-04a53469b1f7-kube-api-access-q6ztq\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.119086 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:46.119010    2567 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 07 22:05:46.119086 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:46.119077    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edbc7aa2-af11-4860-bc1f-04a53469b1f7-plugin-serving-cert podName:edbc7aa2-af11-4860-bc1f-04a53469b1f7 nodeName:}" failed. No retries permitted until 2026-07-07 22:05:46.619060118 +0000 UTC m=+425.917279446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/edbc7aa2-af11-4860-bc1f-04a53469b1f7-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-k79pj" (UID: "edbc7aa2-af11-4860-bc1f-04a53469b1f7") : secret "plugin-serving-cert" not found
Jul 07 22:05:46.119606 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.119586    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/edbc7aa2-af11-4860-bc1f-04a53469b1f7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.129244 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.129223    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ztq\" (UniqueName: \"kubernetes.io/projected/edbc7aa2-af11-4860-bc1f-04a53469b1f7-kube-api-access-q6ztq\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.623332 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.623293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbc7aa2-af11-4860-bc1f-04a53469b1f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.625984 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.625955    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/edbc7aa2-af11-4860-bc1f-04a53469b1f7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k79pj\" (UID: \"edbc7aa2-af11-4860-bc1f-04a53469b1f7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.839577 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.839516    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"
Jul 07 22:05:46.971416 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:46.971389    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj"]
Jul 07 22:05:46.972468 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:46.972437    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedbc7aa2_af11_4860_bc1f_04a53469b1f7.slice/crio-df6a235b43e610e32ab6bc18dbcc324bfa1169b5e879f1524ce3361d39109191 WatchSource:0}: Error finding container df6a235b43e610e32ab6bc18dbcc324bfa1169b5e879f1524ce3361d39109191: Status 404 returned error can't find the container with id df6a235b43e610e32ab6bc18dbcc324bfa1169b5e879f1524ce3361d39109191
Jul 07 22:05:47.233652 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:47.233570    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kh5m9"
Jul 07 22:05:47.288342 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:47.288304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj" event={"ID":"edbc7aa2-af11-4860-bc1f-04a53469b1f7","Type":"ContainerStarted","Data":"df6a235b43e610e32ab6bc18dbcc324bfa1169b5e879f1524ce3361d39109191"}
Jul 07 22:05:54.274384 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:54.274346    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:55.500048 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.500016    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"]
Jul 07 22:05:55.503695 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.503669    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.519236 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.519210    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"]
Jul 07 22:05:55.602665 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.602629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gmvm\" (UniqueName: \"kubernetes.io/projected/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-kube-api-access-8gmvm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.602839 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.602668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.703288 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.703236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gmvm\" (UniqueName: \"kubernetes.io/projected/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-kube-api-access-8gmvm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.703288 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.703289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.703663 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.703646    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.714970 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.714949    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gmvm\" (UniqueName: \"kubernetes.io/projected/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-kube-api-access-8gmvm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.816282 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.816251    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:55.961896 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:55.961864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"]
Jul 07 22:05:55.965241 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:05:55.965200    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3367a1dc_62d6_48cd_acc5_0edfe9f631d9.slice/crio-a6962b9b1dc2316bcf6ee6dee537d13618997d45db219b3d64e403e6de5f0db8 WatchSource:0}: Error finding container a6962b9b1dc2316bcf6ee6dee537d13618997d45db219b3d64e403e6de5f0db8: Status 404 returned error can't find the container with id a6962b9b1dc2316bcf6ee6dee537d13618997d45db219b3d64e403e6de5f0db8
Jul 07 22:05:56.168246 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.168163    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"]
Jul 07 22:05:56.175787 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.175761    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"]
Jul 07 22:05:56.187593 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.187568    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"]
Jul 07 22:05:56.187751 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.187733    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57" podUID="3766d3c5-da71-4b55-a403-2b15113af684" containerName="manager" containerID="cri-o://b68df6611ba64b455bbc203737a0f5281a10a1debe33946bedd73ad038cc9993" gracePeriod=2
Jul 07 22:05:56.194663 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.194634    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"]
Jul 07 22:05:56.195011 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.194996    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" containerName="manager"
Jul 07 22:05:56.195011 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.195011    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" containerName="manager"
Jul 07 22:05:56.195146 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.195079    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" containerName="manager"
Jul 07 22:05:56.198974 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.198946    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"]
Jul 07 22:05:56.199082 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.199016    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.207080 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.207046    2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3766d3c5-da71-4b55-a403-2b15113af684\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-8cf57\": pods \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:56.209306 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.209276    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3766d3c5-da71-4b55-a403-2b15113af684" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:56.216466 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.216437    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"]
Jul 07 22:05:56.216722 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.216697    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" containerName="manager" containerID="cri-o://3282cfc1bdefcf63ec89e199eaa087c2b4156828455f6f12e6e0eb6447677666" gracePeriod=2
Jul 07 22:05:56.218685 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.218663    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"]
Jul 07 22:05:56.220595 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.219167    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3766d3c5-da71-4b55-a403-2b15113af684" containerName="manager"
Jul 07 22:05:56.220595 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.219187    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3766d3c5-da71-4b55-a403-2b15113af684" containerName="manager"
Jul 07 22:05:56.220595 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.219296    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3766d3c5-da71-4b55-a403-2b15113af684" containerName="manager"
Jul 07 22:05:56.222746 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.222726    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"]
Jul 07 22:05:56.222840 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.222809    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:56.229851 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.229823    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"]
Jul 07 22:05:56.244812 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.244557    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"]
Jul 07 22:05:56.245702 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.245673    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w96dt\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:56.247760 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.247735    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3766d3c5-da71-4b55-a403-2b15113af684" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:56.308513 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.308476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6074d43d-519a-47a7-bb90-eb22043a4362-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zm69\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.308675 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.308552    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6f5\" (UniqueName: \"kubernetes.io/projected/6074d43d-519a-47a7-bb90-eb22043a4362-kube-api-access-gj6f5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zm69\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.308675 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.308597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjq4q\" (UniqueName: \"kubernetes.io/projected/6d52a629-90a3-42d4-80e0-6c364d8d5901-kube-api-access-hjq4q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mqf6\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:56.308675 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.308640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d52a629-90a3-42d4-80e0-6c364d8d5901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mqf6\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:56.346631 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.346585    2567 generic.go:356] "Generic (PLEG): container finished" podID="21396759-2ba1-4bf0-9d63-b59540fc30f8" containerID="3282cfc1bdefcf63ec89e199eaa087c2b4156828455f6f12e6e0eb6447677666" exitCode=0
Jul 07 22:05:56.350209 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.350168    2567 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv" container="manager"
Jul 07 22:05:56.352573 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.352498    2567 generic.go:356] "Generic (PLEG): container finished" podID="3766d3c5-da71-4b55-a403-2b15113af684" containerID="b68df6611ba64b455bbc203737a0f5281a10a1debe33946bedd73ad038cc9993" exitCode=0
Jul 07 22:05:56.352881 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.352843    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:56.356484 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.356454    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w96dt\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:56.358713 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.358689    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3766d3c5-da71-4b55-a403-2b15113af684" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:56.409256 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.409219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6074d43d-519a-47a7-bb90-eb22043a4362-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zm69\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.409414 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.409272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6f5\" (UniqueName: \"kubernetes.io/projected/6074d43d-519a-47a7-bb90-eb22043a4362-kube-api-access-gj6f5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zm69\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.409414 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.409302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjq4q\" (UniqueName: \"kubernetes.io/projected/6d52a629-90a3-42d4-80e0-6c364d8d5901-kube-api-access-hjq4q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mqf6\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:56.409414 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.409329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d52a629-90a3-42d4-80e0-6c364d8d5901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mqf6\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:56.409874 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.409667    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6074d43d-519a-47a7-bb90-eb22043a4362-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zm69\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.409874 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.409762    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d52a629-90a3-42d4-80e0-6c364d8d5901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mqf6\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:56.419798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.419720    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjq4q\" (UniqueName: \"kubernetes.io/projected/6d52a629-90a3-42d4-80e0-6c364d8d5901-kube-api-access-hjq4q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mqf6\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:56.420077 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.420046    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6f5\" (UniqueName: \"kubernetes.io/projected/6074d43d-519a-47a7-bb90-eb22043a4362-kube-api-access-gj6f5\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7zm69\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.471687 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.471660    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:56.474425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.474392    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:56.474425 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.474403    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w96dt\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:56.476627 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.476596    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3766d3c5-da71-4b55-a403-2b15113af684" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:56.479118 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.479092    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:56.481180 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.481155    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w96dt\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:56.483076 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.483036    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8cf57\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3766d3c5-da71-4b55-a403-2b15113af684" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:05:56.485002 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:05:56.484982    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:05:56.510295 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.510267    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44rwq\" (UniqueName: \"kubernetes.io/projected/3766d3c5-da71-4b55-a403-2b15113af684-kube-api-access-44rwq\") pod \"3766d3c5-da71-4b55-a403-2b15113af684\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") "
Jul 07 22:05:56.510770 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.510318    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3766d3c5-da71-4b55-a403-2b15113af684-extensions-socket-volume\") pod \"3766d3c5-da71-4b55-a403-2b15113af684\" (UID: \"3766d3c5-da71-4b55-a403-2b15113af684\") "
Jul 07 22:05:56.510770 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.510362    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bld2m\" (UniqueName: \"kubernetes.io/projected/21396759-2ba1-4bf0-9d63-b59540fc30f8-kube-api-access-bld2m\") pod \"21396759-2ba1-4bf0-9d63-b59540fc30f8\" (UID: \"21396759-2ba1-4bf0-9d63-b59540fc30f8\") "
Jul 07 22:05:56.510960 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.510933    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3766d3c5-da71-4b55-a403-2b15113af684-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3766d3c5-da71-4b55-a403-2b15113af684" (UID: "3766d3c5-da71-4b55-a403-2b15113af684"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:05:56.512638 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.512597    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3766d3c5-da71-4b55-a403-2b15113af684-kube-api-access-44rwq" (OuterVolumeSpecName: "kube-api-access-44rwq") pod "3766d3c5-da71-4b55-a403-2b15113af684" (UID: "3766d3c5-da71-4b55-a403-2b15113af684"). InnerVolumeSpecName "kube-api-access-44rwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:05:56.512755 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.512701    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21396759-2ba1-4bf0-9d63-b59540fc30f8-kube-api-access-bld2m" (OuterVolumeSpecName: "kube-api-access-bld2m") pod "21396759-2ba1-4bf0-9d63-b59540fc30f8" (UID: "21396759-2ba1-4bf0-9d63-b59540fc30f8"). InnerVolumeSpecName "kube-api-access-bld2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:05:56.611340 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.611300    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44rwq\" (UniqueName: \"kubernetes.io/projected/3766d3c5-da71-4b55-a403-2b15113af684-kube-api-access-44rwq\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:56.611340 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.611336    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3766d3c5-da71-4b55-a403-2b15113af684-extensions-socket-volume\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:56.611575 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.611353    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bld2m\" (UniqueName: \"kubernetes.io/projected/21396759-2ba1-4bf0-9d63-b59540fc30f8-kube-api-access-bld2m\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:05:56.616578 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.616512    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:05:56.623562 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:56.623522    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:05:57.252837 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:57.252804    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" path="/var/lib/kubelet/pods/21396759-2ba1-4bf0-9d63-b59540fc30f8/volumes"
Jul 07 22:05:57.253224 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:57.253203    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3766d3c5-da71-4b55-a403-2b15113af684" path="/var/lib/kubelet/pods/3766d3c5-da71-4b55-a403-2b15113af684/volumes"
Jul 07 22:05:57.360489 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:57.360462    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w96dt"
Jul 07 22:05:57.360677 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:57.360473    2567 scope.go:117] "RemoveContainer" containerID="3282cfc1bdefcf63ec89e199eaa087c2b4156828455f6f12e6e0eb6447677666"
Jul 07 22:05:57.362769 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:57.362741    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" containerName="manager" containerID="cri-o://90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3" gracePeriod=2
Jul 07 22:05:57.364747 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:05:57.364725    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8cf57"
Jul 07 22:06:10.729769 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:10.729664    2567 scope.go:117] "RemoveContainer" containerID="b68df6611ba64b455bbc203737a0f5281a10a1debe33946bedd73ad038cc9993"
Jul 07 22:06:10.884320 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:10.884027    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:06:10.886434 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:06:10.886397    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:06:10.919732 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:10.919707    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"]
Jul 07 22:06:10.921149 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:06:10.921125    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d52a629_90a3_42d4_80e0_6c364d8d5901.slice/crio-834c8222dd7781e3a49a704611495ed338b2905d4f81a2844b46ddaea3384cc8 WatchSource:0}: Error finding container 834c8222dd7781e3a49a704611495ed338b2905d4f81a2844b46ddaea3384cc8: Status 404 returned error can't find the container with id 834c8222dd7781e3a49a704611495ed338b2905d4f81a2844b46ddaea3384cc8
Jul 07 22:06:10.938874 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:10.938851    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"]
Jul 07 22:06:10.940746 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:06:10.940724    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6074d43d_519a_47a7_bb90_eb22043a4362.slice/crio-44d56b3c6281eb305b0642ff7e24b95e1fb4c38788dd26697500b051f632e9da WatchSource:0}: Error finding container 44d56b3c6281eb305b0642ff7e24b95e1fb4c38788dd26697500b051f632e9da: Status 404 returned error can't find the container with id 44d56b3c6281eb305b0642ff7e24b95e1fb4c38788dd26697500b051f632e9da
Jul 07 22:06:11.042650 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.042617    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gmvm\" (UniqueName: \"kubernetes.io/projected/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-kube-api-access-8gmvm\") pod \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") "
Jul 07 22:06:11.042813 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.042681    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-extensions-socket-volume\") pod \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\" (UID: \"3367a1dc-62d6-48cd-acc5-0edfe9f631d9\") "
Jul 07 22:06:11.042890 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.042866    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3367a1dc-62d6-48cd-acc5-0edfe9f631d9" (UID: "3367a1dc-62d6-48cd-acc5-0edfe9f631d9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:06:11.042982 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.042962    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-extensions-socket-volume\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:06:11.044868 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.044849    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-kube-api-access-8gmvm" (OuterVolumeSpecName: "kube-api-access-8gmvm") pod "3367a1dc-62d6-48cd-acc5-0edfe9f631d9" (UID: "3367a1dc-62d6-48cd-acc5-0edfe9f631d9"). InnerVolumeSpecName "kube-api-access-8gmvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:06:11.143393 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.143358    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gmvm\" (UniqueName: \"kubernetes.io/projected/3367a1dc-62d6-48cd-acc5-0edfe9f631d9-kube-api-access-8gmvm\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:06:11.249584 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:06:11.249463    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:06:11.251212 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.251186    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" path="/var/lib/kubelet/pods/3367a1dc-62d6-48cd-acc5-0edfe9f631d9/volumes"
Jul 07 22:06:11.447371 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.447340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6" event={"ID":"6d52a629-90a3-42d4-80e0-6c364d8d5901","Type":"ContainerStarted","Data":"f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d"}
Jul 07 22:06:11.447603 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.447391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6" event={"ID":"6d52a629-90a3-42d4-80e0-6c364d8d5901","Type":"ContainerStarted","Data":"834c8222dd7781e3a49a704611495ed338b2905d4f81a2844b46ddaea3384cc8"}
Jul 07 22:06:11.447603 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.447484    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:06:11.448850 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.448828    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj" event={"ID":"edbc7aa2-af11-4860-bc1f-04a53469b1f7","Type":"ContainerStarted","Data":"89d337212da105634adeadff405ca62b8c8769e1352e9121f83fa8390d5a0051"}
Jul 07 22:06:11.450946 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.450921    2567 generic.go:356] "Generic (PLEG): container finished" podID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" containerID="90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3" exitCode=2
Jul 07 22:06:11.451020 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.450949    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:06:11.451085 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.451018    2567 scope.go:117] "RemoveContainer" containerID="90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3"
Jul 07 22:06:11.453954 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.453935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69" event={"ID":"6074d43d-519a-47a7-bb90-eb22043a4362","Type":"ContainerStarted","Data":"db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c"}
Jul 07 22:06:11.454046 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.453974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69" event={"ID":"6074d43d-519a-47a7-bb90-eb22043a4362","Type":"ContainerStarted","Data":"44d56b3c6281eb305b0642ff7e24b95e1fb4c38788dd26697500b051f632e9da"}
Jul 07 22:06:11.454046 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.453996    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:06:11.459908 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.459892    2567 scope.go:117] "RemoveContainer" containerID="90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3"
Jul 07 22:06:11.460157 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:06:11.460133    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3\": container with ID starting with 90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3 not found: ID does not exist" containerID="90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3"
Jul 07 22:06:11.460211 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.460157    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3"} err="failed to get container status \"90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3\": rpc error: code = NotFound desc = could not find container \"90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3\": container with ID starting with 90f7211e5ec80e0bc5cdbd464066be15237138d93dfdc8ad3eb07c3498e9dae3 not found: ID does not exist"
Jul 07 22:06:11.469904 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:06:11.469874    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4p2hv\" is forbidden: User \"system:node:ip-10-0-128-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-35.ec2.internal' and this object" podUID="3367a1dc-62d6-48cd-acc5-0edfe9f631d9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4p2hv"
Jul 07 22:06:11.470162 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.470121    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6" podStartSLOduration=15.470090035 podStartE2EDuration="15.470090035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:11.467646391 +0000 UTC m=+450.765865742" watchObservedRunningTime="2026-07-07 22:06:11.470090035 +0000 UTC m=+450.768309387"
Jul 07 22:06:11.494779 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.494737    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k79pj" podStartSLOduration=2.67400342 podStartE2EDuration="26.494724354s" totalImagesPullingTime="23.820720934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:11.492186987 +0000 UTC m=+450.790406339" watchObservedRunningTime="2026-07-07 22:06:11.494724354 +0000 UTC m=+450.792943705"
Jul 07 22:06:11.517554 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:11.517493    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69" podStartSLOduration=15.517477258 podStartE2EDuration="15.517477258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:11.514375507 +0000 UTC m=+450.812594895" watchObservedRunningTime="2026-07-07 22:06:11.517477258 +0000 UTC m=+450.815696610"
Jul 07 22:06:22.462266 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.462234    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:06:22.462845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.462312    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:06:22.539599 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.539568    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"]
Jul 07 22:06:22.539814 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.539788    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6" podUID="6d52a629-90a3-42d4-80e0-6c364d8d5901" containerName="manager" containerID="cri-o://f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d" gracePeriod=10
Jul 07 22:06:22.774563 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.773953    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"]
Jul 07 22:06:22.774563 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.774473    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" containerName="manager"
Jul 07 22:06:22.774563 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.774488    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" containerName="manager"
Jul 07 22:06:22.774809 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.774584    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="21396759-2ba1-4bf0-9d63-b59540fc30f8" containerName="manager"
Jul 07 22:06:22.778557 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.776919    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:22.789267 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.789227    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"]
Jul 07 22:06:22.810844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.810818    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:06:22.943812 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.943784    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjq4q\" (UniqueName: \"kubernetes.io/projected/6d52a629-90a3-42d4-80e0-6c364d8d5901-kube-api-access-hjq4q\") pod \"6d52a629-90a3-42d4-80e0-6c364d8d5901\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") "
Jul 07 22:06:22.943997 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.943886    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d52a629-90a3-42d4-80e0-6c364d8d5901-extensions-socket-volume\") pod \"6d52a629-90a3-42d4-80e0-6c364d8d5901\" (UID: \"6d52a629-90a3-42d4-80e0-6c364d8d5901\") "
Jul 07 22:06:22.943997 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.943972    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v874z\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:22.944093 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.944020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpfgx\" (UniqueName: \"kubernetes.io/projected/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-kube-api-access-mpfgx\") pod \"kuadrant-operator-controller-manager-86878c769f-v874z\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:22.944272 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.944244    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52a629-90a3-42d4-80e0-6c364d8d5901-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d52a629-90a3-42d4-80e0-6c364d8d5901" (UID: "6d52a629-90a3-42d4-80e0-6c364d8d5901"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:06:22.946052 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:22.946024    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d52a629-90a3-42d4-80e0-6c364d8d5901-kube-api-access-hjq4q" (OuterVolumeSpecName: "kube-api-access-hjq4q") pod "6d52a629-90a3-42d4-80e0-6c364d8d5901" (UID: "6d52a629-90a3-42d4-80e0-6c364d8d5901"). InnerVolumeSpecName "kube-api-access-hjq4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:06:23.044589 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.044474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpfgx\" (UniqueName: \"kubernetes.io/projected/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-kube-api-access-mpfgx\") pod \"kuadrant-operator-controller-manager-86878c769f-v874z\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:23.044757 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.044633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v874z\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:23.044757 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.044675    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d52a629-90a3-42d4-80e0-6c364d8d5901-extensions-socket-volume\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:06:23.044757 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.044689    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjq4q\" (UniqueName: \"kubernetes.io/projected/6d52a629-90a3-42d4-80e0-6c364d8d5901-kube-api-access-hjq4q\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:06:23.044989 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.044968    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v874z\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:23.067307 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.067278    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpfgx\" (UniqueName: \"kubernetes.io/projected/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-kube-api-access-mpfgx\") pod \"kuadrant-operator-controller-manager-86878c769f-v874z\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:23.106201 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.106165    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:23.240742 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.240713    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"]
Jul 07 22:06:23.243621 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:06:23.243592    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8bbd34_8469_4ca5_b009_21b2d1c9a850.slice/crio-05dfc6ed91c6a1a9665de768eaff9c86e8db16a4467b4e503cfd8f8a79477698 WatchSource:0}: Error finding container 05dfc6ed91c6a1a9665de768eaff9c86e8db16a4467b4e503cfd8f8a79477698: Status 404 returned error can't find the container with id 05dfc6ed91c6a1a9665de768eaff9c86e8db16a4467b4e503cfd8f8a79477698
Jul 07 22:06:23.523972 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.523932    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z" event={"ID":"6f8bbd34-8469-4ca5-b009-21b2d1c9a850","Type":"ContainerStarted","Data":"c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4"}
Jul 07 22:06:23.524459 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.523999    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:23.524459 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.524017    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z" event={"ID":"6f8bbd34-8469-4ca5-b009-21b2d1c9a850","Type":"ContainerStarted","Data":"05dfc6ed91c6a1a9665de768eaff9c86e8db16a4467b4e503cfd8f8a79477698"}
Jul 07 22:06:23.525370 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.525348    2567 generic.go:356] "Generic (PLEG): container finished" podID="6d52a629-90a3-42d4-80e0-6c364d8d5901" containerID="f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d" exitCode=0
Jul 07 22:06:23.525428 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.525396    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"
Jul 07 22:06:23.525428 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.525400    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6" event={"ID":"6d52a629-90a3-42d4-80e0-6c364d8d5901","Type":"ContainerDied","Data":"f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d"}
Jul 07 22:06:23.525501 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.525450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6" event={"ID":"6d52a629-90a3-42d4-80e0-6c364d8d5901","Type":"ContainerDied","Data":"834c8222dd7781e3a49a704611495ed338b2905d4f81a2844b46ddaea3384cc8"}
Jul 07 22:06:23.525501 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.525472    2567 scope.go:117] "RemoveContainer" containerID="f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d"
Jul 07 22:06:23.535236 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.535214    2567 scope.go:117] "RemoveContainer" containerID="f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d"
Jul 07 22:06:23.535576 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:06:23.535553    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d\": container with ID starting with f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d not found: ID does not exist" containerID="f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d"
Jul 07 22:06:23.535651 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.535587    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d"} err="failed to get container status \"f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d\": rpc error: code = NotFound desc = could not find container \"f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d\": container with ID starting with f5dfdd7097eff53eea91cbd2cd3f1f0465b2af085383c4d09a444ce0cf32362d not found: ID does not exist"
Jul 07 22:06:23.546178 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.546036    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z" podStartSLOduration=1.546019969 podStartE2EDuration="1.546019969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:06:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:23.544254057 +0000 UTC m=+462.842473409" watchObservedRunningTime="2026-07-07 22:06:23.546019969 +0000 UTC m=+462.844239319"
Jul 07 22:06:23.561350 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.561327    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"]
Jul 07 22:06:23.565883 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:23.565862    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mqf6"]
Jul 07 22:06:25.250825 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:25.250793    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d52a629-90a3-42d4-80e0-6c364d8d5901" path="/var/lib/kubelet/pods/6d52a629-90a3-42d4-80e0-6c364d8d5901/volumes"
Jul 07 22:06:34.534867 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:34.534834    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:06:34.593112 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:34.593073    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"]
Jul 07 22:06:34.593299 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:34.593268    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69" podUID="6074d43d-519a-47a7-bb90-eb22043a4362" containerName="manager" containerID="cri-o://db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c" gracePeriod=10
Jul 07 22:06:35.401686 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.401660    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:06:35.447947 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.447915    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6074d43d-519a-47a7-bb90-eb22043a4362-extensions-socket-volume\") pod \"6074d43d-519a-47a7-bb90-eb22043a4362\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") "
Jul 07 22:06:35.448104 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.447965    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj6f5\" (UniqueName: \"kubernetes.io/projected/6074d43d-519a-47a7-bb90-eb22043a4362-kube-api-access-gj6f5\") pod \"6074d43d-519a-47a7-bb90-eb22043a4362\" (UID: \"6074d43d-519a-47a7-bb90-eb22043a4362\") "
Jul 07 22:06:35.448259 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.448237    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6074d43d-519a-47a7-bb90-eb22043a4362-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6074d43d-519a-47a7-bb90-eb22043a4362" (UID: "6074d43d-519a-47a7-bb90-eb22043a4362"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:06:35.450185 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.450155    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6074d43d-519a-47a7-bb90-eb22043a4362-kube-api-access-gj6f5" (OuterVolumeSpecName: "kube-api-access-gj6f5") pod "6074d43d-519a-47a7-bb90-eb22043a4362" (UID: "6074d43d-519a-47a7-bb90-eb22043a4362"). InnerVolumeSpecName "kube-api-access-gj6f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:06:35.549094 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.549064    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6074d43d-519a-47a7-bb90-eb22043a4362-extensions-socket-volume\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:06:35.549094 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.549091    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj6f5\" (UniqueName: \"kubernetes.io/projected/6074d43d-519a-47a7-bb90-eb22043a4362-kube-api-access-gj6f5\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:06:35.598719 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.598677    2567 generic.go:356] "Generic (PLEG): container finished" podID="6074d43d-519a-47a7-bb90-eb22043a4362" containerID="db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c" exitCode=0
Jul 07 22:06:35.598719 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.598719    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"
Jul 07 22:06:35.598913 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.598776    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69" event={"ID":"6074d43d-519a-47a7-bb90-eb22043a4362","Type":"ContainerDied","Data":"db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c"}
Jul 07 22:06:35.598913 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.598830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69" event={"ID":"6074d43d-519a-47a7-bb90-eb22043a4362","Type":"ContainerDied","Data":"44d56b3c6281eb305b0642ff7e24b95e1fb4c38788dd26697500b051f632e9da"}
Jul 07 22:06:35.598913 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.598856    2567 scope.go:117] "RemoveContainer" containerID="db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c"
Jul 07 22:06:35.613102 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.613073    2567 scope.go:117] "RemoveContainer" containerID="db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c"
Jul 07 22:06:35.613860 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:06:35.613704    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c\": container with ID starting with db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c not found: ID does not exist" containerID="db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c"
Jul 07 22:06:35.613957 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.613869    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c"} err="failed to get container status \"db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c\": rpc error: code = NotFound desc = could not find container \"db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c\": container with ID starting with db60a1fe6741b4b07f5c26f378df4b87a4665646ef3be864bf9d245acf5b794c not found: ID does not exist"
Jul 07 22:06:35.625825 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.625790    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"]
Jul 07 22:06:35.627798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:35.627772    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7zm69"]
Jul 07 22:06:37.249785 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:37.249751    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6074d43d-519a-47a7-bb90-eb22043a4362" path="/var/lib/kubelet/pods/6074d43d-519a-47a7-bb90-eb22043a4362/volumes"
Jul 07 22:06:38.975786 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:38.975747    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"]
Jul 07 22:06:38.976313 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:38.976297    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6074d43d-519a-47a7-bb90-eb22043a4362" containerName="manager"
Jul 07 22:06:38.976359 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:38.976316    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6074d43d-519a-47a7-bb90-eb22043a4362" containerName="manager"
Jul 07 22:06:38.976359 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:38.976331    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d52a629-90a3-42d4-80e0-6c364d8d5901" containerName="manager"
Jul 07 22:06:38.976359 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:38.976339    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d52a629-90a3-42d4-80e0-6c364d8d5901" containerName="manager"
Jul 07 22:06:38.976445 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:38.976432    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6074d43d-519a-47a7-bb90-eb22043a4362" containerName="manager"
Jul 07 22:06:38.976477 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:38.976444    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d52a629-90a3-42d4-80e0-6c364d8d5901" containerName="manager"
Jul 07 22:06:39.000382 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.000354    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"]
Jul 07 22:06:39.000585 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.000489    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.003143 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.003122    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6wlp5\""
Jul 07 22:06:39.003442 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.003424    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 22:06:39.075637 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075603    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.075842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.075842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.075842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075751    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.075842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.075842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075841    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h495v\" (UniqueName: \"kubernetes.io/projected/2b6ca15d-7931-47d0-aabe-8e497235dcc9-kube-api-access-h495v\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.076042 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075896    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.076042 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075921    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.076042 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.075940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177329 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177488 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177488 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177488 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177488 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177455    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177488 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177814 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h495v\" (UniqueName: \"kubernetes.io/projected/2b6ca15d-7931-47d0-aabe-8e497235dcc9-kube-api-access-h495v\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177814 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177814 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177983 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177808    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.177983 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177828    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.178082 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.177985    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.178082 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.178044    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.178319 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.178265    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.180106 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.180082    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.180218 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.180201    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.186922 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.186897    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b6ca15d-7931-47d0-aabe-8e497235dcc9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.187040 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.186936    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h495v\" (UniqueName: \"kubernetes.io/projected/2b6ca15d-7931-47d0-aabe-8e497235dcc9-kube-api-access-h495v\") pod \"maas-default-gateway-openshift-default-56654dcf7-48d5r\" (UID: \"2b6ca15d-7931-47d0-aabe-8e497235dcc9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.312821 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.312787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:39.455525 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.455490    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"]
Jul 07 22:06:39.457259 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:06:39.457224    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6ca15d_7931_47d0_aabe_8e497235dcc9.slice/crio-41493afa206edae3b5490fed66786f64b8ce494dfc1904625badbf398f1fd6bb WatchSource:0}: Error finding container 41493afa206edae3b5490fed66786f64b8ce494dfc1904625badbf398f1fd6bb: Status 404 returned error can't find the container with id 41493afa206edae3b5490fed66786f64b8ce494dfc1904625badbf398f1fd6bb
Jul 07 22:06:39.621780 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:39.621694    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" event={"ID":"2b6ca15d-7931-47d0-aabe-8e497235dcc9","Type":"ContainerStarted","Data":"41493afa206edae3b5490fed66786f64b8ce494dfc1904625badbf398f1fd6bb"}
Jul 07 22:06:42.986882 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:42.986846    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:06:42.987198 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:42.986922    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:06:42.987198 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:42.986951    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:06:43.648658 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:43.648627    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" event={"ID":"2b6ca15d-7931-47d0-aabe-8e497235dcc9","Type":"ContainerStarted","Data":"b9c8613870fc25177b6a0361b3f6ec2b7897e3cd10f29f2802f3a647ebfa2fc9"}
Jul 07 22:06:43.669506 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:43.669447    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" podStartSLOduration=2.14207896 podStartE2EDuration="5.669428609s" totalImagesPullingTime="3.527349649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:43.668569578 +0000 UTC m=+482.966788925" watchObservedRunningTime="2026-07-07 22:06:43.669428609 +0000 UTC m=+482.967647961"
Jul 07 22:06:44.313824 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:44.313790    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:44.320049 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:44.320019    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:44.654377 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:44.654292    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:44.655380 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:44.655356    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:06:52.298422 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.298389    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"]
Jul 07 22:06:52.302012 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.301993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.304614 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.304594    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 22:06:52.313330 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.313308    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"]
Jul 07 22:06:52.396901 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.396872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-config-file\") pod \"limitador-limitador-64c94fd64f-xlpm4\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.397090 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.396965    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4ld\" (UniqueName: \"kubernetes.io/projected/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-kube-api-access-nl4ld\") pod \"limitador-limitador-64c94fd64f-xlpm4\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.397245 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.397223    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"]
Jul 07 22:06:52.497987 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.497957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4ld\" (UniqueName: \"kubernetes.io/projected/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-kube-api-access-nl4ld\") pod \"limitador-limitador-64c94fd64f-xlpm4\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.498160 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.498002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-config-file\") pod \"limitador-limitador-64c94fd64f-xlpm4\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.498675 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.498654    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-config-file\") pod \"limitador-limitador-64c94fd64f-xlpm4\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.506649 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.506610    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4ld\" (UniqueName: \"kubernetes.io/projected/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-kube-api-access-nl4ld\") pod \"limitador-limitador-64c94fd64f-xlpm4\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.612178 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.612101    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:52.752061 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:52.752031    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"]
Jul 07 22:06:52.753408 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:06:52.753376    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe08e89_9fce_4c5e_a7c3_ac47aecf85ab.slice/crio-26533cba8392bfb4db9dbbe0b7a201f617583170a877acb7fd8337c00a99d958 WatchSource:0}: Error finding container 26533cba8392bfb4db9dbbe0b7a201f617583170a877acb7fd8337c00a99d958: Status 404 returned error can't find the container with id 26533cba8392bfb4db9dbbe0b7a201f617583170a877acb7fd8337c00a99d958
Jul 07 22:06:53.348017 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.347978    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7w8n"]
Jul 07 22:06:53.351494 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.351471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7w8n"
Jul 07 22:06:53.354408 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.354390    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-42m78\""
Jul 07 22:06:53.362564 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.362525    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7w8n"]
Jul 07 22:06:53.406986 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.406944    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hms4k\" (UniqueName: \"kubernetes.io/projected/7536c572-4696-4496-a93b-61e73ec00687-kube-api-access-hms4k\") pod \"authorino-75d556bd77-h7w8n\" (UID: \"7536c572-4696-4496-a93b-61e73ec00687\") " pod="kuadrant-system/authorino-75d556bd77-h7w8n"
Jul 07 22:06:53.508435 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.508396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hms4k\" (UniqueName: \"kubernetes.io/projected/7536c572-4696-4496-a93b-61e73ec00687-kube-api-access-hms4k\") pod \"authorino-75d556bd77-h7w8n\" (UID: \"7536c572-4696-4496-a93b-61e73ec00687\") " pod="kuadrant-system/authorino-75d556bd77-h7w8n"
Jul 07 22:06:53.518847 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.518817    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hms4k\" (UniqueName: \"kubernetes.io/projected/7536c572-4696-4496-a93b-61e73ec00687-kube-api-access-hms4k\") pod \"authorino-75d556bd77-h7w8n\" (UID: \"7536c572-4696-4496-a93b-61e73ec00687\") " pod="kuadrant-system/authorino-75d556bd77-h7w8n"
Jul 07 22:06:53.661338 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.661236    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7w8n"
Jul 07 22:06:53.706981 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.706944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4" event={"ID":"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab","Type":"ContainerStarted","Data":"26533cba8392bfb4db9dbbe0b7a201f617583170a877acb7fd8337c00a99d958"}
Jul 07 22:06:53.843578 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:53.843549    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7w8n"]
Jul 07 22:06:53.845770 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:06:53.845735    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7536c572_4696_4496_a93b_61e73ec00687.slice/crio-bfcb676e0ed4bd3bdfd94c0b2c65514be76c27308f001d1b7eccf51ae2b77f96 WatchSource:0}: Error finding container bfcb676e0ed4bd3bdfd94c0b2c65514be76c27308f001d1b7eccf51ae2b77f96: Status 404 returned error can't find the container with id bfcb676e0ed4bd3bdfd94c0b2c65514be76c27308f001d1b7eccf51ae2b77f96
Jul 07 22:06:54.713330 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:54.713301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7w8n" event={"ID":"7536c572-4696-4496-a93b-61e73ec00687","Type":"ContainerStarted","Data":"bfcb676e0ed4bd3bdfd94c0b2c65514be76c27308f001d1b7eccf51ae2b77f96"}
Jul 07 22:06:56.732814 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:56.732777    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4" event={"ID":"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab","Type":"ContainerStarted","Data":"09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717"}
Jul 07 22:06:56.733287 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:56.733033    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:06:56.754303 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:56.754243    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4" podStartSLOduration=1.844819557 podStartE2EDuration="4.754225259s" totalImagesPullingTime="2.909405702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:56.750833023 +0000 UTC m=+496.049052411" watchObservedRunningTime="2026-07-07 22:06:56.754225259 +0000 UTC m=+496.052444610"
Jul 07 22:06:57.739489 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:57.739440    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7w8n" event={"ID":"7536c572-4696-4496-a93b-61e73ec00687","Type":"ContainerStarted","Data":"d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d"}
Jul 07 22:06:57.755954 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:06:57.755911    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-h7w8n" podStartSLOduration=1.078200403 podStartE2EDuration="4.755895337s" totalImagesPullingTime="3.677694934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:06:57.755255258 +0000 UTC m=+497.053474609" watchObservedRunningTime="2026-07-07 22:06:57.755895337 +0000 UTC m=+497.054114687"
Jul 07 22:07:07.004342 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.004304    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"]
Jul 07 22:07:07.004766 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.004495    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4" podUID="2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" containerName="limitador" containerID="cri-o://09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717" gracePeriod=30
Jul 07 22:07:07.005205 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.005172    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:07:07.560819 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.560796    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:07:07.638386 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.638305    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-config-file\") pod \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") "
Jul 07 22:07:07.638386 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.638344    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl4ld\" (UniqueName: \"kubernetes.io/projected/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-kube-api-access-nl4ld\") pod \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\" (UID: \"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab\") "
Jul 07 22:07:07.638715 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.638692    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-config-file" (OuterVolumeSpecName: "config-file") pod "2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" (UID: "2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:07:07.640520 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.640501    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-kube-api-access-nl4ld" (OuterVolumeSpecName: "kube-api-access-nl4ld") pod "2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" (UID: "2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab"). InnerVolumeSpecName "kube-api-access-nl4ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:07:07.739069 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.739034    2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-config-file\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:07.739069 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.739063    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl4ld\" (UniqueName: \"kubernetes.io/projected/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab-kube-api-access-nl4ld\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:07.792892 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.792857    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" containerID="09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717" exitCode=0
Jul 07 22:07:07.793073 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.792906    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"
Jul 07 22:07:07.793073 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.792938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4" event={"ID":"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab","Type":"ContainerDied","Data":"09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717"}
Jul 07 22:07:07.793073 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.792990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlpm4" event={"ID":"2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab","Type":"ContainerDied","Data":"26533cba8392bfb4db9dbbe0b7a201f617583170a877acb7fd8337c00a99d958"}
Jul 07 22:07:07.793073 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.793012    2567 scope.go:117] "RemoveContainer" containerID="09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717"
Jul 07 22:07:07.807389 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.807367    2567 scope.go:117] "RemoveContainer" containerID="09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717"
Jul 07 22:07:07.807686 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:07:07.807667    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717\": container with ID starting with 09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717 not found: ID does not exist" containerID="09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717"
Jul 07 22:07:07.807759 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.807695    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717"} err="failed to get container status \"09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717\": rpc error: code = NotFound desc = could not find container \"09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717\": container with ID starting with 09dbce0ee30970d0b18e64d56d56b9e014fe22d5dc18821301ad31a9f4011717 not found: ID does not exist"
Jul 07 22:07:07.820350 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.820322    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"]
Jul 07 22:07:07.825362 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:07.825339    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlpm4"]
Jul 07 22:07:09.250217 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:09.250182    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" path="/var/lib/kubelet/pods/2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab/volumes"
Jul 07 22:07:24.739346 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.739307    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptbs6"]
Jul 07 22:07:24.739826 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.739684    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" containerName="limitador"
Jul 07 22:07:24.739826 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.739697    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" containerName="limitador"
Jul 07 22:07:24.739826 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.739766    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fe08e89-9fce-4c5e-a7c3-ac47aecf85ab" containerName="limitador"
Jul 07 22:07:24.749481 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.749457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptbs6"
Jul 07 22:07:24.752753 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.752722    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptbs6"]
Jul 07 22:07:24.781107 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.781074    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x5bj\" (UniqueName: \"kubernetes.io/projected/5fdd825c-a2c7-452e-a0e3-6c6c5315fa53-kube-api-access-9x5bj\") pod \"authorino-5d4b67c446-ptbs6\" (UID: \"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53\") " pod="kuadrant-system/authorino-5d4b67c446-ptbs6"
Jul 07 22:07:24.882305 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.882276    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x5bj\" (UniqueName: \"kubernetes.io/projected/5fdd825c-a2c7-452e-a0e3-6c6c5315fa53-kube-api-access-9x5bj\") pod \"authorino-5d4b67c446-ptbs6\" (UID: \"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53\") " pod="kuadrant-system/authorino-5d4b67c446-ptbs6"
Jul 07 22:07:24.891300 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.891273    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x5bj\" (UniqueName: \"kubernetes.io/projected/5fdd825c-a2c7-452e-a0e3-6c6c5315fa53-kube-api-access-9x5bj\") pod \"authorino-5d4b67c446-ptbs6\" (UID: \"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53\") " pod="kuadrant-system/authorino-5d4b67c446-ptbs6"
Jul 07 22:07:24.927652 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.927616    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptbs6"]
Jul 07 22:07:24.927874 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.927862    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptbs6"
Jul 07 22:07:24.961993 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.961939    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-nm5b5"]
Jul 07 22:07:24.966613 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.966589    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:24.969507 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.969488    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 22:07:24.971967 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.971943    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-nm5b5"]
Jul 07 22:07:24.985469 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.984825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-tls-cert\") pod \"authorino-76877994-nm5b5\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") " pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:24.985469 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:24.984867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4kc8\" (UniqueName: \"kubernetes.io/projected/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-kube-api-access-l4kc8\") pod \"authorino-76877994-nm5b5\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") " pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:25.025075 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.024983    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-nm5b5"]
Jul 07 22:07:25.025426 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:07:25.025350    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-l4kc8 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-nm5b5" podUID="cc11c1d3-cffb-46c9-ac6a-2a6975df8be7"
Jul 07 22:07:25.081417 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.081394    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptbs6"]
Jul 07 22:07:25.083022 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:07:25.082992    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fdd825c_a2c7_452e_a0e3_6c6c5315fa53.slice/crio-87b1bc48dd40ac8f927f37c88a2835d4e2a02e9b0473e39246a5294a1f14a522 WatchSource:0}: Error finding container 87b1bc48dd40ac8f927f37c88a2835d4e2a02e9b0473e39246a5294a1f14a522: Status 404 returned error can't find the container with id 87b1bc48dd40ac8f927f37c88a2835d4e2a02e9b0473e39246a5294a1f14a522
Jul 07 22:07:25.085311 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.085287    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-tls-cert\") pod \"authorino-76877994-nm5b5\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") " pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:25.085390 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.085326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4kc8\" (UniqueName: \"kubernetes.io/projected/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-kube-api-access-l4kc8\") pod \"authorino-76877994-nm5b5\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") " pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:25.087960 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.087935    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-tls-cert\") pod \"authorino-76877994-nm5b5\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") " pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:25.093893 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.093871    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4kc8\" (UniqueName: \"kubernetes.io/projected/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-kube-api-access-l4kc8\") pod \"authorino-76877994-nm5b5\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") " pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:25.885188 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.885150    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptbs6" event={"ID":"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53","Type":"ContainerStarted","Data":"7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d"}
Jul 07 22:07:25.885188 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.885183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:25.885735 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.885175    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ptbs6" podUID="5fdd825c-a2c7-452e-a0e3-6c6c5315fa53" containerName="authorino" containerID="cri-o://7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d" gracePeriod=30
Jul 07 22:07:25.885735 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.885201    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptbs6" event={"ID":"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53","Type":"ContainerStarted","Data":"87b1bc48dd40ac8f927f37c88a2835d4e2a02e9b0473e39246a5294a1f14a522"}
Jul 07 22:07:25.892920 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.892899    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:25.901844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.901785    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ptbs6" podStartSLOduration=1.489843734 podStartE2EDuration="1.901771407s" totalImagesPullingTime="411.927673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:07:25.9001041 +0000 UTC m=+525.198323450" watchObservedRunningTime="2026-07-07 22:07:25.901771407 +0000 UTC m=+525.199990757"
Jul 07 22:07:25.992270 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.992243    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4kc8\" (UniqueName: \"kubernetes.io/projected/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-kube-api-access-l4kc8\") pod \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") "
Jul 07 22:07:25.992455 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.992341    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-tls-cert\") pod \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\" (UID: \"cc11c1d3-cffb-46c9-ac6a-2a6975df8be7\") "
Jul 07 22:07:25.994396 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.994367    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-kube-api-access-l4kc8" (OuterVolumeSpecName: "kube-api-access-l4kc8") pod "cc11c1d3-cffb-46c9-ac6a-2a6975df8be7" (UID: "cc11c1d3-cffb-46c9-ac6a-2a6975df8be7"). InnerVolumeSpecName "kube-api-access-l4kc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:07:25.994651 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:25.994416    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cc11c1d3-cffb-46c9-ac6a-2a6975df8be7" (UID: "cc11c1d3-cffb-46c9-ac6a-2a6975df8be7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:07:26.093233 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.093201    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-tls-cert\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:26.093233 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.093231    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4kc8\" (UniqueName: \"kubernetes.io/projected/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7-kube-api-access-l4kc8\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:26.140307 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.140249    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptbs6"
Jul 07 22:07:26.194039 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.194013    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x5bj\" (UniqueName: \"kubernetes.io/projected/5fdd825c-a2c7-452e-a0e3-6c6c5315fa53-kube-api-access-9x5bj\") pod \"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53\" (UID: \"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53\") "
Jul 07 22:07:26.196201 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.196169    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fdd825c-a2c7-452e-a0e3-6c6c5315fa53-kube-api-access-9x5bj" (OuterVolumeSpecName: "kube-api-access-9x5bj") pod "5fdd825c-a2c7-452e-a0e3-6c6c5315fa53" (UID: "5fdd825c-a2c7-452e-a0e3-6c6c5315fa53"). InnerVolumeSpecName "kube-api-access-9x5bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:07:26.294963 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.294925    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x5bj\" (UniqueName: \"kubernetes.io/projected/5fdd825c-a2c7-452e-a0e3-6c6c5315fa53-kube-api-access-9x5bj\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:26.892109 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.892076    2567 generic.go:356] "Generic (PLEG): container finished" podID="5fdd825c-a2c7-452e-a0e3-6c6c5315fa53" containerID="7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d" exitCode=0
Jul 07 22:07:26.892577 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.892122    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptbs6"
Jul 07 22:07:26.892577 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.892167    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptbs6" event={"ID":"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53","Type":"ContainerDied","Data":"7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d"}
Jul 07 22:07:26.892577 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.892210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptbs6" event={"ID":"5fdd825c-a2c7-452e-a0e3-6c6c5315fa53","Type":"ContainerDied","Data":"87b1bc48dd40ac8f927f37c88a2835d4e2a02e9b0473e39246a5294a1f14a522"}
Jul 07 22:07:26.892577 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.892234    2567 scope.go:117] "RemoveContainer" containerID="7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d"
Jul 07 22:07:26.892577 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.892274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nm5b5"
Jul 07 22:07:26.903335 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.903319    2567 scope.go:117] "RemoveContainer" containerID="7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d"
Jul 07 22:07:26.903611 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:07:26.903592    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d\": container with ID starting with 7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d not found: ID does not exist" containerID="7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d"
Jul 07 22:07:26.903683 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.903619    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d"} err="failed to get container status \"7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d\": rpc error: code = NotFound desc = could not find container \"7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d\": container with ID starting with 7fcc03707bbe7d3a5e5d9133b7377f7da7bc0752db8ddaf6b2f632a63af3344d not found: ID does not exist"
Jul 07 22:07:26.929791 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.929760    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-nm5b5"]
Jul 07 22:07:26.931852 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.931834    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-nm5b5"]
Jul 07 22:07:26.945026 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.944999    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptbs6"]
Jul 07 22:07:26.950865 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:26.950845    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptbs6"]
Jul 07 22:07:27.208760 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.208611    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7w8n"]
Jul 07 22:07:27.208938 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.208826    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-h7w8n" podUID="7536c572-4696-4496-a93b-61e73ec00687" containerName="authorino" containerID="cri-o://d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d" gracePeriod=30
Jul 07 22:07:27.252211 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.252182    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fdd825c-a2c7-452e-a0e3-6c6c5315fa53" path="/var/lib/kubelet/pods/5fdd825c-a2c7-452e-a0e3-6c6c5315fa53/volumes"
Jul 07 22:07:27.252527 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.252515    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc11c1d3-cffb-46c9-ac6a-2a6975df8be7" path="/var/lib/kubelet/pods/cc11c1d3-cffb-46c9-ac6a-2a6975df8be7/volumes"
Jul 07 22:07:27.466633 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.466580    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7w8n"
Jul 07 22:07:27.504330 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.504305    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hms4k\" (UniqueName: \"kubernetes.io/projected/7536c572-4696-4496-a93b-61e73ec00687-kube-api-access-hms4k\") pod \"7536c572-4696-4496-a93b-61e73ec00687\" (UID: \"7536c572-4696-4496-a93b-61e73ec00687\") "
Jul 07 22:07:27.506572 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.506513    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7536c572-4696-4496-a93b-61e73ec00687-kube-api-access-hms4k" (OuterVolumeSpecName: "kube-api-access-hms4k") pod "7536c572-4696-4496-a93b-61e73ec00687" (UID: "7536c572-4696-4496-a93b-61e73ec00687"). InnerVolumeSpecName "kube-api-access-hms4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:07:27.605309 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.605258    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hms4k\" (UniqueName: \"kubernetes.io/projected/7536c572-4696-4496-a93b-61e73ec00687-kube-api-access-hms4k\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:27.899601 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.899566    2567 generic.go:356] "Generic (PLEG): container finished" podID="7536c572-4696-4496-a93b-61e73ec00687" containerID="d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d" exitCode=0
Jul 07 22:07:27.899994 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.899619    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7w8n"
Jul 07 22:07:27.899994 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.899628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7w8n" event={"ID":"7536c572-4696-4496-a93b-61e73ec00687","Type":"ContainerDied","Data":"d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d"}
Jul 07 22:07:27.899994 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.899663    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7w8n" event={"ID":"7536c572-4696-4496-a93b-61e73ec00687","Type":"ContainerDied","Data":"bfcb676e0ed4bd3bdfd94c0b2c65514be76c27308f001d1b7eccf51ae2b77f96"}
Jul 07 22:07:27.899994 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.899680    2567 scope.go:117] "RemoveContainer" containerID="d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d"
Jul 07 22:07:27.908939 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.908921    2567 scope.go:117] "RemoveContainer" containerID="d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d"
Jul 07 22:07:27.909190 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:07:27.909171    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d\": container with ID starting with d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d not found: ID does not exist" containerID="d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d"
Jul 07 22:07:27.909257 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.909202    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d"} err="failed to get container status \"d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d\": rpc error: code = NotFound desc = could not find container \"d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d\": container with ID starting with d6bb9bb925576f5f2a88b6175e57c0bb73bce27a4dce522313d65141beaa5b4d not found: ID does not exist"
Jul 07 22:07:27.925029 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.925003    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7w8n"]
Jul 07 22:07:27.938213 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:27.938191    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7w8n"]
Jul 07 22:07:29.252714 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:29.251120    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7536c572-4696-4496-a93b-61e73ec00687" path="/var/lib/kubelet/pods/7536c572-4696-4496-a93b-61e73ec00687/volumes"
Jul 07 22:07:31.743169 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.743135    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-mp2l5"]
Jul 07 22:07:31.743709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.743494    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7536c572-4696-4496-a93b-61e73ec00687" containerName="authorino"
Jul 07 22:07:31.743709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.743504    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7536c572-4696-4496-a93b-61e73ec00687" containerName="authorino"
Jul 07 22:07:31.743709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.743522    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fdd825c-a2c7-452e-a0e3-6c6c5315fa53" containerName="authorino"
Jul 07 22:07:31.743709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.743551    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fdd825c-a2c7-452e-a0e3-6c6c5315fa53" containerName="authorino"
Jul 07 22:07:31.743709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.743621    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fdd825c-a2c7-452e-a0e3-6c6c5315fa53" containerName="authorino"
Jul 07 22:07:31.743709 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.743630    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7536c572-4696-4496-a93b-61e73ec00687" containerName="authorino"
Jul 07 22:07:31.822432 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.822398    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-mp2l5"]
Jul 07 22:07:31.822626 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.822497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:31.825714 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.825692    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 22:07:31.825873 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.825855    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bdknk\""
Jul 07 22:07:31.826270 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.826248    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 22:07:31.839941 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.839922    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpq64\" (UniqueName: \"kubernetes.io/projected/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-kube-api-access-mpq64\") pod \"maas-controller-54cdf5d9ff-mp2l5\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") " pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:31.840029 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.839977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert\") pod \"maas-controller-54cdf5d9ff-mp2l5\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") " pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:31.930422 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.930346    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d68568969-v4tnj"]
Jul 07 22:07:31.940850 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.940823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert\") pod \"maas-controller-54cdf5d9ff-mp2l5\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") " pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:31.941008 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.940873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpq64\" (UniqueName: \"kubernetes.io/projected/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-kube-api-access-mpq64\") pod \"maas-controller-54cdf5d9ff-mp2l5\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") " pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:31.941008 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:07:31.940959    2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 22:07:31.941105 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:07:31.941014    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert podName:5cc50d1c-9745-4d30-ae1f-0df50656eb7c nodeName:}" failed. No retries permitted until 2026-07-07 22:07:32.441000041 +0000 UTC m=+531.739219371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert") pod "maas-controller-54cdf5d9ff-mp2l5" (UID: "5cc50d1c-9745-4d30-ae1f-0df50656eb7c") : secret "maas-controller-webhook-cert" not found
Jul 07 22:07:31.950721 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.950695    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpq64\" (UniqueName: \"kubernetes.io/projected/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-kube-api-access-mpq64\") pod \"maas-controller-54cdf5d9ff-mp2l5\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") " pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:31.957362 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.957336    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d68568969-v4tnj"]
Jul 07 22:07:31.957487 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:31.957425    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.041401 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.041366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sv42\" (UniqueName: \"kubernetes.io/projected/0b0e6d07-0465-4474-8860-67abce6978ff-kube-api-access-7sv42\") pod \"maas-controller-d68568969-v4tnj\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") " pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.041603 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.041432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0e6d07-0465-4474-8860-67abce6978ff-webhook-cert\") pod \"maas-controller-d68568969-v4tnj\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") " pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.141863 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.141828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv42\" (UniqueName: \"kubernetes.io/projected/0b0e6d07-0465-4474-8860-67abce6978ff-kube-api-access-7sv42\") pod \"maas-controller-d68568969-v4tnj\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") " pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.142054 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.141892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0e6d07-0465-4474-8860-67abce6978ff-webhook-cert\") pod \"maas-controller-d68568969-v4tnj\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") " pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.144387 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.144359    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0e6d07-0465-4474-8860-67abce6978ff-webhook-cert\") pod \"maas-controller-d68568969-v4tnj\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") " pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.150910 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.150885    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sv42\" (UniqueName: \"kubernetes.io/projected/0b0e6d07-0465-4474-8860-67abce6978ff-kube-api-access-7sv42\") pod \"maas-controller-d68568969-v4tnj\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") " pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.274182 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.274149    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:32.429918 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.429894    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d68568969-v4tnj"]
Jul 07 22:07:32.431992 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:07:32.431966    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0e6d07_0465_4474_8860_67abce6978ff.slice/crio-69039dda37ca03eff3a86acb841109700ed5e28c0b56738add2238a4d407ecf1 WatchSource:0}: Error finding container 69039dda37ca03eff3a86acb841109700ed5e28c0b56738add2238a4d407ecf1: Status 404 returned error can't find the container with id 69039dda37ca03eff3a86acb841109700ed5e28c0b56738add2238a4d407ecf1
Jul 07 22:07:32.445425 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.445400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert\") pod \"maas-controller-54cdf5d9ff-mp2l5\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") " pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:32.447730 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.447713    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert\") pod \"maas-controller-54cdf5d9ff-mp2l5\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") " pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:32.733573 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.733455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:32.867518 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.867486    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-mp2l5"]
Jul 07 22:07:32.869232 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:07:32.869197    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc50d1c_9745_4d30_ae1f_0df50656eb7c.slice/crio-683bc26cc972483d28eabda0cde9f7fa868c70db033f34ddf1ca4fdcf602f5be WatchSource:0}: Error finding container 683bc26cc972483d28eabda0cde9f7fa868c70db033f34ddf1ca4fdcf602f5be: Status 404 returned error can't find the container with id 683bc26cc972483d28eabda0cde9f7fa868c70db033f34ddf1ca4fdcf602f5be
Jul 07 22:07:32.928226 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.928187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d68568969-v4tnj" event={"ID":"0b0e6d07-0465-4474-8860-67abce6978ff","Type":"ContainerStarted","Data":"69039dda37ca03eff3a86acb841109700ed5e28c0b56738add2238a4d407ecf1"}
Jul 07 22:07:32.929407 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:32.929376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5" event={"ID":"5cc50d1c-9745-4d30-ae1f-0df50656eb7c","Type":"ContainerStarted","Data":"683bc26cc972483d28eabda0cde9f7fa868c70db033f34ddf1ca4fdcf602f5be"}
Jul 07 22:07:34.945603 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:34.945565    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d68568969-v4tnj" event={"ID":"0b0e6d07-0465-4474-8860-67abce6978ff","Type":"ContainerStarted","Data":"41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0"}
Jul 07 22:07:34.946035 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:34.945773    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:34.947431 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:34.947404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5" event={"ID":"5cc50d1c-9745-4d30-ae1f-0df50656eb7c","Type":"ContainerStarted","Data":"bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8"}
Jul 07 22:07:34.947597 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:34.947471    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:34.967750 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:34.967696    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d68568969-v4tnj" podStartSLOduration=1.664815086 podStartE2EDuration="3.967681941s" totalImagesPullingTime="2.302866855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:07:34.966292008 +0000 UTC m=+534.264511361" watchObservedRunningTime="2026-07-07 22:07:34.967681941 +0000 UTC m=+534.265901292"
Jul 07 22:07:34.989800 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:34.989690    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5" podStartSLOduration=2.133761012 podStartE2EDuration="3.989675146s" totalImagesPullingTime="1.855914134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:07:34.986895926 +0000 UTC m=+534.285115274" watchObservedRunningTime="2026-07-07 22:07:34.989675146 +0000 UTC m=+534.287894499"
Jul 07 22:07:45.960179 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:45.960147    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:45.960618 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:45.960379    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:07:46.027897 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.027863    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-mp2l5"]
Jul 07 22:07:46.028179 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.028106    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5" podUID="5cc50d1c-9745-4d30-ae1f-0df50656eb7c" containerName="manager" containerID="cri-o://bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8" gracePeriod=30
Jul 07 22:07:46.277916 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.277894    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:46.378837 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.378806    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert\") pod \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") "
Jul 07 22:07:46.379020 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.378911    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpq64\" (UniqueName: \"kubernetes.io/projected/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-kube-api-access-mpq64\") pod \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\" (UID: \"5cc50d1c-9745-4d30-ae1f-0df50656eb7c\") "
Jul 07 22:07:46.381100 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.381073    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5cc50d1c-9745-4d30-ae1f-0df50656eb7c" (UID: "5cc50d1c-9745-4d30-ae1f-0df50656eb7c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:07:46.381227 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.381118    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-kube-api-access-mpq64" (OuterVolumeSpecName: "kube-api-access-mpq64") pod "5cc50d1c-9745-4d30-ae1f-0df50656eb7c" (UID: "5cc50d1c-9745-4d30-ae1f-0df50656eb7c"). InnerVolumeSpecName "kube-api-access-mpq64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:07:46.480016 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.479975    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-webhook-cert\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:46.480016 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:46.480008    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpq64\" (UniqueName: \"kubernetes.io/projected/5cc50d1c-9745-4d30-ae1f-0df50656eb7c-kube-api-access-mpq64\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:07:47.015842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.015807    2567 generic.go:356] "Generic (PLEG): container finished" podID="5cc50d1c-9745-4d30-ae1f-0df50656eb7c" containerID="bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8" exitCode=0
Jul 07 22:07:47.016269 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.015859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5" event={"ID":"5cc50d1c-9745-4d30-ae1f-0df50656eb7c","Type":"ContainerDied","Data":"bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8"}
Jul 07 22:07:47.016269 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.015872    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5"
Jul 07 22:07:47.016269 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.015926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cdf5d9ff-mp2l5" event={"ID":"5cc50d1c-9745-4d30-ae1f-0df50656eb7c","Type":"ContainerDied","Data":"683bc26cc972483d28eabda0cde9f7fa868c70db033f34ddf1ca4fdcf602f5be"}
Jul 07 22:07:47.016269 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.015950    2567 scope.go:117] "RemoveContainer" containerID="bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8"
Jul 07 22:07:47.025310 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.025291    2567 scope.go:117] "RemoveContainer" containerID="bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8"
Jul 07 22:07:47.025597 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:07:47.025573    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8\": container with ID starting with bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8 not found: ID does not exist" containerID="bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8"
Jul 07 22:07:47.025698 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.025604    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8"} err="failed to get container status \"bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8\": rpc error: code = NotFound desc = could not find container \"bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8\": container with ID starting with bc1dcfb0e4eebc5c3115e0a8e1a27980a73fc92b7b5a0c81e8550aace70ef7f8 not found: ID does not exist"
Jul 07 22:07:47.040705 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.040681    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-mp2l5"]
Jul 07 22:07:47.045377 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.045355    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54cdf5d9ff-mp2l5"]
Jul 07 22:07:47.250793 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:07:47.250751    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc50d1c-9745-4d30-ae1f-0df50656eb7c" path="/var/lib/kubelet/pods/5cc50d1c-9745-4d30-ae1f-0df50656eb7c/volumes"
Jul 07 22:08:06.877281 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.877245    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"]
Jul 07 22:08:06.877798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.877689    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc50d1c-9745-4d30-ae1f-0df50656eb7c" containerName="manager"
Jul 07 22:08:06.877798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.877704    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc50d1c-9745-4d30-ae1f-0df50656eb7c" containerName="manager"
Jul 07 22:08:06.877902 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.877804    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc50d1c-9745-4d30-ae1f-0df50656eb7c" containerName="manager"
Jul 07 22:08:06.879897 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.879879    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:06.882903 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.882885    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 07 22:08:06.883110 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.883090    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 07 22:08:06.883281 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.883269    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 07 22:08:06.892226 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:06.892206    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"]
Jul 07 22:08:07.062621 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.062580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7kjn\" (UniqueName: \"kubernetes.io/projected/951c7b81-84e7-4ca8-886c-f4ae5c673617-kube-api-access-z7kjn\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.062802 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.062631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951c7b81-84e7-4ca8-886c-f4ae5c673617-maas-api-tls\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.062802 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.062720    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951c7b81-84e7-4ca8-886c-f4ae5c673617-openshift-service-ca\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.163526 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.163431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7kjn\" (UniqueName: \"kubernetes.io/projected/951c7b81-84e7-4ca8-886c-f4ae5c673617-kube-api-access-z7kjn\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.163526 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.163479    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951c7b81-84e7-4ca8-886c-f4ae5c673617-maas-api-tls\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.163526 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.163508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951c7b81-84e7-4ca8-886c-f4ae5c673617-openshift-service-ca\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.164236 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.164217    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951c7b81-84e7-4ca8-886c-f4ae5c673617-openshift-service-ca\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.166054 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.166036    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951c7b81-84e7-4ca8-886c-f4ae5c673617-maas-api-tls\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.173819 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.173800    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7kjn\" (UniqueName: \"kubernetes.io/projected/951c7b81-84e7-4ca8-886c-f4ae5c673617-kube-api-access-z7kjn\") pod \"maas-api-5c6b8bff7d-x545m\" (UID: \"951c7b81-84e7-4ca8-886c-f4ae5c673617\") " pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.190268 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.190247    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:07.338868 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.338842    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"]
Jul 07 22:08:07.341033 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:08:07.341010    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951c7b81_84e7_4ca8_886c_f4ae5c673617.slice/crio-b73ea945ab9f71dd1f6befc3b12c3bc01c9cae0af9c361de7927f6b3de17fa48 WatchSource:0}: Error finding container b73ea945ab9f71dd1f6befc3b12c3bc01c9cae0af9c361de7927f6b3de17fa48: Status 404 returned error can't find the container with id b73ea945ab9f71dd1f6befc3b12c3bc01c9cae0af9c361de7927f6b3de17fa48
Jul 07 22:08:07.656091 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.656046    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-sxn8j"]
Jul 07 22:08:07.658985 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.658969    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.661846 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.661817    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vlzxb\""
Jul 07 22:08:07.662231 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.662210    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 22:08:07.676591 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.676566    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-sxn8j"]
Jul 07 22:08:07.750578 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.750540    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9d8v6"]
Jul 07 22:08:07.753148 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.753131    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:07.767150 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.767123    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9d8v6"]
Jul 07 22:08:07.769808 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.769785    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1ac2c26-52f8-4989-8ca1-cb3487d75673-plugins-config-volume\") pod \"payload-pre-processing-7964457696-sxn8j\" (UID: \"a1ac2c26-52f8-4989-8ca1-cb3487d75673\") " pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.769956 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.769890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c2ns\" (UniqueName: \"kubernetes.io/projected/a1ac2c26-52f8-4989-8ca1-cb3487d75673-kube-api-access-8c2ns\") pod \"payload-pre-processing-7964457696-sxn8j\" (UID: \"a1ac2c26-52f8-4989-8ca1-cb3487d75673\") " pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.870652 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.870620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qbl\" (UniqueName: \"kubernetes.io/projected/376e4911-420f-425e-84b5-437e86b34c65-kube-api-access-h5qbl\") pod \"payload-processing-58f86c7798-9d8v6\" (UID: \"376e4911-420f-425e-84b5-437e86b34c65\") " pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:07.870844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.870725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c2ns\" (UniqueName: \"kubernetes.io/projected/a1ac2c26-52f8-4989-8ca1-cb3487d75673-kube-api-access-8c2ns\") pod \"payload-pre-processing-7964457696-sxn8j\" (UID: \"a1ac2c26-52f8-4989-8ca1-cb3487d75673\") " pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.870844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.870767    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376e4911-420f-425e-84b5-437e86b34c65-plugins-config-volume\") pod \"payload-processing-58f86c7798-9d8v6\" (UID: \"376e4911-420f-425e-84b5-437e86b34c65\") " pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:07.870844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.870797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1ac2c26-52f8-4989-8ca1-cb3487d75673-plugins-config-volume\") pod \"payload-pre-processing-7964457696-sxn8j\" (UID: \"a1ac2c26-52f8-4989-8ca1-cb3487d75673\") " pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.871523 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.871490    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1ac2c26-52f8-4989-8ca1-cb3487d75673-plugins-config-volume\") pod \"payload-pre-processing-7964457696-sxn8j\" (UID: \"a1ac2c26-52f8-4989-8ca1-cb3487d75673\") " pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.880495 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.880472    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c2ns\" (UniqueName: \"kubernetes.io/projected/a1ac2c26-52f8-4989-8ca1-cb3487d75673-kube-api-access-8c2ns\") pod \"payload-pre-processing-7964457696-sxn8j\" (UID: \"a1ac2c26-52f8-4989-8ca1-cb3487d75673\") " pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.970403 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.970318    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:07.971707 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.971676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376e4911-420f-425e-84b5-437e86b34c65-plugins-config-volume\") pod \"payload-processing-58f86c7798-9d8v6\" (UID: \"376e4911-420f-425e-84b5-437e86b34c65\") " pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:07.971853 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.971769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qbl\" (UniqueName: \"kubernetes.io/projected/376e4911-420f-425e-84b5-437e86b34c65-kube-api-access-h5qbl\") pod \"payload-processing-58f86c7798-9d8v6\" (UID: \"376e4911-420f-425e-84b5-437e86b34c65\") " pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:07.972410 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.972385    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376e4911-420f-425e-84b5-437e86b34c65-plugins-config-volume\") pod \"payload-processing-58f86c7798-9d8v6\" (UID: \"376e4911-420f-425e-84b5-437e86b34c65\") " pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:07.981589 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:07.981563    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qbl\" (UniqueName: \"kubernetes.io/projected/376e4911-420f-425e-84b5-437e86b34c65-kube-api-access-h5qbl\") pod \"payload-processing-58f86c7798-9d8v6\" (UID: \"376e4911-420f-425e-84b5-437e86b34c65\") " pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:08.064026 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:08.063927    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:08.122352 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:08.122079    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-sxn8j"]
Jul 07 22:08:08.126112 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:08:08.125866    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ac2c26_52f8_4989_8ca1_cb3487d75673.slice/crio-5d6028c6e8aa6f796147544f6dbeb575c7e1ca92e1fc03662d7a41c0547cdcdb WatchSource:0}: Error finding container 5d6028c6e8aa6f796147544f6dbeb575c7e1ca92e1fc03662d7a41c0547cdcdb: Status 404 returned error can't find the container with id 5d6028c6e8aa6f796147544f6dbeb575c7e1ca92e1fc03662d7a41c0547cdcdb
Jul 07 22:08:08.132375 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:08.132327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m" event={"ID":"951c7b81-84e7-4ca8-886c-f4ae5c673617","Type":"ContainerStarted","Data":"b73ea945ab9f71dd1f6befc3b12c3bc01c9cae0af9c361de7927f6b3de17fa48"}
Jul 07 22:08:08.216681 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:08.216646    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9d8v6"]
Jul 07 22:08:08.218676 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:08:08.218650    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376e4911_420f_425e_84b5_437e86b34c65.slice/crio-78f7324afffde75545dd5d534ee2e96353ed55575e877577c7e5a7a9ae893042 WatchSource:0}: Error finding container 78f7324afffde75545dd5d534ee2e96353ed55575e877577c7e5a7a9ae893042: Status 404 returned error can't find the container with id 78f7324afffde75545dd5d534ee2e96353ed55575e877577c7e5a7a9ae893042
Jul 07 22:08:09.140331 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:09.140296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-9d8v6" event={"ID":"376e4911-420f-425e-84b5-437e86b34c65","Type":"ContainerStarted","Data":"78f7324afffde75545dd5d534ee2e96353ed55575e877577c7e5a7a9ae893042"}
Jul 07 22:08:09.141441 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:09.141417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j" event={"ID":"a1ac2c26-52f8-4989-8ca1-cb3487d75673","Type":"ContainerStarted","Data":"5d6028c6e8aa6f796147544f6dbeb575c7e1ca92e1fc03662d7a41c0547cdcdb"}
Jul 07 22:08:10.149915 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:10.149875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m" event={"ID":"951c7b81-84e7-4ca8-886c-f4ae5c673617","Type":"ContainerStarted","Data":"4b54b8c24b5c413003ad3b9ed0a35047cb7371b8c2e08a942aa3e5dfaec92612"}
Jul 07 22:08:10.150406 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:10.150058    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:10.175013 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:10.174967    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m" podStartSLOduration=2.415398689 podStartE2EDuration="4.174951949s" totalImagesPullingTime="1.75955326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:08:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:08:10.17389727 +0000 UTC m=+569.472116621" watchObservedRunningTime="2026-07-07 22:08:10.174951949 +0000 UTC m=+569.473171330"
Jul 07 22:08:11.157459 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:11.157418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-9d8v6" event={"ID":"376e4911-420f-425e-84b5-437e86b34c65","Type":"ContainerStarted","Data":"ab8cccfe02b8ca9d9ad7d38e2ec5cb0bdb6825d3e14e07002f2426966ccad761"}
Jul 07 22:08:11.157988 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:11.157656    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:11.159130 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:11.159103    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j" event={"ID":"a1ac2c26-52f8-4989-8ca1-cb3487d75673","Type":"ContainerStarted","Data":"a3293fe72683c35a09404ef78e760ccd8735787608b7584b39baf589289f70ef"}
Jul 07 22:08:11.159263 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:11.159236    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:11.177898 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:11.177854    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-9d8v6" podStartSLOduration=2.141785263 podStartE2EDuration="4.177841892s" totalImagesPullingTime="2.036056629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:08:11.176334077 +0000 UTC m=+570.474553429" watchObservedRunningTime="2026-07-07 22:08:11.177841892 +0000 UTC m=+570.476061242"
Jul 07 22:08:11.195916 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:11.195868    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j" podStartSLOduration=2.06733235 podStartE2EDuration="4.19585403s" totalImagesPullingTime="2.12852168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:08:11.193239004 +0000 UTC m=+570.491458365" watchObservedRunningTime="2026-07-07 22:08:11.19585403 +0000 UTC m=+570.494073381"
Jul 07 22:08:15.303322 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:15.303274    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-48d5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:46548->10.132.0.46:15021: read: connection reset by peer" start-of-body=
Jul 07 22:08:15.303744 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:15.303348    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" podUID="2b6ca15d-7931-47d0-aabe-8e497235dcc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:46548->10.132.0.46:15021: read: connection reset by peer"
Jul 07 22:08:16.164512 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:16.164484    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c6b8bff7d-x545m"
Jul 07 22:08:16.190923 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:16.190892    2567 generic.go:356] "Generic (PLEG): container finished" podID="2b6ca15d-7931-47d0-aabe-8e497235dcc9" containerID="b9c8613870fc25177b6a0361b3f6ec2b7897e3cd10f29f2802f3a647ebfa2fc9" exitCode=0
Jul 07 22:08:16.191087 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:16.190940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" event={"ID":"2b6ca15d-7931-47d0-aabe-8e497235dcc9","Type":"ContainerDied","Data":"b9c8613870fc25177b6a0361b3f6ec2b7897e3cd10f29f2802f3a647ebfa2fc9"}
Jul 07 22:08:16.191343 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:16.191325    2567 scope.go:117] "RemoveContainer" containerID="b9c8613870fc25177b6a0361b3f6ec2b7897e3cd10f29f2802f3a647ebfa2fc9"
Jul 07 22:08:16.192379 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:16.192350    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:08:16.192442 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:16.192416    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:08:16.192478 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:16.192469    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:08:17.198716 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:17.198677    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" event={"ID":"2b6ca15d-7931-47d0-aabe-8e497235dcc9","Type":"ContainerStarted","Data":"377c92488ff4abeb54f686900ebe7ba6cdd6a2cc3bf16541b1a20f9e2164d1f4"}
Jul 07 22:08:17.314291 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:17.313837    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:08:17.314291 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:17.313973    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-48d5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 22:08:17.314291 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:17.314038    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" podUID="2b6ca15d-7931-47d0-aabe-8e497235dcc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 22:08:18.313773 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:18.313732    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-48d5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 22:08:18.314271 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:18.313820    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" podUID="2b6ca15d-7931-47d0-aabe-8e497235dcc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 22:08:19.313747 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:19.313709    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-48d5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 22:08:19.314057 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:19.314027    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" podUID="2b6ca15d-7931-47d0-aabe-8e497235dcc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 22:08:20.314945 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:20.314900    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-48d5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 22:08:20.315415 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:20.314970    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r" podUID="2b6ca15d-7931-47d0-aabe-8e497235dcc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 22:08:21.317418 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:21.317379    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:08:21.317877 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:21.317779    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:08:21.318399 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:21.318384    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-48d5r"
Jul 07 22:08:22.166373 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:22.166328    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j" podUID="a1ac2c26-52f8-4989-8ca1-cb3487d75673" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.54:9004: connect: connection refused"
Jul 07 22:08:22.166633 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:22.166614    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-9d8v6"
Jul 07 22:08:29.403837 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.403796    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"]
Jul 07 22:08:29.406494 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.406472    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.410994 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.410972    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 22:08:29.411755 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.411742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 22:08:29.412022 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.412001    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vjtr8\""
Jul 07 22:08:29.412141 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.412076    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 22:08:29.422445 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.422417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"]
Jul 07 22:08:29.448219 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.448184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b5dh\" (UniqueName: \"kubernetes.io/projected/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-kube-api-access-4b5dh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.448392 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.448232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.448392 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.448274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.448392 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.448297    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.448392 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.448315    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.448392 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.448331    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.549640 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.549604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5dh\" (UniqueName: \"kubernetes.io/projected/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-kube-api-access-4b5dh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.549845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.549671    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.549845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.549712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.549845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.549750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.549845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.549790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.549845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.549823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.550203 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.550179    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.550343 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.550316    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.550475 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.550386    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.552693 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.552671    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.553073 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.553050    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.560013 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.559991    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b5dh\" (UniqueName: \"kubernetes.io/projected/4fe0a2c0-88b7-48fd-8e01-2fe7f691f304-kube-api-access-4b5dh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx\" (UID: \"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.717294 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.717206    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:29.856593 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:29.856526    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"]
Jul 07 22:08:29.857649 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:08:29.857622    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe0a2c0_88b7_48fd_8e01_2fe7f691f304.slice/crio-8fedddcb7230e83af5f3961141d5ea1ff36b57720dace7b9c5099043d41930d9 WatchSource:0}: Error finding container 8fedddcb7230e83af5f3961141d5ea1ff36b57720dace7b9c5099043d41930d9: Status 404 returned error can't find the container with id 8fedddcb7230e83af5f3961141d5ea1ff36b57720dace7b9c5099043d41930d9
Jul 07 22:08:30.276970 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:30.276935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx" event={"ID":"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304","Type":"ContainerStarted","Data":"8fedddcb7230e83af5f3961141d5ea1ff36b57720dace7b9c5099043d41930d9"}
Jul 07 22:08:31.283999 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:31.283955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx" event={"ID":"4fe0a2c0-88b7-48fd-8e01-2fe7f691f304","Type":"ContainerStarted","Data":"312a709cea300b6a65ffee30c2e078f6daa7a3ad1cc29853a34329102258667a"}
Jul 07 22:08:31.306790 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:31.306742    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx" podStartSLOduration=1.098933148 podStartE2EDuration="2.306726947s" totalImagesPullingTime="1.207793799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:08:31.305424531 +0000 UTC m=+590.603643884" watchObservedRunningTime="2026-07-07 22:08:31.306726947 +0000 UTC m=+590.604946298"
Jul 07 22:08:32.165744 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:32.165705    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-sxn8j"
Jul 07 22:08:39.717318 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:39.717282    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:39.717856 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:39.717453    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:39.730036 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:39.730012    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:40.343507 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:40.343475    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx"
Jul 07 22:08:41.131347 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:41.131292    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:08:41.132037 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:41.132017    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:08:49.085700 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.085663    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"]
Jul 07 22:08:49.089464 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.089443    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.093389 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.093370    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 22:08:49.101367 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.101343    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"]
Jul 07 22:08:49.235420 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.235379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.235420 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.235422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.235738 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.235476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s2t8\" (UniqueName: \"kubernetes.io/projected/c17cd772-0d20-4d09-b103-010e83b15d07-kube-api-access-4s2t8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.235738 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.235514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.235738 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.235570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17cd772-0d20-4d09-b103-010e83b15d07-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.235738 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.235608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.336546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.336435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.336546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.336470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.336546 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.336515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s2t8\" (UniqueName: \"kubernetes.io/projected/c17cd772-0d20-4d09-b103-010e83b15d07-kube-api-access-4s2t8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.336825 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.336571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.336825 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.336592    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17cd772-0d20-4d09-b103-010e83b15d07-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.336825 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.336624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.336990 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.336943    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.337047 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.337018    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.337091 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.337080    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.338967 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.338945    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c17cd772-0d20-4d09-b103-010e83b15d07-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.339218 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.339200    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c17cd772-0d20-4d09-b103-010e83b15d07-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.345717 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.345696    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s2t8\" (UniqueName: \"kubernetes.io/projected/c17cd772-0d20-4d09-b103-010e83b15d07-kube-api-access-4s2t8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2bttt\" (UID: \"c17cd772-0d20-4d09-b103-010e83b15d07\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.399580 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.399501    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:49.543761 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:49.543726    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"]
Jul 07 22:08:49.545081 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:08:49.545048    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17cd772_0d20_4d09_b103_010e83b15d07.slice/crio-eef8790155b2e01839c1854701a5fa684054dfed0cad76c038c9891dc4f49667 WatchSource:0}: Error finding container eef8790155b2e01839c1854701a5fa684054dfed0cad76c038c9891dc4f49667: Status 404 returned error can't find the container with id eef8790155b2e01839c1854701a5fa684054dfed0cad76c038c9891dc4f49667
Jul 07 22:08:50.389836 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:50.389806    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt" event={"ID":"c17cd772-0d20-4d09-b103-010e83b15d07","Type":"ContainerStarted","Data":"ca533af1ddba44bb30d109c62cc67a206e9d4324a7188a01178f3b7cbc58231c"}
Jul 07 22:08:50.390325 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:50.389874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt" event={"ID":"c17cd772-0d20-4d09-b103-010e83b15d07","Type":"ContainerStarted","Data":"eef8790155b2e01839c1854701a5fa684054dfed0cad76c038c9891dc4f49667"}
Jul 07 22:08:50.414058 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:50.413996    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt" podStartSLOduration=1.214410166 podStartE2EDuration="1.413973021s" totalImagesPullingTime="199.562855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:08:50.411610359 +0000 UTC m=+609.709829705" watchObservedRunningTime="2026-07-07 22:08:50.413973021 +0000 UTC m=+609.712192375"
Jul 07 22:08:59.400241 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:59.400202    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:59.400698 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:59.400299    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:59.412852 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:59.412828    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:08:59.449871 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:08:59.449845    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2bttt"
Jul 07 22:09:18.779851 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.779746    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"]
Jul 07 22:09:18.783864 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.783848    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:18.786564 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.786515    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 22:09:18.793168 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.793144    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"]
Jul 07 22:09:18.904633 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.904587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzkhf\" (UniqueName: \"kubernetes.io/projected/4b1dd67a-f567-488f-a772-9a04181db01b-kube-api-access-vzkhf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:18.904806 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.904653    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:18.904806 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.904674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:18.904806 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.904772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:18.904967 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.904812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1dd67a-f567-488f-a772-9a04181db01b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:18.904967 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:18.904898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006062 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006062 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006330 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006330 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1dd67a-f567-488f-a772-9a04181db01b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006330 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006330 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzkhf\" (UniqueName: \"kubernetes.io/projected/4b1dd67a-f567-488f-a772-9a04181db01b-kube-api-access-vzkhf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006638 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006519    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006638 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006564    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.006638 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.006604    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.009060 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.009032    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1dd67a-f567-488f-a772-9a04181db01b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.009302 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.009277    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1dd67a-f567-488f-a772-9a04181db01b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.015414 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.015389    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzkhf\" (UniqueName: \"kubernetes.io/projected/4b1dd67a-f567-488f-a772-9a04181db01b-kube-api-access-vzkhf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d\" (UID: \"4b1dd67a-f567-488f-a772-9a04181db01b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.095362 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.095269    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:19.236895 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.236865    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"]
Jul 07 22:09:19.238799 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:09:19.238773    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1dd67a_f567_488f_a772_9a04181db01b.slice/crio-06ef3925fdd7e7f89d8cccd7dded19dd6c0c64a57dad3358db90441e787efd9c WatchSource:0}: Error finding container 06ef3925fdd7e7f89d8cccd7dded19dd6c0c64a57dad3358db90441e787efd9c: Status 404 returned error can't find the container with id 06ef3925fdd7e7f89d8cccd7dded19dd6c0c64a57dad3358db90441e787efd9c
Jul 07 22:09:19.240670 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.240653    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:09:19.552402 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.552362    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d" event={"ID":"4b1dd67a-f567-488f-a772-9a04181db01b","Type":"ContainerStarted","Data":"e0aa5bb1a5f01cbba2c8168a7991cfa3294468ad13abde15935592c1f68085c5"}
Jul 07 22:09:19.552595 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.552427    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d" event={"ID":"4b1dd67a-f567-488f-a772-9a04181db01b","Type":"ContainerStarted","Data":"06ef3925fdd7e7f89d8cccd7dded19dd6c0c64a57dad3358db90441e787efd9c"}
Jul 07 22:09:19.573509 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:19.573460    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d" podStartSLOduration=1.357749246 podStartE2EDuration="1.573445477s" totalImagesPullingTime="215.696231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:19.570561187 +0000 UTC m=+638.868780536" watchObservedRunningTime="2026-07-07 22:09:19.573445477 +0000 UTC m=+638.871664827"
Jul 07 22:09:29.096398 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:29.096353    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:29.096854 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:29.096423    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:29.109877 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:29.109841    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:29.619434 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:29.619400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d"
Jul 07 22:09:32.818349 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.818316    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"]
Jul 07 22:09:32.821712 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.821695    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:32.825205 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.825183    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 22:09:32.847950 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.847919    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"]
Jul 07 22:09:32.936593 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.936526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:32.936785 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.936597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:32.936785 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.936639    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:32.936785 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.936750    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:32.936931 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.936782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9tvm\" (UniqueName: \"kubernetes.io/projected/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-kube-api-access-c9tvm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:32.936931 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:32.936826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.037869 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.037830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.037869 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.037874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9tvm\" (UniqueName: \"kubernetes.io/projected/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-kube-api-access-c9tvm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.038114 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.037921    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.038114 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.037980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.038114 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.038004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.038114 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.038049    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.038315 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.038258    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.038403 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.038377    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.038466 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.038418    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.040384 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.040362    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.040662 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.040637    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.049691 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.049669    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9tvm\" (UniqueName: \"kubernetes.io/projected/0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e-kube-api-access-c9tvm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7\" (UID: \"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.131742 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.131649    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:33.280985 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.280958    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"]
Jul 07 22:09:33.283514 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:09:33.283481    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ebbb3b8_b85d_41a3_beb2_96029d3f8b8e.slice/crio-2dcb72eaaf15973ccce1440ff20666c6c5cfb955a2a8b621221107eb1a6c198a WatchSource:0}: Error finding container 2dcb72eaaf15973ccce1440ff20666c6c5cfb955a2a8b621221107eb1a6c198a: Status 404 returned error can't find the container with id 2dcb72eaaf15973ccce1440ff20666c6c5cfb955a2a8b621221107eb1a6c198a
Jul 07 22:09:33.634983 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.634947    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7" event={"ID":"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e","Type":"ContainerStarted","Data":"1945ea091f03c5adb4cd05a6bcbd93aa28012db49e8c552275788b540b9fa176"}
Jul 07 22:09:33.635162 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.634992    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7" event={"ID":"0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e","Type":"ContainerStarted","Data":"2dcb72eaaf15973ccce1440ff20666c6c5cfb955a2a8b621221107eb1a6c198a"}
Jul 07 22:09:33.660697 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:33.660652    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7" podStartSLOduration=1.40829248 podStartE2EDuration="1.660637411s" totalImagesPullingTime="252.344931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:09:33.658990698 +0000 UTC m=+652.957210051" watchObservedRunningTime="2026-07-07 22:09:33.660637411 +0000 UTC m=+652.958856762"
Jul 07 22:09:43.132301 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:43.132263    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:43.132732 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:43.132336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:43.145179 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:43.145157    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:09:43.702908 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:09:43.702878    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7"
Jul 07 22:10:44.853360 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:44.853275    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79c66666c-kkl9h"]
Jul 07 22:10:44.856858 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:44.856841    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:44.860930 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:44.860905    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 22:10:44.861248 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:44.860967    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-42m78\""
Jul 07 22:10:44.864957 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:44.864408    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79c66666c-kkl9h"]
Jul 07 22:10:44.907071 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:44.907041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5htpf\" (UniqueName: \"kubernetes.io/projected/febe8a7d-ec28-42a2-82cb-f785fa97bab6-kube-api-access-5htpf\") pod \"authorino-79c66666c-kkl9h\" (UID: \"febe8a7d-ec28-42a2-82cb-f785fa97bab6\") " pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:44.907252 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:44.907090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/febe8a7d-ec28-42a2-82cb-f785fa97bab6-tls-cert\") pod \"authorino-79c66666c-kkl9h\" (UID: \"febe8a7d-ec28-42a2-82cb-f785fa97bab6\") " pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:45.008471 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:45.008438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5htpf\" (UniqueName: \"kubernetes.io/projected/febe8a7d-ec28-42a2-82cb-f785fa97bab6-kube-api-access-5htpf\") pod \"authorino-79c66666c-kkl9h\" (UID: \"febe8a7d-ec28-42a2-82cb-f785fa97bab6\") " pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:45.008711 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:45.008491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/febe8a7d-ec28-42a2-82cb-f785fa97bab6-tls-cert\") pod \"authorino-79c66666c-kkl9h\" (UID: \"febe8a7d-ec28-42a2-82cb-f785fa97bab6\") " pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:45.011245 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:45.011220    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/febe8a7d-ec28-42a2-82cb-f785fa97bab6-tls-cert\") pod \"authorino-79c66666c-kkl9h\" (UID: \"febe8a7d-ec28-42a2-82cb-f785fa97bab6\") " pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:45.016515 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:45.016489    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5htpf\" (UniqueName: \"kubernetes.io/projected/febe8a7d-ec28-42a2-82cb-f785fa97bab6-kube-api-access-5htpf\") pod \"authorino-79c66666c-kkl9h\" (UID: \"febe8a7d-ec28-42a2-82cb-f785fa97bab6\") " pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:45.167782 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:45.167696    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79c66666c-kkl9h"
Jul 07 22:10:45.311932 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:45.311861    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79c66666c-kkl9h"]
Jul 07 22:10:45.314357 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:10:45.314324    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfebe8a7d_ec28_42a2_82cb_f785fa97bab6.slice/crio-84a8d6a69a7c7863a6695bf81095124ef6ec2ae7620874a4e6c15a3d53759a2d WatchSource:0}: Error finding container 84a8d6a69a7c7863a6695bf81095124ef6ec2ae7620874a4e6c15a3d53759a2d: Status 404 returned error can't find the container with id 84a8d6a69a7c7863a6695bf81095124ef6ec2ae7620874a4e6c15a3d53759a2d
Jul 07 22:10:46.033851 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:46.033808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79c66666c-kkl9h" event={"ID":"febe8a7d-ec28-42a2-82cb-f785fa97bab6","Type":"ContainerStarted","Data":"66eca89c0c8170a786e6dfa3414a92ab192657f67d01a6e80884a5a9480efd38"}
Jul 07 22:10:46.034309 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:46.033863    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79c66666c-kkl9h" event={"ID":"febe8a7d-ec28-42a2-82cb-f785fa97bab6","Type":"ContainerStarted","Data":"84a8d6a69a7c7863a6695bf81095124ef6ec2ae7620874a4e6c15a3d53759a2d"}
Jul 07 22:10:46.080913 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:10:46.080861    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79c66666c-kkl9h" podStartSLOduration=1.681525363 podStartE2EDuration="2.080843902s" totalImagesPullingTime="399.318539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:10:46.078633092 +0000 UTC m=+725.376852453" watchObservedRunningTime="2026-07-07 22:10:46.080843902 +0000 UTC m=+725.379063252"
Jul 07 22:11:57.830586 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:57.830551    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d68568969-v4tnj"]
Jul 07 22:11:57.831166 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:57.830746    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d68568969-v4tnj" podUID="0b0e6d07-0465-4474-8860-67abce6978ff" containerName="manager" containerID="cri-o://41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0" gracePeriod=30
Jul 07 22:11:58.088278 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.088213    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:11:58.192830 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.192796    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0e6d07-0465-4474-8860-67abce6978ff-webhook-cert\") pod \"0b0e6d07-0465-4474-8860-67abce6978ff\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") "
Jul 07 22:11:58.193020 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.192876    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sv42\" (UniqueName: \"kubernetes.io/projected/0b0e6d07-0465-4474-8860-67abce6978ff-kube-api-access-7sv42\") pod \"0b0e6d07-0465-4474-8860-67abce6978ff\" (UID: \"0b0e6d07-0465-4474-8860-67abce6978ff\") "
Jul 07 22:11:58.195009 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.194980    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b0e6d07-0465-4474-8860-67abce6978ff-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0b0e6d07-0465-4474-8860-67abce6978ff" (UID: "0b0e6d07-0465-4474-8860-67abce6978ff"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:11:58.195125 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.195048    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b0e6d07-0465-4474-8860-67abce6978ff-kube-api-access-7sv42" (OuterVolumeSpecName: "kube-api-access-7sv42") pod "0b0e6d07-0465-4474-8860-67abce6978ff" (UID: "0b0e6d07-0465-4474-8860-67abce6978ff"). InnerVolumeSpecName "kube-api-access-7sv42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:11:58.294169 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.294125    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b0e6d07-0465-4474-8860-67abce6978ff-webhook-cert\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:11:58.294169 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.294158    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sv42\" (UniqueName: \"kubernetes.io/projected/0b0e6d07-0465-4474-8860-67abce6978ff-kube-api-access-7sv42\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:11:58.447548 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.447429    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b0e6d07-0465-4474-8860-67abce6978ff" containerID="41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0" exitCode=0
Jul 07 22:11:58.447548 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.447477    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d68568969-v4tnj"
Jul 07 22:11:58.447728 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.447524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d68568969-v4tnj" event={"ID":"0b0e6d07-0465-4474-8860-67abce6978ff","Type":"ContainerDied","Data":"41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0"}
Jul 07 22:11:58.447728 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.447603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d68568969-v4tnj" event={"ID":"0b0e6d07-0465-4474-8860-67abce6978ff","Type":"ContainerDied","Data":"69039dda37ca03eff3a86acb841109700ed5e28c0b56738add2238a4d407ecf1"}
Jul 07 22:11:58.447728 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.447625    2567 scope.go:117] "RemoveContainer" containerID="41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0"
Jul 07 22:11:58.459792 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.459734    2567 scope.go:117] "RemoveContainer" containerID="41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0"
Jul 07 22:11:58.460335 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:11:58.460310    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0\": container with ID starting with 41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0 not found: ID does not exist" containerID="41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0"
Jul 07 22:11:58.460443 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.460341    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0"} err="failed to get container status \"41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0\": rpc error: code = NotFound desc = could not find container \"41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0\": container with ID starting with 41c34ca3a1a1fb1721f5b13c7aaa32a4ba582163370fe5eaafccf25bb836e4e0 not found: ID does not exist"
Jul 07 22:11:58.470456 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.470428    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d68568969-v4tnj"]
Jul 07 22:11:58.475940 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:58.475921    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d68568969-v4tnj"]
Jul 07 22:11:59.250544 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:11:59.250498    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b0e6d07-0465-4474-8860-67abce6978ff" path="/var/lib/kubelet/pods/0b0e6d07-0465-4474-8860-67abce6978ff/volumes"
Jul 07 22:13:41.168213 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:13:41.168135    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:13:41.170748 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:13:41.169772    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:16:49.813023 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:49.812928    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"]
Jul 07 22:16:49.813512 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:49.813179    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z" podUID="6f8bbd34-8469-4ca5-b009-21b2d1c9a850" containerName="manager" containerID="cri-o://c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4" gracePeriod=10
Jul 07 22:16:53.977981 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:53.977955    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:16:54.025779 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.025746    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpfgx\" (UniqueName: \"kubernetes.io/projected/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-kube-api-access-mpfgx\") pod \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") "
Jul 07 22:16:54.025923 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.025816    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-extensions-socket-volume\") pod \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\" (UID: \"6f8bbd34-8469-4ca5-b009-21b2d1c9a850\") "
Jul 07 22:16:54.026244 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.026213    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f8bbd34-8469-4ca5-b009-21b2d1c9a850" (UID: "6f8bbd34-8469-4ca5-b009-21b2d1c9a850"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:16:54.028099 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.028069    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-kube-api-access-mpfgx" (OuterVolumeSpecName: "kube-api-access-mpfgx") pod "6f8bbd34-8469-4ca5-b009-21b2d1c9a850" (UID: "6f8bbd34-8469-4ca5-b009-21b2d1c9a850"). InnerVolumeSpecName "kube-api-access-mpfgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:16:54.126563 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.126446    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpfgx\" (UniqueName: \"kubernetes.io/projected/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-kube-api-access-mpfgx\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:16:54.126563 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.126475    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f8bbd34-8469-4ca5-b009-21b2d1c9a850-extensions-socket-volume\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:16:54.136220 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.136187    2567 generic.go:356] "Generic (PLEG): container finished" podID="6f8bbd34-8469-4ca5-b009-21b2d1c9a850" containerID="c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4" exitCode=0
Jul 07 22:16:54.136336 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.136238    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"
Jul 07 22:16:54.136336 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.136275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z" event={"ID":"6f8bbd34-8469-4ca5-b009-21b2d1c9a850","Type":"ContainerDied","Data":"c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4"}
Jul 07 22:16:54.136336 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.136325    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z" event={"ID":"6f8bbd34-8469-4ca5-b009-21b2d1c9a850","Type":"ContainerDied","Data":"05dfc6ed91c6a1a9665de768eaff9c86e8db16a4467b4e503cfd8f8a79477698"}
Jul 07 22:16:54.136453 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.136351    2567 scope.go:117] "RemoveContainer" containerID="c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4"
Jul 07 22:16:54.147479 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.147462    2567 scope.go:117] "RemoveContainer" containerID="c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4"
Jul 07 22:16:54.147769 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:16:54.147745    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4\": container with ID starting with c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4 not found: ID does not exist" containerID="c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4"
Jul 07 22:16:54.147825 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.147781    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4"} err="failed to get container status \"c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4\": rpc error: code = NotFound desc = could not find container \"c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4\": container with ID starting with c154e689e7d4aebc9c4af5537a30729ddece91e779bd62b508aade6dbda995d4 not found: ID does not exist"
Jul 07 22:16:54.158811 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.158788    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"]
Jul 07 22:16:54.162305 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:54.162282    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v874z"]
Jul 07 22:16:55.250725 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:16:55.250691    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8bbd34-8469-4ca5-b009-21b2d1c9a850" path="/var/lib/kubelet/pods/6f8bbd34-8469-4ca5-b009-21b2d1c9a850/volumes"
Jul 07 22:17:51.004565 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.004517    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"]
Jul 07 22:17:51.004961 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.004903    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bbd34-8469-4ca5-b009-21b2d1c9a850" containerName="manager"
Jul 07 22:17:51.004961 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.004914    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bbd34-8469-4ca5-b009-21b2d1c9a850" containerName="manager"
Jul 07 22:17:51.004961 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.004942    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b0e6d07-0465-4474-8860-67abce6978ff" containerName="manager"
Jul 07 22:17:51.004961 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.004947    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b0e6d07-0465-4474-8860-67abce6978ff" containerName="manager"
Jul 07 22:17:51.005100 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.005006    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b0e6d07-0465-4474-8860-67abce6978ff" containerName="manager"
Jul 07 22:17:51.005100 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.005017    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8bbd34-8469-4ca5-b009-21b2d1c9a850" containerName="manager"
Jul 07 22:17:51.009200 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.009185    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.012711 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.012692    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k5wq7\""
Jul 07 22:17:51.027575 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.027550    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"]
Jul 07 22:17:51.067883 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.067852    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3e78dca-daed-401c-b29b-c4d37fc69889-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgqcx\" (UID: \"c3e78dca-daed-401c-b29b-c4d37fc69889\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.068035 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.067903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9q55\" (UniqueName: \"kubernetes.io/projected/c3e78dca-daed-401c-b29b-c4d37fc69889-kube-api-access-n9q55\") pod \"kuadrant-operator-controller-manager-86878c769f-wgqcx\" (UID: \"c3e78dca-daed-401c-b29b-c4d37fc69889\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.168801 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.168771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3e78dca-daed-401c-b29b-c4d37fc69889-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgqcx\" (UID: \"c3e78dca-daed-401c-b29b-c4d37fc69889\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.168975 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.168822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9q55\" (UniqueName: \"kubernetes.io/projected/c3e78dca-daed-401c-b29b-c4d37fc69889-kube-api-access-n9q55\") pod \"kuadrant-operator-controller-manager-86878c769f-wgqcx\" (UID: \"c3e78dca-daed-401c-b29b-c4d37fc69889\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.169159 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.169141    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3e78dca-daed-401c-b29b-c4d37fc69889-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wgqcx\" (UID: \"c3e78dca-daed-401c-b29b-c4d37fc69889\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.177234 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.177208    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9q55\" (UniqueName: \"kubernetes.io/projected/c3e78dca-daed-401c-b29b-c4d37fc69889-kube-api-access-n9q55\") pod \"kuadrant-operator-controller-manager-86878c769f-wgqcx\" (UID: \"c3e78dca-daed-401c-b29b-c4d37fc69889\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.318924 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.318831    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:51.463215 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:51.463185    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"]
Jul 07 22:17:51.464360 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:17:51.464332    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e78dca_daed_401c_b29b_c4d37fc69889.slice/crio-8bf5536834b572800269616c45af0bc569f044edbcf3433502d3143d8ea596a6 WatchSource:0}: Error finding container 8bf5536834b572800269616c45af0bc569f044edbcf3433502d3143d8ea596a6: Status 404 returned error can't find the container with id 8bf5536834b572800269616c45af0bc569f044edbcf3433502d3143d8ea596a6
Jul 07 22:17:52.471893 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:52.471859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx" event={"ID":"c3e78dca-daed-401c-b29b-c4d37fc69889","Type":"ContainerStarted","Data":"dfe5606a0810dd8c04ceb7f4e1fe3f8a9c865110ad2822a3e0f92097ad5d9700"}
Jul 07 22:17:52.472276 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:52.471936    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx" event={"ID":"c3e78dca-daed-401c-b29b-c4d37fc69889","Type":"ContainerStarted","Data":"8bf5536834b572800269616c45af0bc569f044edbcf3433502d3143d8ea596a6"}
Jul 07 22:17:52.472276 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:52.471979    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:17:52.492880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:17:52.492833    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx" podStartSLOduration=2.492817981 podStartE2EDuration="2.492817981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:17:52.489056742 +0000 UTC m=+1151.787276095" watchObservedRunningTime="2026-07-07 22:17:52.492817981 +0000 UTC m=+1151.791037331"
Jul 07 22:18:03.479261 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:18:03.479188    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wgqcx"
Jul 07 22:18:41.208243 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:18:41.208124    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:18:41.211180 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:18:41.211161    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:23:41.246159 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:23:41.246034    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:23:41.251656 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:23:41.251629    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:28:41.282701 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:28:41.282663    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:28:41.288198 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:28:41.288175    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:32:21.472141 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.472101    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"]
Jul 07 22:32:21.477166 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.477143    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.479870 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.479849    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7e3dc8-openshift-default-dockercfg-l45fq\""
Jul 07 22:32:21.487654 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.487626    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"]
Jul 07 22:32:21.593605 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-socket\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.593798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b6928f7-7950-4e16-a581-4babf968b1b0-istiod-ca-cert\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.593798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-data\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.593798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-envoy\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.593798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-podinfo\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.593798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqh9\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-kube-api-access-bnqh9\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.593798 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-token\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.594019 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-certs\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.594019 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.593828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-credential-socket\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.694882 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.694843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-socket\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695083 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.694892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b6928f7-7950-4e16-a581-4babf968b1b0-istiod-ca-cert\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695083 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-data\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695222 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-envoy\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695222 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695164    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-podinfo\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695222 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqh9\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-kube-api-access-bnqh9\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695222 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-token\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695509 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695218    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-socket\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695509 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-certs\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695509 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695300    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-credential-socket\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695509 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695425    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-data\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695816 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695681    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b6928f7-7950-4e16-a581-4babf968b1b0-istiod-ca-cert\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.695816 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695802    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-credential-socket\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.696004 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.695859    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-certs\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.697926 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.697904    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-envoy\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.698025 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.697956    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-podinfo\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.702991 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.702970    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqh9\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-kube-api-access-bnqh9\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.703351 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.703335    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-token\") pod \"e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") " pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.789303 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.789267    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:21.932299 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.932264    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"]
Jul 07 22:32:21.932667 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:32:21.932639    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6928f7_7950_4e16_a581_4babf968b1b0.slice/crio-25971f386f8779d5597a4085dd98433957b2decb6f2d7577f349f59c5b00ac96 WatchSource:0}: Error finding container 25971f386f8779d5597a4085dd98433957b2decb6f2d7577f349f59c5b00ac96: Status 404 returned error can't find the container with id 25971f386f8779d5597a4085dd98433957b2decb6f2d7577f349f59c5b00ac96
Jul 07 22:32:21.934840 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.934808    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:32:21.934918 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.934897    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:32:21.934962 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:21.934940    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:32:22.387486 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:22.387442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" event={"ID":"1b6928f7-7950-4e16-a581-4babf968b1b0","Type":"ContainerStarted","Data":"815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2"}
Jul 07 22:32:22.387716 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:22.387506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" event={"ID":"1b6928f7-7950-4e16-a581-4babf968b1b0","Type":"ContainerStarted","Data":"25971f386f8779d5597a4085dd98433957b2decb6f2d7577f349f59c5b00ac96"}
Jul 07 22:32:22.408396 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:22.408340    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" podStartSLOduration=1.408319213 podStartE2EDuration="1.408319213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:32:22.406630409 +0000 UTC m=+2021.704849762" watchObservedRunningTime="2026-07-07 22:32:22.408319213 +0000 UTC m=+2021.706538568"
Jul 07 22:32:22.790262 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:22.790233    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:22.795327 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:22.795304    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:23.395559 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:23.395435    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:23.400140 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:23.400109    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:39.436772 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:39.436723    2567 patch_prober.go:28] interesting pod/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 22:32:39.437250 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:39.436828    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 22:32:40.497410 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:40.497379    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerID="815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2" exitCode=0
Jul 07 22:32:40.497838 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:40.497456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" event={"ID":"1b6928f7-7950-4e16-a581-4babf968b1b0","Type":"ContainerDied","Data":"815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2"}
Jul 07 22:32:40.497942 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:40.497925    2567 scope.go:117] "RemoveContainer" containerID="815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2"
Jul 07 22:32:40.498975 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:40.498948    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:32:40.499034 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:40.499020    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:32:40.499081 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:40.499068    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 22:32:41.504883 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:41.504852    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" event={"ID":"1b6928f7-7950-4e16-a581-4babf968b1b0","Type":"ContainerStarted","Data":"424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f"}
Jul 07 22:32:41.789664 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:41.789577    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:41.789817 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:41.789786    2567 patch_prober.go:28] interesting pod/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 22:32:41.789856 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:41.789840    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 22:32:42.789777 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:42.789735    2567 patch_prober.go:28] interesting pod/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 22:32:42.790269 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:42.789818    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 22:32:43.790744 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:43.790707    2567 patch_prober.go:28] interesting pod/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 22:32:43.791134 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:43.790783    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 22:32:44.790677 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:44.790642    2567 patch_prober.go:28] interesting pod/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 22:32:44.790839 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:44.790715    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 22:32:45.793667 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:45.793637    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:45.794129 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:45.794013    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:32:45.794677 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:32:45.794658    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:33:41.317728 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:33:41.317700    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:33:41.324729 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:33:41.324709    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:35:48.223524 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:48.223488    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"]
Jul 07 22:35:48.224040 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:48.223803    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy" containerID="cri-o://424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f" gracePeriod=30
Jul 07 22:35:53.479946 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.479915    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:35:53.554500 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554468    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-certs\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.554701 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554542    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-token\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.554701 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554566    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-credential-socket\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.554701 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554594    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-socket\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.554880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554720    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b6928f7-7950-4e16-a581-4babf968b1b0-istiod-ca-cert\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.554880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554767    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnqh9\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-kube-api-access-bnqh9\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.554880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554818    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-data\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.554880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554835    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:35:53.554880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554849    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:35:53.554880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554860    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:35:53.554880 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554878    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-envoy\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.555204 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.554968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-podinfo\") pod \"1b6928f7-7950-4e16-a581-4babf968b1b0\" (UID: \"1b6928f7-7950-4e16-a581-4babf968b1b0\") "
Jul 07 22:35:53.555204 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.555080    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b6928f7-7950-4e16-a581-4babf968b1b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:35:53.555342 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.555317    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-certs\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.555342 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.555344    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-credential-socket\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.555525 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.555357    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-workload-socket\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.555525 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.555368    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b6928f7-7950-4e16-a581-4babf968b1b0-istiod-ca-cert\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.555841 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.555818    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:35:53.557092 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.557073    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:35:53.557209 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.557188    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:35:53.557471 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.557441    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-kube-api-access-bnqh9" (OuterVolumeSpecName: "kube-api-access-bnqh9") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "kube-api-access-bnqh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:35:53.557471 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.557454    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b6928f7-7950-4e16-a581-4babf968b1b0" (UID: "1b6928f7-7950-4e16-a581-4babf968b1b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:35:53.606888 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.606854    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerID="424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f" exitCode=0
Jul 07 22:35:53.607046 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.606903    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"
Jul 07 22:35:53.607046 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.606910    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" event={"ID":"1b6928f7-7950-4e16-a581-4babf968b1b0","Type":"ContainerDied","Data":"424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f"}
Jul 07 22:35:53.607046 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.606966    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9" event={"ID":"1b6928f7-7950-4e16-a581-4babf968b1b0","Type":"ContainerDied","Data":"25971f386f8779d5597a4085dd98433957b2decb6f2d7577f349f59c5b00ac96"}
Jul 07 22:35:53.607046 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.606996    2567 scope.go:117] "RemoveContainer" containerID="424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f"
Jul 07 22:35:53.617469 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.617449    2567 scope.go:117] "RemoveContainer" containerID="815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2"
Jul 07 22:35:53.626409 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.626389    2567 scope.go:117] "RemoveContainer" containerID="424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f"
Jul 07 22:35:53.626760 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:35:53.626740    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f\": container with ID starting with 424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f not found: ID does not exist" containerID="424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f"
Jul 07 22:35:53.626842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.626771    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f"} err="failed to get container status \"424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f\": rpc error: code = NotFound desc = could not find container \"424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f\": container with ID starting with 424aab037e39a293d1d1d35201385ff393ec559eea4000860e3559ee566f702f not found: ID does not exist"
Jul 07 22:35:53.626842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.626790    2567 scope.go:117] "RemoveContainer" containerID="815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2"
Jul 07 22:35:53.627065 ip-10-0-128-35 kubenswrapper[2567]: E0707 22:35:53.627041    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2\": container with ID starting with 815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2 not found: ID does not exist" containerID="815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2"
Jul 07 22:35:53.627146 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.627074    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2"} err="failed to get container status \"815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2\": rpc error: code = NotFound desc = could not find container \"815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2\": container with ID starting with 815a79caf03f2f7253a0c10304069677c052f2d26d15ff60c0800b425aa360e2 not found: ID does not exist"
Jul 07 22:35:53.631419 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.631401    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"]
Jul 07 22:35:53.633842 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.633822    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7e3dc8-openshift-default-7d956585bc-94cg9"]
Jul 07 22:35:53.656055 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.656021    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-data\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.656055 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.656048    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-envoy\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.656055 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.656060    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-podinfo\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.656237 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.656071    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-istio-token\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:53.656237 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:53.656086    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnqh9\" (UniqueName: \"kubernetes.io/projected/1b6928f7-7950-4e16-a581-4babf968b1b0-kube-api-access-bnqh9\") on node \"ip-10-0-128-35.ec2.internal\" DevicePath \"\""
Jul 07 22:35:55.251212 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:55.251178    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" path="/var/lib/kubelet/pods/1b6928f7-7950-4e16-a581-4babf968b1b0/volumes"
Jul 07 22:35:55.762512 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:35:55.762481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79c66666c-kkl9h_febe8a7d-ec28-42a2-82cb-f785fa97bab6/authorino/0.log"
Jul 07 22:36:00.441512 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:00.441481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wppzc_612ec492-4ba7-44e5-8720-c91044c6ea04/manager/0.log"
Jul 07 22:36:00.571620 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:00.571592    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4cc5b_27483891-ffe9-498b-a5f9-4883492a5a64/manager/0.log"
Jul 07 22:36:00.818334 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:00.818307    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r7vvd_5c037267-7dc1-47b2-9a35-4235feedb537/server/0.log"
Jul 07 22:36:00.950149 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:00.950114    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kltts_b2a51b0c-d6e6-48d2-98c4-3d840f64540d/manager/0.log"
Jul 07 22:36:01.215784 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:01.215706    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd55458bc-fgll2_a81e4e8d-03a8-4d7c-b5af-5c216b9c477f/copy-manifests/0.log"
Jul 07 22:36:01.229742 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:01.229710    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd55458bc-fgll2_a81e4e8d-03a8-4d7c-b5af-5c216b9c477f/manager/0.log"
Jul 07 22:36:02.172604 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.172516    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg_4f1e9631-4521-44dd-970b-cdb6143eee52/util/0.log"
Jul 07 22:36:02.179258 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.179239    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg_4f1e9631-4521-44dd-970b-cdb6143eee52/pull/0.log"
Jul 07 22:36:02.185968 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.185944    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg_4f1e9631-4521-44dd-970b-cdb6143eee52/extract/0.log"
Jul 07 22:36:02.301897 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.301866    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878_97f719e0-a780-40d7-9f45-f65543e1e148/util/0.log"
Jul 07 22:36:02.308519 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.308497    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878_97f719e0-a780-40d7-9f45-f65543e1e148/pull/0.log"
Jul 07 22:36:02.314917 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.314893    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878_97f719e0-a780-40d7-9f45-f65543e1e148/extract/0.log"
Jul 07 22:36:02.432890 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.432809    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6_11035410-8054-4835-a84a-97750e736c6c/util/0.log"
Jul 07 22:36:02.446890 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.446862    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6_11035410-8054-4835-a84a-97750e736c6c/pull/0.log"
Jul 07 22:36:02.453763 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.453735    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6_11035410-8054-4835-a84a-97750e736c6c/extract/0.log"
Jul 07 22:36:02.567811 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.567760    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv_3c1f7168-eab8-4b21-8b4c-9e223025c89f/util/0.log"
Jul 07 22:36:02.574772 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.574749    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv_3c1f7168-eab8-4b21-8b4c-9e223025c89f/pull/0.log"
Jul 07 22:36:02.581633 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.581614    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv_3c1f7168-eab8-4b21-8b4c-9e223025c89f/extract/0.log"
Jul 07 22:36:02.698319 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.698243    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79c66666c-kkl9h_febe8a7d-ec28-42a2-82cb-f785fa97bab6/authorino/0.log"
Jul 07 22:36:02.816903 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.816873    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xgzhh_56c007dd-9adb-45b2-b6b3-c2de1e44d414/manager/0.log"
Jul 07 22:36:02.933981 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:02.933952    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kh5m9_9f765ce5-19d7-4410-8c9a-17c8edb044f3/manager/0.log"
Jul 07 22:36:03.040435 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:03.040406    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k79pj_edbc7aa2-af11-4860-bc1f-04a53469b1f7/kuadrant-console-plugin/0.log"
Jul 07 22:36:03.165666 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:03.165636    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mgt87_c11e4022-b037-4eed-9bcd-bdb93128b249/registry-server/0.log"
Jul 07 22:36:03.293887 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:03.293816    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wgqcx_c3e78dca-daed-401c-b29b-c4d37fc69889/manager/0.log"
Jul 07 22:36:04.136884 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:04.136854    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98fbf9c8c-psf28_b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0/kube-auth-proxy/0.log"
Jul 07 22:36:04.382565 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:04.382519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-48d5r_2b6ca15d-7931-47d0-aabe-8e497235dcc9/istio-proxy/1.log"
Jul 07 22:36:04.502490 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:04.502415    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sxn8j_a1ac2c26-52f8-4989-8ca1-cb3487d75673/payload-pre-processing/0.log"
Jul 07 22:36:04.624107 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:04.624075    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9d8v6_376e4911-420f-425e-84b5-437e86b34c65/payload-processing/0.log"
Jul 07 22:36:04.744154 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:04.744116    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f58964cdf-9k4jp_3fec479e-1fb0-4c6a-a8ee-e7b8171b6439/router/0.log"
Jul 07 22:36:05.097115 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:05.097084    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-59grx_4fe0a2c0-88b7-48fd-8e01-2fe7f691f304/main/0.log"
Jul 07 22:36:05.213904 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:05.213872    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2bttt_c17cd772-0d20-4d09-b103-010e83b15d07/main/0.log"
Jul 07 22:36:05.445616 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:05.445526    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbkj66d_4b1dd67a-f567-488f-a772-9a04181db01b/main/0.log"
Jul 07 22:36:05.685020 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:05.684984    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-4qzn7_0ebbb3b8-b85d-41a3-beb2-96029d3f8b8e/main/0.log"
Jul 07 22:36:12.827715 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:12.827682    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hrp64_e731550a-f9e4-4dcc-8753-211daa613598/global-pull-secret-syncer/0.log"
Jul 07 22:36:12.952738 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:12.952707    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jmrp6_d208d9b2-8e9e-4af0-88b8-306fedbcaf86/konnectivity-agent/0.log"
Jul 07 22:36:13.002519 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:13.002482    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-35.ec2.internal_120a20f30fe5c9ca002daa23d04a4b05/haproxy/0.log"
Jul 07 22:36:17.804954 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:17.804925    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg_4f1e9631-4521-44dd-970b-cdb6143eee52/extract/0.log"
Jul 07 22:36:17.836435 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:17.836406    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg_4f1e9631-4521-44dd-970b-cdb6143eee52/util/0.log"
Jul 07 22:36:17.867788 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:17.867767    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759frgfg_4f1e9631-4521-44dd-970b-cdb6143eee52/pull/0.log"
Jul 07 22:36:17.910094 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:17.910063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878_97f719e0-a780-40d7-9f45-f65543e1e148/extract/0.log"
Jul 07 22:36:17.934969 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:17.934948    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878_97f719e0-a780-40d7-9f45-f65543e1e148/util/0.log"
Jul 07 22:36:17.973379 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:17.973354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jv878_97f719e0-a780-40d7-9f45-f65543e1e148/pull/0.log"
Jul 07 22:36:18.006727 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.006704    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6_11035410-8054-4835-a84a-97750e736c6c/extract/0.log"
Jul 07 22:36:18.031273 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.031243    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6_11035410-8054-4835-a84a-97750e736c6c/util/0.log"
Jul 07 22:36:18.055772 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.055701    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r65d6_11035410-8054-4835-a84a-97750e736c6c/pull/0.log"
Jul 07 22:36:18.093229 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.093204    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv_3c1f7168-eab8-4b21-8b4c-9e223025c89f/extract/0.log"
Jul 07 22:36:18.117893 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.117872    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv_3c1f7168-eab8-4b21-8b4c-9e223025c89f/util/0.log"
Jul 07 22:36:18.148526 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.148500    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zglrv_3c1f7168-eab8-4b21-8b4c-9e223025c89f/pull/0.log"
Jul 07 22:36:18.399775 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.399695    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79c66666c-kkl9h_febe8a7d-ec28-42a2-82cb-f785fa97bab6/authorino/0.log"
Jul 07 22:36:18.429933 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.429905    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xgzhh_56c007dd-9adb-45b2-b6b3-c2de1e44d414/manager/0.log"
Jul 07 22:36:18.465969 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.465944    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kh5m9_9f765ce5-19d7-4410-8c9a-17c8edb044f3/manager/0.log"
Jul 07 22:36:18.497845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.497821    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k79pj_edbc7aa2-af11-4860-bc1f-04a53469b1f7/kuadrant-console-plugin/0.log"
Jul 07 22:36:18.538250 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.538224    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mgt87_c11e4022-b037-4eed-9bcd-bdb93128b249/registry-server/0.log"
Jul 07 22:36:18.651835 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:18.651746    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wgqcx_c3e78dca-daed-401c-b29b-c4d37fc69889/manager/0.log"
Jul 07 22:36:20.864400 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:20.864314    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxj9k_2ca0bb30-7001-4bf1-99ca-58ed330c60cd/node-exporter/0.log"
Jul 07 22:36:20.890114 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:20.890085    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxj9k_2ca0bb30-7001-4bf1-99ca-58ed330c60cd/kube-rbac-proxy/0.log"
Jul 07 22:36:20.915311 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:20.915281    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxj9k_2ca0bb30-7001-4bf1-99ca-58ed330c60cd/init-textfile/0.log"
Jul 07 22:36:23.331453 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.331413    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"]
Jul 07 22:36:23.331905 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.331859    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy"
Jul 07 22:36:23.331905 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.331872    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy"
Jul 07 22:36:23.331905 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.331882    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy"
Jul 07 22:36:23.331905 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.331887    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy"
Jul 07 22:36:23.332067 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.331949    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy"
Jul 07 22:36:23.332067 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.331956    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6928f7-7950-4e16-a581-4babf968b1b0" containerName="istio-proxy"
Jul 07 22:36:23.335122 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.335100    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.337587 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.337564    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh6z7\"/\"kube-root-ca.crt\""
Jul 07 22:36:23.337690 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.337618    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh6z7\"/\"openshift-service-ca.crt\""
Jul 07 22:36:23.338731 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.338710    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wh6z7\"/\"default-dockercfg-bhddq\""
Jul 07 22:36:23.344645 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.344616    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"]
Jul 07 22:36:23.422004 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.421962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkgjz\" (UniqueName: \"kubernetes.io/projected/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-kube-api-access-jkgjz\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.422180 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.422077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-podres\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.422180 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.422107    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-lib-modules\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.422180 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.422129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-sys\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.422290 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.422185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-proc\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.521310 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.521283    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/1.log"
Jul 07 22:36:23.522630 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkgjz\" (UniqueName: \"kubernetes.io/projected/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-kube-api-access-jkgjz\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.522713 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-podres\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.522713 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-lib-modules\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.522820 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-sys\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.522820 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522794    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-sys\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.522918 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522838    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-lib-modules\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.522918 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522859    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-podres\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.522918 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-proc\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.523076 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.522917    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-proc\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.526266 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.526248    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-t9xql_0ceca531-7113-4e27-b88b-fe978af02515/console-operator/2.log"
Jul 07 22:36:23.531520 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.531501    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkgjz\" (UniqueName: \"kubernetes.io/projected/bc146ddd-c02c-4e09-8186-3def4d1bf2a8-kube-api-access-jkgjz\") pod \"perf-node-gather-daemonset-6r4hg\" (UID: \"bc146ddd-c02c-4e09-8186-3def4d1bf2a8\") " pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.646728 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.646643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:23.785962 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:23.785936    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"]
Jul 07 22:36:23.787194 ip-10-0-128-35 kubenswrapper[2567]: W0707 22:36:23.787167    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc146ddd_c02c_4e09_8186_3def4d1bf2a8.slice/crio-7b1bd2c02f2a007e6a1b35c7eb084c6959c96161e8fb45ae36925eaab08a7efe WatchSource:0}: Error finding container 7b1bd2c02f2a007e6a1b35c7eb084c6959c96161e8fb45ae36925eaab08a7efe: Status 404 returned error can't find the container with id 7b1bd2c02f2a007e6a1b35c7eb084c6959c96161e8fb45ae36925eaab08a7efe
Jul 07 22:36:24.154977 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:24.154949    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-2w99d_a31cc548-4b33-40a4-a9d5-2aacb0769c41/download-server/0.log"
Jul 07 22:36:24.784424 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:24.784394    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg" event={"ID":"bc146ddd-c02c-4e09-8186-3def4d1bf2a8","Type":"ContainerStarted","Data":"793f6628c057dd0082ccb390460fdbc574f205c50e1d20dfc21a698a7b1585b2"}
Jul 07 22:36:24.784820 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:24.784451    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg" event={"ID":"bc146ddd-c02c-4e09-8186-3def4d1bf2a8","Type":"ContainerStarted","Data":"7b1bd2c02f2a007e6a1b35c7eb084c6959c96161e8fb45ae36925eaab08a7efe"}
Jul 07 22:36:24.784820 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:24.784507    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:24.802175 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:24.802131    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg" podStartSLOduration=1.802116872 podStartE2EDuration="1.802116872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:36:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:36:24.799989697 +0000 UTC m=+2264.098209049" watchObservedRunningTime="2026-07-07 22:36:24.802116872 +0000 UTC m=+2264.100336223"
Jul 07 22:36:25.902469 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:25.902444    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rcm4p_135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d/dns/0.log"
Jul 07 22:36:25.926433 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:25.926403    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rcm4p_135699d8-a1c1-44b8-9f3f-71e5a5ca3d8d/kube-rbac-proxy/0.log"
Jul 07 22:36:25.974524 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:25.974503    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mpgz9_efee0fac-b0f6-48cb-bc56-7102d99df282/dns-node-resolver/0.log"
Jul 07 22:36:26.531412 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:26.531382    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f8c66bb86-8z548_bccd42ad-cdf2-487d-a03a-d688cf0098e8/registry/0.log"
Jul 07 22:36:26.576603 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:26.576577    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9vcl9_0d7e7a42-1558-456a-be23-2c6b973ad1a4/node-ca/0.log"
Jul 07 22:36:27.669986 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:27.669958    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98fbf9c8c-psf28_b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0/kube-auth-proxy/0.log"
Jul 07 22:36:27.727844 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:27.727814    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-48d5r_2b6ca15d-7931-47d0-aabe-8e497235dcc9/istio-proxy/0.log"
Jul 07 22:36:27.754602 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:27.754573    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-48d5r_2b6ca15d-7931-47d0-aabe-8e497235dcc9/istio-proxy/1.log"
Jul 07 22:36:27.792950 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:27.792923    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sxn8j_a1ac2c26-52f8-4989-8ca1-cb3487d75673/payload-pre-processing/0.log"
Jul 07 22:36:27.839223 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:27.839196    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9d8v6_376e4911-420f-425e-84b5-437e86b34c65/payload-processing/0.log"
Jul 07 22:36:27.863043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:27.863021    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f58964cdf-9k4jp_3fec479e-1fb0-4c6a-a8ee-e7b8171b6439/router/0.log"
Jul 07 22:36:28.594289 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:28.594259    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfsvp_98f0faa1-778b-42c0-adf4-44c989bc68e5/serve-healthcheck-canary/0.log"
Jul 07 22:36:29.092040 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:29.092005    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xfgmq_cad384a6-548d-4dd5-a3fc-808c6db4ae10/insights-operator/0.log"
Jul 07 22:36:29.092636 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:29.092378    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xfgmq_cad384a6-548d-4dd5-a3fc-808c6db4ae10/insights-operator/1.log"
Jul 07 22:36:29.186505 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:29.186466    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jf64n_a9c7e19e-3417-4884-bcb0-73329e6d5096/kube-rbac-proxy/0.log"
Jul 07 22:36:29.212255 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:29.212225    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jf64n_a9c7e19e-3417-4884-bcb0-73329e6d5096/exporter/0.log"
Jul 07 22:36:29.235801 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:29.235776    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jf64n_a9c7e19e-3417-4884-bcb0-73329e6d5096/extractor/0.log"
Jul 07 22:36:30.800030 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:30.800001    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wh6z7/perf-node-gather-daemonset-6r4hg"
Jul 07 22:36:31.441845 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:31.441816    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wppzc_612ec492-4ba7-44e5-8720-c91044c6ea04/manager/0.log"
Jul 07 22:36:31.553337 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:31.553304    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4cc5b_27483891-ffe9-498b-a5f9-4883492a5a64/manager/0.log"
Jul 07 22:36:31.687363 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:31.687336    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r7vvd_5c037267-7dc1-47b2-9a35-4235feedb537/server/0.log"
Jul 07 22:36:31.752029 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:31.751952    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kltts_b2a51b0c-d6e6-48d2-98c4-3d840f64540d/manager/0.log"
Jul 07 22:36:31.868510 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:31.868485    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd55458bc-fgll2_a81e4e8d-03a8-4d7c-b5af-5c216b9c477f/manager/0.log"
Jul 07 22:36:31.888628 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:31.888605    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd55458bc-fgll2_a81e4e8d-03a8-4d7c-b5af-5c216b9c477f/copy-manifests/0.log"
Jul 07 22:36:33.399066 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:33.399039    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wqqzx_34778705-f473-4227-be85-d5a4712bb544/openshift-lws-operator/0.log"
Jul 07 22:36:34.678234 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:34.678202    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98fbf9c8c-psf28_b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0/kube-auth-proxy/0.log"
Jul 07 22:36:34.763017 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:34.762989    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-48d5r_2b6ca15d-7931-47d0-aabe-8e497235dcc9/istio-proxy/0.log"
Jul 07 22:36:34.793461 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:34.793433    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-48d5r_2b6ca15d-7931-47d0-aabe-8e497235dcc9/istio-proxy/1.log"
Jul 07 22:36:34.829181 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:34.829155    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sxn8j_a1ac2c26-52f8-4989-8ca1-cb3487d75673/payload-pre-processing/0.log"
Jul 07 22:36:34.868432 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:34.868402    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9d8v6_376e4911-420f-425e-84b5-437e86b34c65/payload-processing/0.log"
Jul 07 22:36:34.885112 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:34.885081    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f58964cdf-9k4jp_3fec479e-1fb0-4c6a-a8ee-e7b8171b6439/router/0.log"
Jul 07 22:36:36.352746 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:36.352723    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98fbf9c8c-psf28_b0b0e6a3-b861-4a2e-9ed1-b7bae84583a0/kube-auth-proxy/0.log"
Jul 07 22:36:36.395474 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:36.395441    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-48d5r_2b6ca15d-7931-47d0-aabe-8e497235dcc9/istio-proxy/0.log"
Jul 07 22:36:36.426459 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:36.426426    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-48d5r_2b6ca15d-7931-47d0-aabe-8e497235dcc9/istio-proxy/1.log"
Jul 07 22:36:36.455417 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:36.455387    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sxn8j_a1ac2c26-52f8-4989-8ca1-cb3487d75673/payload-pre-processing/0.log"
Jul 07 22:36:36.492133 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:36.492103    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9d8v6_376e4911-420f-425e-84b5-437e86b34c65/payload-processing/0.log"
Jul 07 22:36:36.511221 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:36.511193    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f58964cdf-9k4jp_3fec479e-1fb0-4c6a-a8ee-e7b8171b6439/router/0.log"
Jul 07 22:36:39.075043 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:39.075005    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-tsnb8_5df4e0ac-5f34-4fac-92b2-dfaf96d5063a/kube-storage-version-migrator-operator/1.log"
Jul 07 22:36:39.075762 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:39.075744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-tsnb8_5df4e0ac-5f34-4fac-92b2-dfaf96d5063a/kube-storage-version-migrator-operator/0.log"
Jul 07 22:36:40.102733 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.102690    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5kvl4_33409e67-7d89-476d-9635-d83b1becf01d/kube-multus/0.log"
Jul 07 22:36:40.129322 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.129296    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdkwg_db63a0f2-4105-4fa5-ae4f-290e1631b761/kube-multus-additional-cni-plugins/0.log"
Jul 07 22:36:40.155449 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.155425    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdkwg_db63a0f2-4105-4fa5-ae4f-290e1631b761/egress-router-binary-copy/0.log"
Jul 07 22:36:40.179848 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.179822    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdkwg_db63a0f2-4105-4fa5-ae4f-290e1631b761/cni-plugins/0.log"
Jul 07 22:36:40.203145 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.203115    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdkwg_db63a0f2-4105-4fa5-ae4f-290e1631b761/bond-cni-plugin/0.log"
Jul 07 22:36:40.226030 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.226006    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdkwg_db63a0f2-4105-4fa5-ae4f-290e1631b761/routeoverride-cni/0.log"
Jul 07 22:36:40.248670 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.248649    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdkwg_db63a0f2-4105-4fa5-ae4f-290e1631b761/whereabouts-cni-bincopy/0.log"
Jul 07 22:36:40.273128 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.273111    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdkwg_db63a0f2-4105-4fa5-ae4f-290e1631b761/whereabouts-cni/0.log"
Jul 07 22:36:40.743618 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.743588    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j4m6v_f27fff47-fac3-41e3-888d-51dd9379d416/network-metrics-daemon/0.log"
Jul 07 22:36:40.765703 ip-10-0-128-35 kubenswrapper[2567]: I0707 22:36:40.765681    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j4m6v_f27fff47-fac3-41e3-888d-51dd9379d416/kube-rbac-proxy/0.log"