Jul 09 22:32:38.400047 ip-10-0-132-100 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 22:32:38.804009 ip-10-0-132-100 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:32:38.804009 ip-10-0-132-100 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 22:32:38.804009 ip-10-0-132-100 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:32:38.804009 ip-10-0-132-100 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 22:32:38.804009 ip-10-0-132-100 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:32:38.805842 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.805744    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 22:32:38.811313 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811296    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:38.811313 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811310    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:38.811313 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811315    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:38.811313 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811319    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811326    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811331    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811337    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811341    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811344    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811348    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811352    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811355    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811359    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811362    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811366    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811369    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811373    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811376    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811380    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811383    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811387    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811391    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811394    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:38.811529 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811398    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811401    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811404    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811408    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811412    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811416    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811420    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811424    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811428    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811432    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811437    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811441    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811448    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811453    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811458    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811463    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811468    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811472    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811475    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:38.812277 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811480    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811484    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811487    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811492    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811496    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811499    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811503    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811508    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811511    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811515    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811519    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811523    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811526    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811530    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811533    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811537    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811540    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811544    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811548    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811552    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:38.812704 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811556    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811562    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811568    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811571    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811576    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811580    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811584    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811588    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811592    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811598    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811603    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811607    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811611    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811615    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811619    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811622    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811626    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811630    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811634    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:38.813182 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811638    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811641    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811645    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811649    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811653    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811656    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811660    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811664    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811668    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811672    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811676    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811679    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811684    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811688    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811699    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811703    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811706    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:38.813597 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.811710    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:38.814330 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814316    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:38.814330 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814329    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814334    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814339    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814344    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814348    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814352    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814357    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814361    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814365    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814369    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814373    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814377    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814381    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814385    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814388    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814392    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814396    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814399    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814403    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814407    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:38.814433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814411    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814414    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814418    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814422    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814426    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814429    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814433    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814437    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814441    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814445    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814448    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814452    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814456    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814459    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814463    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814467    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814471    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814475    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814480    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814483    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:38.815240 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814487    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814490    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814494    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814498    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814501    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814505    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814508    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814512    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814516    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814520    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814524    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814528    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814532    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814536    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814541    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814545    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814549    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814553    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814557    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814561    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:38.816049 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814565    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814568    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814573    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814576    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814580    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814584    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814588    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814591    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814595    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814599    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814605    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814611    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814615    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814620    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814626    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814631    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814636    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814640    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814644    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:38.816885 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814649    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814653    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814657    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814661    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814665    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814670    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814674    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814678    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814681    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814687    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814701    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814706    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814711    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814715    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814719    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814723    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814727    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814730    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.814734    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:38.817594 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815276    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815284    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815288    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815292    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815296    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815300    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815304    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815308    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815312    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815316    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815320    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815324    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815328    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815332    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815336    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815339    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815343    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815347    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815352    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815356    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:38.818072 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815360    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815366    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815371    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815377    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815383    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815389    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815393    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815397    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815401    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815407    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815410    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815414    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815418    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815421    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815425    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815429    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815433    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815436    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815441    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:38.818595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815445    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815448    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815452    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815455    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815459    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815463    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815467    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815471    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815474    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815479    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815483    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815487    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815491    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815494    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815498    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815502    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815507    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815510    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815514    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815518    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:38.819137 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815521    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815525    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815529    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815532    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815536    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815540    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815544    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815548    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815551    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815555    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815559    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815563    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815567    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815571    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815575    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815579    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815583    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815586    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815594    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815598    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:38.819579 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815602    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815605    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815610    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815613    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815618    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815621    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815625    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815629    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815633    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815637    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815641    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815645    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815649    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815653    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815657    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815661    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815664    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815668    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815672    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.815676    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:38.820090 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815793    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815802    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815810    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815816    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815821    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815827    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815833    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815840    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815844    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815849    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815855    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815860    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815864    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815869    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815873    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815878    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815882    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815887    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815894    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815898    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815902    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815907    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815912    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815917    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 22:32:38.820525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815922    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815926    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815931    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815935    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815939    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815944    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815948    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815953    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815958    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815963    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815967    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815972    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815976    2576 flags.go:64] FLAG: --enable-server="true"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815981    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815988    2576 flags.go:64] FLAG: --event-burst="100"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815992    2576 flags.go:64] FLAG: --event-qps="50"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.815997    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816001    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816007    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816012    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816016    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816021    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816026    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816031    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816035    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 22:32:38.821095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816039    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816044    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816048    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816052    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816056    2576 flags.go:64] FLAG: --feature-gates=""
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816061    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816066    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816070    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816074    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816079    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816084    2576 flags.go:64] FLAG: --help="false"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816088    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-132-100.ec2.internal"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816093    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816098    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816102    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816107    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816112    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816116    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816120    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816125    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816129    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816133    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816139    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816143    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 09 22:32:38.821708 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816147    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816151    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816156    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816160    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816166    2576 flags.go:64] FLAG: --lock-file=""
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816171    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816175    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816203    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816212    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816217    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816221    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816226    2576 flags.go:64] FLAG: --logging-format="text"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816230    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816235    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816240    2576 flags.go:64] FLAG: --manifest-url=""
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816244    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816250    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816254    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816260    2576 flags.go:64] FLAG: --max-pods="110"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816264    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816269    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816273    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816277    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816281    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816286    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 22:32:38.822270 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816290    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816304    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816309    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816313    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816318    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816322    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816727    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816732    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816737    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816741    2576 flags.go:64] FLAG: --port="10250"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816745    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816752    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03389d887d863d3a2"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816757    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816761    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816784    2576 flags.go:64] FLAG: --register-node="true"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816789    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816794    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816798    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816802    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816806    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816812    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816816    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816820    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816824    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816829    2576 flags.go:64] FLAG: --runonce="false"
Jul 09 22:32:38.822860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816833    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816839    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816843    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816847    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816851    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816856    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816861    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816865    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816869    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816874    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816878    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816882    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816886    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816890    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816895    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816903    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816907    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816911    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816920    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816924    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816928    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816932    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816936    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816940    2576 flags.go:64] FLAG: --v="2"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816946    2576 flags.go:64] FLAG: --version="false"
Jul 09 22:32:38.823843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816951    2576 flags.go:64] FLAG: --vmodule=""
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816956    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.816961    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817117    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817123    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817127    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817131    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817136    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817139    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817143    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817147    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817151    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817155    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817158    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817162    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817166    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817170    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817174    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817178    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817181    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:38.824399 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817185    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817189    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817193    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817198    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817201    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817207    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817211    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817215    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817219    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817223    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817226    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817230    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817234    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817240    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817245    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817249    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817254    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817258    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817262    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:38.824909 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817266    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817269    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817273    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817277    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817280    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817284    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817290    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817294    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817298    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817302    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817306    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817309    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817313    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817317    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817321    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817324    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817329    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817332    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817338    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817342    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:38.825341 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817345    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817349    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817353    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817357    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817361    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817367    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817372    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817376    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817380    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817383    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817387    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817391    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817395    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817399    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817402    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817406    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817410    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817414    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817419    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817422    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:38.825869 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817426    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817430    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817434    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817438    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817441    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817445    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817449    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817453    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817457    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817461    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817467    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817470    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817474    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817478    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817482    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817486    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817490    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817494    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817498    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:38.826300 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817502    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:38.826728 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817507    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:38.826728 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817512    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:38.826728 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.817517    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:38.826728 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.818100    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:32:38.827034 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.827016    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 22:32:38.827064 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.827034    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 22:32:38.827064 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.827050    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 22:32:38.827064 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.827055    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 22:32:38.827131 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827115    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:38.827131 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827120    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:38.827131 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827123    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:38.827131 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827126    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:38.827131 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827129    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:38.827131 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827131    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:38.827131 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827134    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827137    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827140    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827143    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827146    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827148    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827151    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827153    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827155    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827158    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827160    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827164    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827167    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827170    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827173    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827176    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827178    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827181    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827183    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:38.827293 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827186    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827188    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827191    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827193    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827195    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827198    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827200    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827203    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827205    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827208    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827210    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827213    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827216    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827219    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827222    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827225    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827228    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827231    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827233    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:38.827711 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827236    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827239    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827242    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827244    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827247    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827249    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827251    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827253    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827256    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827258    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827261    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827263    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827265    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827268    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827270    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827272    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827274    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827277    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827279    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827282    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:38.828151 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827284    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827286    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827288    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827291    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827293    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827295    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827298    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827300    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827303    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827306    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827308    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827311    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827313    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827315    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827318    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827320    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827323    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827325    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827327    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827330    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:38.828595 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827332    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827334    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827336    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827339    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827341    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827344    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827346    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827348    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827351    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827353    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827355    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827358    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827360    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827362    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827365    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:38.829065 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.827369    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827469    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827473    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827476    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827479    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827482    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827485    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827487    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827490    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827492    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827494    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827497    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827499    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827502    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827504    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827507    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827510    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827512    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827515    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:32:38.829408 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827517    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827519    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827522    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827524    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827527    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827529    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827531    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827533    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827536    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827538    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827541    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827543    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827545    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827549    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827552    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827555    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827558    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827560    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827563    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:32:38.829861 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827565    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827568    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827570    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827572    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827575    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827577    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827579    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827581    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827584    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827586    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827588    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827591    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827593    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827595    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827598    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827600    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827602    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827605    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827607    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827609    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:32:38.830317 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827612    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827614    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827616    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827618    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827621    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827623    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827625    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827628    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827630    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827632    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827635    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827637    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827639    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827642    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827644    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827648    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827651    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827653    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827656    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827659    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:32:38.830755 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827661    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827664    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827667    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827669    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827672    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827674    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827676    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827679    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827681    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827684    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827686    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827688    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827697    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827700    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827702    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827705    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827707    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827709    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827712    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827716    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:32:38.831287 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827719    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:32:38.831855 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:38.827722    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:32:38.831855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.827727    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:32:38.831855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.827838    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 22:32:38.831855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.829981    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 22:32:38.831855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.831422    2576 server.go:1019] "Starting client certificate rotation"
Jul 09 22:32:38.831855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.831530    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:32:38.831855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.831575    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:32:38.833828 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.833814    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:32:38.834836 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.834815    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:32:38.846815 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.846795    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 09 22:32:38.850078 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.850063    2576 log.go:25] "Validated CRI v1 image API"
Jul 09 22:32:38.850805 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.850790    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 22:32:38.853005 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.852988    2576 fs.go:135] Filesystem UUIDs: map[06ac7a03-d8c2-43fc-b569-5396e6820669:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8bd5746c-b422-47f0-90b0-24f15401c1d4:/dev/nvme0n1p4]
Jul 09 22:32:38.853059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.853005    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 22:32:38.857790 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.857667    2576 manager.go:216] Machine: {Timestamp:2026-07-09 22:32:38.856275477 +0000 UTC m=+0.338098852 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098517 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec282d5ca7ed002556b6d8e6c4b44d8c SystemUUID:ec282d5c-a7ed-0025-56b6-d8e6c4b44d8c BootID:34fb3bfe-b625-40fd-998d-e8eca60a3d64 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7e:0c:7e:25:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7e:0c:7e:25:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:da:0c:de:5d:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 22:32:38.857790 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.857786    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 22:32:38.857899 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.857854    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 22:32:38.858173 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.858159    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:32:38.860676 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.860654    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 22:32:38.860828 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.860677    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 22:32:38.861890 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.861881    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 22:32:38.861921 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.861892    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 22:32:38.861921 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.861899    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:32:38.862475 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.862466    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:32:38.863603 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.863594    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 22:32:38.866335 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866325    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:32:38.866441 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866432    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 22:32:38.866475 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866460    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 22:32:38.866475 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866468    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 22:32:38.866536 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866479    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 22:32:38.866536 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866487    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 09 22:32:38.866536 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866495    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 22:32:38.866844 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866832    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:32:38.866875 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.866851    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:32:38.868725 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.868711    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 22:32:38.870566 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.870552    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 22:32:38.870640 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.870579    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 22:32:38.871621 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871611    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 22:32:38.871653 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871626    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 22:32:38.871653 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871632    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 22:32:38.871653 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871646    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871655    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871660    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871668    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871672    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871678    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871683    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871705    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 22:32:38.871750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.871712    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 22:32:38.872648 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.872639    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 22:32:38.872648 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.872648    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 22:32:38.875359 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.875347    2576 server.go:1268] "Started kubelet"
Jul 09 22:32:38.875467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.875409    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 22:32:38.875531 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.875483    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 22:32:38.875531 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.875449    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 22:32:38.876122 ip-10-0-132-100 systemd[1]: Started Kubernetes Kubelet.
Jul 09 22:32:38.876424 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.876398    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 22:32:38.876424 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.876405    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 22:32:38.876533 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.876428    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 22:32:38.877274 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.877253    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlkx9"
Jul 09 22:32:38.877441 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.877431    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 22:32:38.880712 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.880678    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 22:32:38.881860 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.881832    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 22:32:38.884258 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.884241    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zlkx9"
Jul 09 22:32:38.886608 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.886595    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 22:32:38.886681 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.886608    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 22:32:38.886791 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.886688    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:38.887151 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887134    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 22:32:38.887151 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887136    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 22:32:38.887285 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887162    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 22:32:38.887328 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887289    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 22:32:38.887328 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887297    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 22:32:38.887433 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887349    2576 factory.go:55] Registering systemd factory
Jul 09 22:32:38.887433 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887362    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 09 22:32:38.887433 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.886376    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-100.ec2.internal.18c0bfd17b3c1ece  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-100.ec2.internal,UID:ip-10-0-132-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-100.ec2.internal,},FirstTimestamp:2026-07-09 22:32:38.87532411 +0000 UTC m=+0.357147483,LastTimestamp:2026-07-09 22:32:38.87532411 +0000 UTC m=+0.357147483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-100.ec2.internal,}"
Jul 09 22:32:38.887592 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887582    2576 factory.go:153] Registering CRI-O factory
Jul 09 22:32:38.887637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887594    2576 factory.go:223] Registration of the crio container factory successfully
Jul 09 22:32:38.887637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887634    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 22:32:38.887743 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887655    2576 factory.go:103] Registering Raw factory
Jul 09 22:32:38.887743 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.887667    2576 manager.go:1196] Started watching for new ooms in manager
Jul 09 22:32:38.888063 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.888051    2576 manager.go:349] Starting recovery of all containers
Jul 09 22:32:38.894993 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.894959    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:38.899044 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.899029    2576 manager.go:354] Recovery completed
Jul 09 22:32:38.900980 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.900949    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-100.ec2.internal\" not found" node="ip-10-0-132-100.ec2.internal"
Jul 09 22:32:38.903326 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.903315    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:38.904916 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.904896    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:38.904952 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.904922    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:38.904952 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.904933    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:38.905410 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.905398    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 22:32:38.905410 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.905408    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 22:32:38.905488 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.905423    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:32:38.905488 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.905398    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:38.906405 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.906387    2576 policy_none.go:49] "None policy: Start"
Jul 09 22:32:38.906487 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.906409    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 22:32:38.906487 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.906426    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 22:32:38.906582 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.906524    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:38.906582 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.906562    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:38.906582 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.906577    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:38.907991 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.907978    2576 policy_none.go:47] "Start"
Jul 09 22:32:38.937351 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.937248    2576 manager.go:337] "Starting Device Plugin manager"
Jul 09 22:32:38.937430 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.937365    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 22:32:38.937430 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.937374    2576 server.go:87] "Starting device plugin registration server"
Jul 09 22:32:38.937589 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.937580    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 22:32:38.937617 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.937591    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 22:32:38.937713 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.937687    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 22:32:38.937826 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.937814    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 22:32:38.937880 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:38.937827    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 22:32:38.938223 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.938207    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 22:32:38.938299 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:38.938246    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.035391 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.035365    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 22:32:39.036485 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.036466    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 22:32:39.036539 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.036513    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 22:32:39.036574 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.036539    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 22:32:39.036615 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.036577    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 22:32:39.037710 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.037685    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:39.038415 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.038399    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:39.038501 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.038430    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:39.038501 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.038445    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:39.038501 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.038473    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.038903 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.038891    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:39.045931 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.045919    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.045971 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.045938    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-100.ec2.internal\": node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.059496 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.059480    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.137221 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.137186    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"]
Jul 09 22:32:39.137306 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.137253    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:39.138015 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.138000    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:39.138060 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.138033    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:39.138060 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.138045    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:39.139227 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139216    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:39.139326 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139312    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.139370 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139343    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:39.139834 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139822    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:39.139907 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139842    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:39.139907 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139854    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:39.139907 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139879    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:39.139907 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139889    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:39.139907 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.139858    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:39.141149 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.141136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.141225 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.141162    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:32:39.141756 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.141742    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:32:39.141825 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.141762    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:32:39.141825 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.141790    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:32:39.160155 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.160140    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.164262 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.164245    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-100.ec2.internal\" not found" node="ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.168364 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.168350    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-100.ec2.internal\" not found" node="ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.189968 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.189933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2402c47062fa63a1f829c94ee7d64289-config\") pod \"kube-apiserver-proxy-ip-10-0-132-100.ec2.internal\" (UID: \"2402c47062fa63a1f829c94ee7d64289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.189968 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.189953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3d76fef6e121628f428c5fedb919a71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal\" (UID: \"f3d76fef6e121628f428c5fedb919a71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.190045 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.189975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3d76fef6e121628f428c5fedb919a71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal\" (UID: \"f3d76fef6e121628f428c5fedb919a71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.260760 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.260744    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.291079 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.291056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2402c47062fa63a1f829c94ee7d64289-config\") pod \"kube-apiserver-proxy-ip-10-0-132-100.ec2.internal\" (UID: \"2402c47062fa63a1f829c94ee7d64289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.291153 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.291087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3d76fef6e121628f428c5fedb919a71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal\" (UID: \"f3d76fef6e121628f428c5fedb919a71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.291153 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.291104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3d76fef6e121628f428c5fedb919a71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal\" (UID: \"f3d76fef6e121628f428c5fedb919a71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.291153 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.291139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3d76fef6e121628f428c5fedb919a71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal\" (UID: \"f3d76fef6e121628f428c5fedb919a71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.291236 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.291163    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2402c47062fa63a1f829c94ee7d64289-config\") pod \"kube-apiserver-proxy-ip-10-0-132-100.ec2.internal\" (UID: \"2402c47062fa63a1f829c94ee7d64289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.291236 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.291171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3d76fef6e121628f428c5fedb919a71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal\" (UID: \"f3d76fef6e121628f428c5fedb919a71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.361273 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.361252    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.461767 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.461704    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.467845 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.467827    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.471687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.471637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:39.562349 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.562327    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.662646 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.662629    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.762974 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.762930    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.830467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.830441    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 22:32:39.830815 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.830570    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 22:32:39.830815 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.830591    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 22:32:39.863665 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.863637    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.888978 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.888954    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 22:27:38 +0000 UTC" deadline="2028-03-03 07:16:45.666623743 +0000 UTC"
Jul 09 22:32:39.888978 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.888978    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14456h44m5.77764891s"
Jul 09 22:32:39.963789 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:39.963748    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:39.975095 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:39.975067    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2402c47062fa63a1f829c94ee7d64289.slice/crio-6703d4b7c27928e1e45da157aab90c98d61395a4ec4daed7868ce5c9240413e9 WatchSource:0}: Error finding container 6703d4b7c27928e1e45da157aab90c98d61395a4ec4daed7868ce5c9240413e9: Status 404 returned error can't find the container with id 6703d4b7c27928e1e45da157aab90c98d61395a4ec4daed7868ce5c9240413e9
Jul 09 22:32:39.975354 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:39.975335    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d76fef6e121628f428c5fedb919a71.slice/crio-c65cbc644c4da424e46b874904e32dc6949e882154bb43bcb8fbe6418be48963 WatchSource:0}: Error finding container c65cbc644c4da424e46b874904e32dc6949e882154bb43bcb8fbe6418be48963: Status 404 returned error can't find the container with id c65cbc644c4da424e46b874904e32dc6949e882154bb43bcb8fbe6418be48963
Jul 09 22:32:39.978888 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:39.978871    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:32:40.039139 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.039069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal" event={"ID":"f3d76fef6e121628f428c5fedb919a71","Type":"ContainerStarted","Data":"c65cbc644c4da424e46b874904e32dc6949e882154bb43bcb8fbe6418be48963"}
Jul 09 22:32:40.040014 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.039995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal" event={"ID":"2402c47062fa63a1f829c94ee7d64289","Type":"ContainerStarted","Data":"6703d4b7c27928e1e45da157aab90c98d61395a4ec4daed7868ce5c9240413e9"}
Jul 09 22:32:40.064106 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:40.064087    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:40.164397 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:40.164376    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-100.ec2.internal\" not found"
Jul 09 22:32:40.220192 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.220173    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:40.225887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.225873    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:40.286959 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.286938    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:40.297245 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.297201    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:32:40.298135 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.298124    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal"
Jul 09 22:32:40.307872 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.307859    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:32:40.867746 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.867716    2576 apiserver.go:52] "Watching apiserver"
Jul 09 22:32:40.876462 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.876172    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 22:32:40.877197 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.877170    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg","openshift-cluster-node-tuning-operator/tuned-6np97","openshift-dns/node-resolver-qnnt7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal","openshift-multus/multus-additional-cni-plugins-z2f8b","openshift-network-operator/iptables-alerter-vltlb","kube-system/global-pull-secret-syncer-lkjbc","kube-system/konnectivity-agent-l2pw2","openshift-image-registry/node-ca-ljvbg","openshift-multus/multus-lhcg9","openshift-multus/network-metrics-daemon-sprcl","openshift-network-diagnostics/network-check-target-g2c72","openshift-ovn-kubernetes/ovnkube-node-sj8p9","kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal"]
Jul 09 22:32:40.878657 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.878640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.880102 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.880082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.881289 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.881186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:40.881380 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.881343    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 22:32:40.881437 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.881393    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 22:32:40.881720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.881699    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2tnxd\""
Jul 09 22:32:40.881826 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.881731    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 22:32:40.881826 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.881798    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 22:32:40.882231 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.882214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:40.882616 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.882599    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 22:32:40.882688 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.882635    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 22:32:40.882800 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.882787    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5h5bm\""
Jul 09 22:32:40.883044 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.883025    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 22:32:40.883663 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.883646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.884058 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884041    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 22:32:40.884156 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884084    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 22:32:40.884156 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884098    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 22:32:40.884840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884521    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jjpkp\""
Jul 09 22:32:40.884840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884525    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 22:32:40.884840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884589    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 22:32:40.884840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884632    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-srd44\""
Jul 09 22:32:40.884840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884696    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 22:32:40.884840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884761    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 22:32:40.885129 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.884916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:40.886846 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.886335    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 22:32:40.886846 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.886404    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h7zb4\""
Jul 09 22:32:40.886846 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.886605    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 22:32:40.886846 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.886843    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 22:32:40.887828 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.887705    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 22:32:40.887828 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.887759    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:32:40.887953 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.887705    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q6vwn\""
Jul 09 22:32:40.888007 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.887963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:40.888087 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.888073    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 22:32:40.890464 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.890335    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 22:32:40.890464 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.890349    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7fglt\""
Jul 09 22:32:40.890464 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.890378    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 22:32:40.890621 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.890580    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 22:32:40.892263 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.892100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:40.892263 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:40.892178    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:40.893551 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.893523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:40.894848 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.894831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.896991    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:40.897070    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.897446    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.897869    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.897899    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.897912    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qzr4z\""
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.898208    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.898229    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xlptm\""
Jul 09 22:32:40.898377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.898257    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 22:32:40.898830 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.898517    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.898921    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:40.899253    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-hostroot\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-slash\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-ovnkube-script-lib\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-system-cni-dir\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-cni-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-conf-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xq8x\" (UniqueName: \"kubernetes.io/projected/753b0678-cea9-43dd-8ad3-c877bba38890-kube-api-access-9xq8x\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4t9\" (UniqueName: \"kubernetes.io/projected/cb90fd78-cb1a-4009-860a-155f25bd679c-kube-api-access-zm4t9\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-var-lib-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-cni-bin\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc362340-c7bb-4c6d-ba2f-28d38341dabf-host\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:40.900039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.899729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-socket-dir-parent\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.900702 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.900356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ggw\" (UniqueName: \"kubernetes.io/projected/53244abc-91b8-4a48-9a3a-fb856e143b32-kube-api-access-v2ggw\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.900702 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.900623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-cni-multus\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.900702 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.900675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.900866 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.900719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/753b0678-cea9-43dd-8ad3-c877bba38890-hosts-file\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:40.900866 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.900789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-multus-certs\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.900866 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.900826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc362340-c7bb-4c6d-ba2f-28d38341dabf-serviceca\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:40.900963 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.900907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.901213 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.901309 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-system-cni-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.901309 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-etc-kubernetes\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.901309 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwgx\" (UniqueName: \"kubernetes.io/projected/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-kube-api-access-kdwgx\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:40.901309 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53244abc-91b8-4a48-9a3a-fb856e143b32-cni-binary-copy\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.901467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-kubelet\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.901467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-ovn\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901367    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-node-log\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-ovnkube-config\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b8509ee-63de-4b12-876d-c270428eba72-ovn-node-metrics-cert\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwqd\" (UniqueName: \"kubernetes.io/projected/7b8509ee-63de-4b12-876d-c270428eba72-kube-api-access-wpwqd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-host-slash\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:40.901637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-kubelet\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-cni-netd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/753b0678-cea9-43dd-8ad3-c877bba38890-tmp-dir\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:40.901887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84715db1-e88e-47d8-a287-53ee262c1146-agent-certs\") pod \"konnectivity-agent-l2pw2\" (UID: \"84715db1-e88e-47d8-a287-53ee262c1146\") " pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:40.901887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-os-release\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.901887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-netns\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.901887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-systemd-units\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-run-netns\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.901887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-iptables-alerter-script\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kstx5\" (UniqueName: \"kubernetes.io/projected/bc362340-c7bb-4c6d-ba2f-28d38341dabf-kube-api-access-kstx5\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84715db1-e88e-47d8-a287-53ee262c1146-konnectivity-ca\") pod \"konnectivity-agent-l2pw2\" (UID: \"84715db1-e88e-47d8-a287-53ee262c1146\") " pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-cnibin\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-os-release\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.901995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-k8s-cni-cncf-io\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-log-socket\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-run-ovn-kubernetes\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.902100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-cnibin\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.902371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-daemon-config\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.902371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-env-overrides\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.902371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-cni-bin\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:40.902371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-systemd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.902371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-etc-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:40.902371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.902216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:40.914062 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.914029    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qcm4c"
Jul 09 22:32:40.920890 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.920818    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qcm4c"
Jul 09 22:32:40.935535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.935504    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:40.988475 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:40.988455    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 22:32:41.002373 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:41.002523 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-cni-bin\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.002523 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-systemd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.002523 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-etc-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.002523 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002468    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-systemd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.002523 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-etc-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.002523 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-lib-modules\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002468    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-cni-bin\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-registration-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwqr\" (UniqueName: \"kubernetes.io/projected/c5e0b261-1038-4019-bd26-cd5949150bb8-kube-api-access-9rwqr\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-kubelet-config\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-hostroot\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-slash\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-ovnkube-script-lib\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-sys-fs\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-system-cni-dir\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002712    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-slash\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002690    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-hostroot\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-cni-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002796    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-system-cni-dir\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-conf-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.002861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysctl-conf\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002896    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-conf-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002904    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xq8x\" (UniqueName: \"kubernetes.io/projected/753b0678-cea9-43dd-8ad3-c877bba38890-kube-api-access-9xq8x\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.002987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4t9\" (UniqueName: \"kubernetes.io/projected/cb90fd78-cb1a-4009-860a-155f25bd679c-kube-api-access-zm4t9\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-var-lib-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003025    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-cni-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-cni-bin\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-cni-bin\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003138    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-var-lib-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc362340-c7bb-4c6d-ba2f-28d38341dabf-host\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-socket-dir-parent\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003255    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc362340-c7bb-4c6d-ba2f-28d38341dabf-host\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003255    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ggw\" (UniqueName: \"kubernetes.io/projected/53244abc-91b8-4a48-9a3a-fb856e143b32-kube-api-access-v2ggw\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.003548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003255    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-ovnkube-script-lib\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysctl-d\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-cni-multus\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003309    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-socket-dir-parent\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13c3f86e-1446-42df-989b-d0f861b414fb-tmp\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003424    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-cni-multus\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j65jm\" (UniqueName: \"kubernetes.io/projected/13c3f86e-1446-42df-989b-d0f861b414fb-kube-api-access-j65jm\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003461    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-openvswitch\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-socket-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/753b0678-cea9-43dd-8ad3-c877bba38890-hosts-file\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-multus-certs\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc362340-c7bb-4c6d-ba2f-28d38341dabf-serviceca\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/753b0678-cea9-43dd-8ad3-c877bba38890-hosts-file\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-host\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysconfig\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.004299 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003742    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-multus-certs\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-system-cni-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-etc-kubernetes\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-run\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwgx\" (UniqueName: \"kubernetes.io/projected/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-kube-api-access-kdwgx\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003918    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-system-cni-dir\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53244abc-91b8-4a48-9a3a-fb856e143b32-cni-binary-copy\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.003970    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-etc-kubernetes\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004007    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc362340-c7bb-4c6d-ba2f-28d38341dabf-serviceca\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-kubelet\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-ovn\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004146    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-run-ovn\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004225    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-var-lib-kubelet\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-node-log\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-dbus\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-sys\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004306    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-node-log\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-ovnkube-config\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004331    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b8509ee-63de-4b12-876d-c270428eba72-ovn-node-metrics-cert\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004385    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwqd\" (UniqueName: \"kubernetes.io/projected/7b8509ee-63de-4b12-876d-c270428eba72-kube-api-access-wpwqd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004409    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb90fd78-cb1a-4009-860a-155f25bd679c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-host-slash\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004451    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53244abc-91b8-4a48-9a3a-fb856e143b32-cni-binary-copy\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-var-lib-kubelet\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-device-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004541    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-host-slash\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-kubelet\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-kubelet\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-cni-netd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.005795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004688    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-cni-netd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-modprobe-d\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-systemd\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-etc-selinux\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zcxg\" (UniqueName: \"kubernetes.io/projected/dc07053a-3a65-4a47-8a8b-fe1646890faf-kube-api-access-9zcxg\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/753b0678-cea9-43dd-8ad3-c877bba38890-tmp-dir\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004867    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-ovnkube-config\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84715db1-e88e-47d8-a287-53ee262c1146-agent-certs\") pod \"konnectivity-agent-l2pw2\" (UID: \"84715db1-e88e-47d8-a287-53ee262c1146\") " pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-os-release\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-netns\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.004987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-systemd-units\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-run-netns\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-iptables-alerter-script\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005045    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-os-release\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005057    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-netns\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005070    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-systemd-units\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstx5\" (UniqueName: \"kubernetes.io/projected/bc362340-c7bb-4c6d-ba2f-28d38341dabf-kube-api-access-kstx5\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005079    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 22:32:41.006522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005109    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-run-netns\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84715db1-e88e-47d8-a287-53ee262c1146-konnectivity-ca\") pod \"konnectivity-agent-l2pw2\" (UID: \"84715db1-e88e-47d8-a287-53ee262c1146\") " pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-cnibin\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-os-release\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/753b0678-cea9-43dd-8ad3-c877bba38890-tmp-dir\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-k8s-cni-cncf-io\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-cnibin\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005227    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-host-run-k8s-cni-cncf-io\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-log-socket\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-run-ovn-kubernetes\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005300    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb90fd78-cb1a-4009-860a-155f25bd679c-os-release\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-log-socket\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-kubernetes\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005343    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8509ee-63de-4b12-876d-c270428eba72-host-run-ovn-kubernetes\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-cnibin\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-daemon-config\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.007308 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-env-overrides\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.008056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13c3f86e-1446-42df-989b-d0f861b414fb-etc-tuned\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.008056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005489    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53244abc-91b8-4a48-9a3a-fb856e143b32-cnibin\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.008056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005834    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-iptables-alerter-script\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:41.008056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005882    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b8509ee-63de-4b12-876d-c270428eba72-env-overrides\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.008056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.005915    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53244abc-91b8-4a48-9a3a-fb856e143b32-multus-daemon-config\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.008056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.006321    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84715db1-e88e-47d8-a287-53ee262c1146-konnectivity-ca\") pod \"konnectivity-agent-l2pw2\" (UID: \"84715db1-e88e-47d8-a287-53ee262c1146\") " pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:41.008405 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.008386    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b8509ee-63de-4b12-876d-c270428eba72-ovn-node-metrics-cert\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.008527 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.008507    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84715db1-e88e-47d8-a287-53ee262c1146-agent-certs\") pod \"konnectivity-agent-l2pw2\" (UID: \"84715db1-e88e-47d8-a287-53ee262c1146\") " pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:41.011229 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.011170    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xq8x\" (UniqueName: \"kubernetes.io/projected/753b0678-cea9-43dd-8ad3-c877bba38890-kube-api-access-9xq8x\") pod \"node-resolver-qnnt7\" (UID: \"753b0678-cea9-43dd-8ad3-c877bba38890\") " pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:41.011229 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.011212    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4t9\" (UniqueName: \"kubernetes.io/projected/cb90fd78-cb1a-4009-860a-155f25bd679c-kube-api-access-zm4t9\") pod \"multus-additional-cni-plugins-z2f8b\" (UID: \"cb90fd78-cb1a-4009-860a-155f25bd679c\") " pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.011352 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.011231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ggw\" (UniqueName: \"kubernetes.io/projected/53244abc-91b8-4a48-9a3a-fb856e143b32-kube-api-access-v2ggw\") pod \"multus-lhcg9\" (UID: \"53244abc-91b8-4a48-9a3a-fb856e143b32\") " pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.011702 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.011680    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwgx\" (UniqueName: \"kubernetes.io/projected/3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb-kube-api-access-kdwgx\") pod \"iptables-alerter-vltlb\" (UID: \"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb\") " pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:41.011802 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.011752    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwqd\" (UniqueName: \"kubernetes.io/projected/7b8509ee-63de-4b12-876d-c270428eba72-kube-api-access-wpwqd\") pod \"ovnkube-node-sj8p9\" (UID: \"7b8509ee-63de-4b12-876d-c270428eba72\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.013010 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.012992    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kstx5\" (UniqueName: \"kubernetes.io/projected/bc362340-c7bb-4c6d-ba2f-28d38341dabf-kube-api-access-kstx5\") pod \"node-ca-ljvbg\" (UID: \"bc362340-c7bb-4c6d-ba2f-28d38341dabf\") " pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:41.106000 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.105969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-sys-fs\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.106000 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysctl-conf\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysctl-d\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13c3f86e-1446-42df-989b-d0f861b414fb-tmp\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j65jm\" (UniqueName: \"kubernetes.io/projected/13c3f86e-1446-42df-989b-d0f861b414fb-kube-api-access-j65jm\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106096    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-sys-fs\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-socket-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.106142    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-host\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysconfig\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106187    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysctl-conf\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106219 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.106215    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret podName:a7e7d3e0-f913-44e8-846c-b8448fc96cd0 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:41.606195183 +0000 UTC m=+3.088018559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret") pod "global-pull-secret-syncer-lkjbc" (UID: "a7e7d3e0-f913-44e8-846c-b8448fc96cd0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106234    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-host\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106243    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-socket-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106245    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106263    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysctl-d\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-run\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106273    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-sysconfig\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-dbus\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-sys\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106337    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-run\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-var-lib-kubelet\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-device-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-dbus\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-modprobe-d\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-var-lib-kubelet\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106410    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-sys\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-systemd\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.106687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106433    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-device-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-etc-selinux\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106489    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-modprobe-d\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106511    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-systemd\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106538    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-etc-selinux\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zcxg\" (UniqueName: \"kubernetes.io/projected/dc07053a-3a65-4a47-8a8b-fe1646890faf-kube-api-access-9zcxg\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-kubernetes\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106644    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13c3f86e-1446-42df-989b-d0f861b414fb-etc-tuned\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106680    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-etc-kubernetes\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-lib-modules\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-registration-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwqr\" (UniqueName: \"kubernetes.io/projected/c5e0b261-1038-4019-bd26-cd5949150bb8-kube-api-access-9rwqr\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-kubelet-config\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106862    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-kubelet-config\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106873    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13c3f86e-1446-42df-989b-d0f861b414fb-lib-modules\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.107429 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.106898    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5e0b261-1038-4019-bd26-cd5949150bb8-registration-dir\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.108074 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.106949    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:41.108074 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.107011    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:32:41.606994494 +0000 UTC m=+3.088817872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:41.108674 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.108644    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13c3f86e-1446-42df-989b-d0f861b414fb-tmp\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.108818 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.108798    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13c3f86e-1446-42df-989b-d0f861b414fb-etc-tuned\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.113364 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.113345    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:41.113466 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.113369    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:41.113466 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.113381    2576 projected.go:196] Error preparing data for projected volume kube-api-access-btkfr for pod openshift-network-diagnostics/network-check-target-g2c72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:41.113466 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.113434    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr podName:a9a337fa-5f89-4a71-a886-c4296a87727e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:41.613420134 +0000 UTC m=+3.095243527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btkfr" (UniqueName: "kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr") pod "network-check-target-g2c72" (UID: "a9a337fa-5f89-4a71-a886-c4296a87727e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:41.115104 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.115074    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zcxg\" (UniqueName: \"kubernetes.io/projected/dc07053a-3a65-4a47-8a8b-fe1646890faf-kube-api-access-9zcxg\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:41.115539 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.115515    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j65jm\" (UniqueName: \"kubernetes.io/projected/13c3f86e-1446-42df-989b-d0f861b414fb-kube-api-access-j65jm\") pod \"tuned-6np97\" (UID: \"13c3f86e-1446-42df-989b-d0f861b414fb\") " pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.116747 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.116728    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwqr\" (UniqueName: \"kubernetes.io/projected/c5e0b261-1038-4019-bd26-cd5949150bb8-kube-api-access-9rwqr\") pod \"aws-ebs-csi-driver-node-8t6cg\" (UID: \"c5e0b261-1038-4019-bd26-cd5949150bb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.182050 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.181974    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:32:41.191422 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.191401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lhcg9"
Jul 09 22:32:41.202093 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.202072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:32:41.208853 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.208835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qnnt7"
Jul 09 22:32:41.213351 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.213330    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:32:41.218748 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.218726    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z2f8b"
Jul 09 22:32:41.224711 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.224688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vltlb"
Jul 09 22:32:41.230235 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.230219    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ljvbg"
Jul 09 22:32:41.237048 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.237030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6np97"
Jul 09 22:32:41.242519 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.242502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg"
Jul 09 22:32:41.612105 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.612022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:41.612105 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.612089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:41.612286 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.612163    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:41.612286 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.612214    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret podName:a7e7d3e0-f913-44e8-846c-b8448fc96cd0 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:42.612202033 +0000 UTC m=+4.094025399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret") pod "global-pull-secret-syncer-lkjbc" (UID: "a7e7d3e0-f913-44e8-846c-b8448fc96cd0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:41.612286 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.612163    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:41.612286 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.612274    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:32:42.612263334 +0000 UTC m=+4.094086710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:41.713333 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.713287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:41.713538 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.713480    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:41.713538 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.713512    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:41.713538 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.713525    2576 projected.go:196] Error preparing data for projected volume kube-api-access-btkfr for pod openshift-network-diagnostics/network-check-target-g2c72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:41.713803 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:41.713582    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr podName:a9a337fa-5f89-4a71-a886-c4296a87727e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:42.713569779 +0000 UTC m=+4.195393141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btkfr" (UniqueName: "kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr") pod "network-check-target-g2c72" (UID: "a9a337fa-5f89-4a71-a886-c4296a87727e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:41.854164 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.854140    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c3f86e_1446_42df_989b_d0f861b414fb.slice/crio-108ca8c16e26e18f46bfb25d75893fd2d08a9352662adb9dbaacc64c22d833be WatchSource:0}: Error finding container 108ca8c16e26e18f46bfb25d75893fd2d08a9352662adb9dbaacc64c22d833be: Status 404 returned error can't find the container with id 108ca8c16e26e18f46bfb25d75893fd2d08a9352662adb9dbaacc64c22d833be
Jul 09 22:32:41.856237 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.856164    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb90fd78_cb1a_4009_860a_155f25bd679c.slice/crio-ed6346abed241de230ac3d3caf6081dcc01e75e2e1d25c17ed7840fddc6e1006 WatchSource:0}: Error finding container ed6346abed241de230ac3d3caf6081dcc01e75e2e1d25c17ed7840fddc6e1006: Status 404 returned error can't find the container with id ed6346abed241de230ac3d3caf6081dcc01e75e2e1d25c17ed7840fddc6e1006
Jul 09 22:32:41.857199 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.857041    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b77f30c_fb1f_4299_bb4e_c5d7d2f3e1bb.slice/crio-84d711c112423e80683ad7107a9a2addde0252f43b4b74210e6c9e60ec9cbf01 WatchSource:0}: Error finding container 84d711c112423e80683ad7107a9a2addde0252f43b4b74210e6c9e60ec9cbf01: Status 404 returned error can't find the container with id 84d711c112423e80683ad7107a9a2addde0252f43b4b74210e6c9e60ec9cbf01
Jul 09 22:32:41.860195 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.860171    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8509ee_63de_4b12_876d_c270428eba72.slice/crio-08a17fe7e48a1aad509fa8801b989e3fcb03209b5c9406b1113ce426aa88a110 WatchSource:0}: Error finding container 08a17fe7e48a1aad509fa8801b989e3fcb03209b5c9406b1113ce426aa88a110: Status 404 returned error can't find the container with id 08a17fe7e48a1aad509fa8801b989e3fcb03209b5c9406b1113ce426aa88a110
Jul 09 22:32:41.860891 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.860867    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc362340_c7bb_4c6d_ba2f_28d38341dabf.slice/crio-c81fe92f0515cd980ad4868a4b64f82ee289c31e83810485281352f35db36892 WatchSource:0}: Error finding container c81fe92f0515cd980ad4868a4b64f82ee289c31e83810485281352f35db36892: Status 404 returned error can't find the container with id c81fe92f0515cd980ad4868a4b64f82ee289c31e83810485281352f35db36892
Jul 09 22:32:41.862477 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.862458    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e0b261_1038_4019_bd26_cd5949150bb8.slice/crio-04991a6d3d182292981c69bc2eaac3e298ebe4ee5951f8ea3405762d32e69983 WatchSource:0}: Error finding container 04991a6d3d182292981c69bc2eaac3e298ebe4ee5951f8ea3405762d32e69983: Status 404 returned error can't find the container with id 04991a6d3d182292981c69bc2eaac3e298ebe4ee5951f8ea3405762d32e69983
Jul 09 22:32:41.863243 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.863215    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753b0678_cea9_43dd_8ad3_c877bba38890.slice/crio-3d7adaa2865e0077b0570602bbae9a982be8b65c66204c1aeafe2d20f437ef99 WatchSource:0}: Error finding container 3d7adaa2865e0077b0570602bbae9a982be8b65c66204c1aeafe2d20f437ef99: Status 404 returned error can't find the container with id 3d7adaa2865e0077b0570602bbae9a982be8b65c66204c1aeafe2d20f437ef99
Jul 09 22:32:41.864083 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.864062    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84715db1_e88e_47d8_a287_53ee262c1146.slice/crio-3127e03868c3d9e4f5b9752aac67b1e2d2269285183518dde707650feb16e697 WatchSource:0}: Error finding container 3127e03868c3d9e4f5b9752aac67b1e2d2269285183518dde707650feb16e697: Status 404 returned error can't find the container with id 3127e03868c3d9e4f5b9752aac67b1e2d2269285183518dde707650feb16e697
Jul 09 22:32:41.865920 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:32:41.865900    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53244abc_91b8_4a48_9a3a_fb856e143b32.slice/crio-d812f337bfd01de03b6e1b2132e338a96ef5470d7d8db4f56c536b6e0593f9fd WatchSource:0}: Error finding container d812f337bfd01de03b6e1b2132e338a96ef5470d7d8db4f56c536b6e0593f9fd: Status 404 returned error can't find the container with id d812f337bfd01de03b6e1b2132e338a96ef5470d7d8db4f56c536b6e0593f9fd
Jul 09 22:32:41.923804 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.923754    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:27:40 +0000 UTC" deadline="2028-01-27 10:41:16.388596458 +0000 UTC"
Jul 09 22:32:41.923804 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:41.923802    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13596h8m34.464798129s"
Jul 09 22:32:42.044962 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.044805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2pw2" event={"ID":"84715db1-e88e-47d8-a287-53ee262c1146","Type":"ContainerStarted","Data":"3127e03868c3d9e4f5b9752aac67b1e2d2269285183518dde707650feb16e697"}
Jul 09 22:32:42.046822 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.046798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qnnt7" event={"ID":"753b0678-cea9-43dd-8ad3-c877bba38890","Type":"ContainerStarted","Data":"3d7adaa2865e0077b0570602bbae9a982be8b65c66204c1aeafe2d20f437ef99"}
Jul 09 22:32:42.047747 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.047729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"08a17fe7e48a1aad509fa8801b989e3fcb03209b5c9406b1113ce426aa88a110"}
Jul 09 22:32:42.048688 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.048666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg" event={"ID":"c5e0b261-1038-4019-bd26-cd5949150bb8","Type":"ContainerStarted","Data":"04991a6d3d182292981c69bc2eaac3e298ebe4ee5951f8ea3405762d32e69983"}
Jul 09 22:32:42.049802 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.049761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ljvbg" event={"ID":"bc362340-c7bb-4c6d-ba2f-28d38341dabf","Type":"ContainerStarted","Data":"c81fe92f0515cd980ad4868a4b64f82ee289c31e83810485281352f35db36892"}
Jul 09 22:32:42.050717 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.050701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vltlb" event={"ID":"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb","Type":"ContainerStarted","Data":"84d711c112423e80683ad7107a9a2addde0252f43b4b74210e6c9e60ec9cbf01"}
Jul 09 22:32:42.051659 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.051638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerStarted","Data":"ed6346abed241de230ac3d3caf6081dcc01e75e2e1d25c17ed7840fddc6e1006"}
Jul 09 22:32:42.052808 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.052790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6np97" event={"ID":"13c3f86e-1446-42df-989b-d0f861b414fb","Type":"ContainerStarted","Data":"108ca8c16e26e18f46bfb25d75893fd2d08a9352662adb9dbaacc64c22d833be"}
Jul 09 22:32:42.055529 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.055507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal" event={"ID":"2402c47062fa63a1f829c94ee7d64289","Type":"ContainerStarted","Data":"c4fe9b4def5983bb17f81b7f1e7d852fe411ba91ff4e4060d26e98e85e71efbc"}
Jul 09 22:32:42.057625 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.057604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lhcg9" event={"ID":"53244abc-91b8-4a48-9a3a-fb856e143b32","Type":"ContainerStarted","Data":"d812f337bfd01de03b6e1b2132e338a96ef5470d7d8db4f56c536b6e0593f9fd"}
Jul 09 22:32:42.621872 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.621597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:42.621872 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.621699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:42.621872 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.621786    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:42.621872 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.621822    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:42.621872 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.621870    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret podName:a7e7d3e0-f913-44e8-846c-b8448fc96cd0 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:44.621847368 +0000 UTC m=+6.103670733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret") pod "global-pull-secret-syncer-lkjbc" (UID: "a7e7d3e0-f913-44e8-846c-b8448fc96cd0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:42.622277 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.621893    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:32:44.621881831 +0000 UTC m=+6.103705202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:42.723824 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.723079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:42.723824 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.723312    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:42.723824 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.723332    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:42.723824 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.723345    2576 projected.go:196] Error preparing data for projected volume kube-api-access-btkfr for pod openshift-network-diagnostics/network-check-target-g2c72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:42.723824 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:42.723420    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr podName:a9a337fa-5f89-4a71-a886-c4296a87727e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:44.723400782 +0000 UTC m=+6.205224151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btkfr" (UniqueName: "kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr") pod "network-check-target-g2c72" (UID: "a9a337fa-5f89-4a71-a886-c4296a87727e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:42.924216 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.923961    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:27:40 +0000 UTC" deadline="2028-04-24 10:00:37.392564506 +0000 UTC"
Jul 09 22:32:42.924216 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:42.924019    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15707h27m54.468549774s"
Jul 09 22:32:43.040972 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:43.040923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:43.041182 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:43.041084    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:43.041613 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:43.041595    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:43.041745 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:43.041697    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:43.041836 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:43.041794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:43.041925 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:43.041904    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:43.090742 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:43.090704    2576 generic.go:356] "Generic (PLEG): container finished" podID="f3d76fef6e121628f428c5fedb919a71" containerID="ff06cbfe0ac98ea7434aa8cf85ee9cb6c35b69116721944fa851392dc6a75a2e" exitCode=0
Jul 09 22:32:43.091223 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:43.091197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal" event={"ID":"f3d76fef6e121628f428c5fedb919a71","Type":"ContainerDied","Data":"ff06cbfe0ac98ea7434aa8cf85ee9cb6c35b69116721944fa851392dc6a75a2e"}
Jul 09 22:32:43.108952 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:43.108858    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-100.ec2.internal" podStartSLOduration=3.108838899 podStartE2EDuration="3.108838899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:42.06910342 +0000 UTC m=+3.550926803" watchObservedRunningTime="2026-07-09 22:32:43.108838899 +0000 UTC m=+4.590662287"
Jul 09 22:32:44.104765 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:44.104270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal" event={"ID":"f3d76fef6e121628f428c5fedb919a71","Type":"ContainerStarted","Data":"9c9950e3c188a6fb2a48d1cdb94c5fcfeb7ef9efc01eff1fd8b3f741f35adf3e"}
Jul 09 22:32:44.639056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:44.639021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:44.639223 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:44.639081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:44.639281 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.639223    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:44.639332 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.639286    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret podName:a7e7d3e0-f913-44e8-846c-b8448fc96cd0 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:48.639266128 +0000 UTC m=+10.121089495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret") pod "global-pull-secret-syncer-lkjbc" (UID: "a7e7d3e0-f913-44e8-846c-b8448fc96cd0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:44.639687 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.639668    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:44.639799 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.639725    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:32:48.639708032 +0000 UTC m=+10.121531396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:44.739605 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:44.739570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:44.739798 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.739759    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:44.739798 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.739796    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:44.739910 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.739810    2576 projected.go:196] Error preparing data for projected volume kube-api-access-btkfr for pod openshift-network-diagnostics/network-check-target-g2c72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:44.739910 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:44.739863    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr podName:a9a337fa-5f89-4a71-a886-c4296a87727e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:48.739844287 +0000 UTC m=+10.221667664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btkfr" (UniqueName: "kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr") pod "network-check-target-g2c72" (UID: "a9a337fa-5f89-4a71-a886-c4296a87727e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:45.039412 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:45.037082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:45.039412 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:45.037111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:45.039412 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:45.037202    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:45.039412 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:45.037082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:45.039412 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:45.037627    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:45.039412 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:45.037704    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:47.037361 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:47.037282    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:47.037802 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:47.037430    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:47.037900 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:47.037883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:47.038013 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:47.037986    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:47.038144 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:47.038131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:47.038266 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:47.038229    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:48.672024 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:48.671838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:48.672024 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:48.671896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:48.672024 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.672001    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:48.672571 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.672083    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:32:56.672060797 +0000 UTC m=+18.153884164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:48.672571 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.672006    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:48.672571 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.672404    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret podName:a7e7d3e0-f913-44e8-846c-b8448fc96cd0 nodeName:}" failed. No retries permitted until 2026-07-09 22:32:56.672388358 +0000 UTC m=+18.154211738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret") pod "global-pull-secret-syncer-lkjbc" (UID: "a7e7d3e0-f913-44e8-846c-b8448fc96cd0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:48.773285 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:48.773250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:48.773451 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.773404    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:48.773451 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.773425    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:48.773451 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.773437    2576 projected.go:196] Error preparing data for projected volume kube-api-access-btkfr for pod openshift-network-diagnostics/network-check-target-g2c72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:48.773594 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:48.773503    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr podName:a9a337fa-5f89-4a71-a886-c4296a87727e nodeName:}" failed. No retries permitted until 2026-07-09 22:32:56.773483346 +0000 UTC m=+18.255306730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btkfr" (UniqueName: "kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr") pod "network-check-target-g2c72" (UID: "a9a337fa-5f89-4a71-a886-c4296a87727e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:49.038103 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:49.037984    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:49.038258 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:49.038107    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:49.038652 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:49.038381    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:49.038652 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:49.038507    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:49.038652 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:49.038545    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:49.038652 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:49.038618    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:51.037083 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:51.036999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:51.037083 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:51.037044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:51.037626 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:51.037133    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:51.037626 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:51.037145    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:51.037626 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:51.037248    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:51.037626 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:51.037375    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:53.037262 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:53.037144    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:53.037262 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:53.037187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:53.037262 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:53.037152    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:53.037766 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:53.037271    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:53.037766 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:53.037366    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:53.037766 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:53.037436    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:53.127734 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:53.127699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg" event={"ID":"c5e0b261-1038-4019-bd26-cd5949150bb8","Type":"ContainerStarted","Data":"1e248362011a5c04e8bb2b408261836f62212f48665b09c3797e5237d272658d"}
Jul 09 22:32:54.131690 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:54.131636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vltlb" event={"ID":"3b77f30c-fb1f-4299-bb4e-c5d7d2f3e1bb","Type":"ContainerStarted","Data":"577c591830bedbf8d413d9f58622d307d542117b47df0374d01013af9389b452"}
Jul 09 22:32:54.147888 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:54.147839    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-100.ec2.internal" podStartSLOduration=14.147822703 podStartE2EDuration="14.147822703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:44.121376244 +0000 UTC m=+5.603199630" watchObservedRunningTime="2026-07-09 22:32:54.147822703 +0000 UTC m=+15.629646089"
Jul 09 22:32:54.148068 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:54.148005    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vltlb" podStartSLOduration=5.858773757 podStartE2EDuration="16.147998613s" totalImagesPullingTime="10.289224856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:32:54.147574028 +0000 UTC m=+15.629397417" watchObservedRunningTime="2026-07-09 22:32:54.147998613 +0000 UTC m=+15.629821999"
Jul 09 22:32:55.037098 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:55.037058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:55.037291 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:55.037059    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:55.037291 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:55.037210    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:55.037291 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:55.037059    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:55.037441 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:55.037248    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:55.037441 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:55.037380    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:56.731090 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:56.731054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:56.731542 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:56.731146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:56.731542 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.731201    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:56.731542 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.731225    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:56.731542 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.731273    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret podName:a7e7d3e0-f913-44e8-846c-b8448fc96cd0 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:12.731250993 +0000 UTC m=+34.213074364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret") pod "global-pull-secret-syncer-lkjbc" (UID: "a7e7d3e0-f913-44e8-846c-b8448fc96cd0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:32:56.731542 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.731293    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:33:12.731282479 +0000 UTC m=+34.213105859 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:32:56.831433 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:56.831406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:56.831597 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.831570    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:32:56.831597 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.831593    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:32:56.831682 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.831606    2576 projected.go:196] Error preparing data for projected volume kube-api-access-btkfr for pod openshift-network-diagnostics/network-check-target-g2c72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:56.831682 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:56.831663    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr podName:a9a337fa-5f89-4a71-a886-c4296a87727e nodeName:}" failed. No retries permitted until 2026-07-09 22:33:12.831648596 +0000 UTC m=+34.313471960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btkfr" (UniqueName: "kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr") pod "network-check-target-g2c72" (UID: "a9a337fa-5f89-4a71-a886-c4296a87727e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:32:57.041051 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:57.040967    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:57.041051 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:57.040974    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:57.041268 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:57.041082    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:32:57.041268 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:57.041147    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:57.041268 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:57.041165    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:57.041376 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:57.041272    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:59.041213 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:59.041014    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:32:59.041621 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:59.041084    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:32:59.041621 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:59.041289    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:32:59.041621 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:59.041396    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:32:59.041621 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:32:59.041092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:32:59.041621 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:32:59.041512    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:00.773124 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:00.772971    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 22:33:00.947560 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:00.947475    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T22:33:00.773120694Z","UUID":"d1d68f5f-f20c-4dd2-8b07-25bc6c3dd152","Handler":null,"Name":"","Endpoint":""}
Jul 09 22:33:00.948919 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:00.948893    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 22:33:00.949013 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:00.948936    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 22:33:01.037209 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.037182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:01.037332 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.037182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:01.037332 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:01.037291    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:01.037449 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:01.037357    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:01.037449 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.037182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:01.037552 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:01.037452    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:33:01.145906 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.145869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6np97" event={"ID":"13c3f86e-1446-42df-989b-d0f861b414fb","Type":"ContainerStarted","Data":"b9cba3cc92f95621b5f63a855672e7bb5085508e80fbabc49ac046a78523acca"}
Jul 09 22:33:01.147280 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.147257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lhcg9" event={"ID":"53244abc-91b8-4a48-9a3a-fb856e143b32","Type":"ContainerStarted","Data":"638f06276c19c95b95cc544eac2f39a761043c1a43f1559086f68167da25533f"}
Jul 09 22:33:01.148557 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.148530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2pw2" event={"ID":"84715db1-e88e-47d8-a287-53ee262c1146","Type":"ContainerStarted","Data":"35903f128fbf569398c4c75335b45c65eccdbbb555c203bf0c5fbb7595287513"}
Jul 09 22:33:01.149979 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.149955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qnnt7" event={"ID":"753b0678-cea9-43dd-8ad3-c877bba38890","Type":"ContainerStarted","Data":"282f57c249d20106653f6b53e6b02d81054d9e9777433702da955d56d348b122"}
Jul 09 22:33:01.153119 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153101    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:33:01.153421 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153400    2576 generic.go:356] "Generic (PLEG): container finished" podID="7b8509ee-63de-4b12-876d-c270428eba72" containerID="1713c5a4444163eb10ac0a5a29cafec850822743a0ed77d043a349eb0571bf7f" exitCode=1
Jul 09 22:33:01.153494 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"f4bff7274d96766f413512694ce28b1c7904bac9ab16394c9867390ef649dcde"}
Jul 09 22:33:01.153548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"15992f070f1e90ce398af29dab933670b7553f1df2d6639af7305d495e1bfd03"}
Jul 09 22:33:01.153604 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"2730e872840fd6c0131bec4db2fcacf91a0808f2d9721e18c6a15333fed145aa"}
Jul 09 22:33:01.153654 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"02e21a04289f36c8d05a79c6dca7bc8b9d64c87c2914b2ed84c7bbe38de2e029"}
Jul 09 22:33:01.153654 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerDied","Data":"1713c5a4444163eb10ac0a5a29cafec850822743a0ed77d043a349eb0571bf7f"}
Jul 09 22:33:01.153748 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.153683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"6ea48a1d9a897a54ac653f3d5ef52e8095d2e52dd7f1d9c6e3a17e43ba9ee5d4"}
Jul 09 22:33:01.155228 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.155209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg" event={"ID":"c5e0b261-1038-4019-bd26-cd5949150bb8","Type":"ContainerStarted","Data":"d0f4316f6538e24e46fb5a1b9c480460e2754245554e7719d0f92c5a03d82797"}
Jul 09 22:33:01.156586 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.156563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ljvbg" event={"ID":"bc362340-c7bb-4c6d-ba2f-28d38341dabf","Type":"ContainerStarted","Data":"f33de5dd272ca3c64e5623ee0cb99d5988551c3f07aee0c295dc24644d63de90"}
Jul 09 22:33:01.158171 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.158147    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb90fd78-cb1a-4009-860a-155f25bd679c" containerID="200ada4bd39a76322c3a06462b58725e30a75cd51b2522f7d524ee3ae6f36e2b" exitCode=0
Jul 09 22:33:01.158261 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.158178    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerDied","Data":"200ada4bd39a76322c3a06462b58725e30a75cd51b2522f7d524ee3ae6f36e2b"}
Jul 09 22:33:01.165529 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.165484    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6np97" podStartSLOduration=4.623875998 podStartE2EDuration="23.16547181s" totalImagesPullingTime="18.541595812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:01.165180746 +0000 UTC m=+22.647004132" watchObservedRunningTime="2026-07-09 22:33:01.16547181 +0000 UTC m=+22.647295197"
Jul 09 22:33:01.184428 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.184379    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lhcg9" podStartSLOduration=4.653434402 podStartE2EDuration="23.184364026s" totalImagesPullingTime="18.530929624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:01.184225992 +0000 UTC m=+22.666049379" watchObservedRunningTime="2026-07-09 22:33:01.184364026 +0000 UTC m=+22.666187410"
Jul 09 22:33:01.201906 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.201853    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l2pw2" podStartSLOduration=12.940061697 podStartE2EDuration="23.201836998s" totalImagesPullingTime="10.261775301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:01.201380913 +0000 UTC m=+22.683204298" watchObservedRunningTime="2026-07-09 22:33:01.201836998 +0000 UTC m=+22.683660384"
Jul 09 22:33:01.244477 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.244398    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ljvbg" podStartSLOduration=12.952196227 podStartE2EDuration="23.244376907s" totalImagesPullingTime="10.29218068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:01.244037461 +0000 UTC m=+22.725860848" watchObservedRunningTime="2026-07-09 22:33:01.244376907 +0000 UTC m=+22.726200295"
Jul 09 22:33:01.262681 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:01.262627    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qnnt7" podStartSLOduration=12.978185164 podStartE2EDuration="23.262605695s" totalImagesPullingTime="10.284420531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:01.262064528 +0000 UTC m=+22.743887917" watchObservedRunningTime="2026-07-09 22:33:01.262605695 +0000 UTC m=+22.744429085"
Jul 09 22:33:02.162351 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:02.162317    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg" event={"ID":"c5e0b261-1038-4019-bd26-cd5949150bb8","Type":"ContainerStarted","Data":"b0c9d3f6abc89ba62759d5a1e569300207a6c77be6931be02ae9c84d129aead4"}
Jul 09 22:33:03.037257 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:03.037227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:03.037629 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:03.037227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:03.037629 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:03.037325    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:33:03.037629 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:03.037340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:03.037629 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:03.037414    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:03.037629 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:03.037481    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:03.869066 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:03.869026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:33:03.869703 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:03.869686    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:33:03.886117 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:03.886068    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8t6cg" podStartSLOduration=6.233140252 podStartE2EDuration="25.886052123s" totalImagesPullingTime="19.652911871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:02.181389884 +0000 UTC m=+23.663213271" watchObservedRunningTime="2026-07-09 22:33:03.886052123 +0000 UTC m=+25.367875509"
Jul 09 22:33:04.173408 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:04.173335    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:33:04.173837 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:04.173806    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"d69d3db2db99a810f4cf696bd4a64e4f8493a5c47a09a86468bae3722e5a6505"}
Jul 09 22:33:04.173961 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:04.173946    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:33:04.174431 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:04.174413    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l2pw2"
Jul 09 22:33:05.036960 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:05.036927    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:05.037452 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:05.036934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:05.037452 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:05.037074    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:33:05.037452 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:05.036934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:05.037452 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:05.037128    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:05.037452 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:05.037187    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:06.180481 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:06.180452    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:33:06.181309 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:06.180864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"9ff01fd06d9166ea6b4604d2ea5564f6c08f60a23549be3a5ff6c7653d42a11a"}
Jul 09 22:33:06.181384 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:06.181347    2576 scope.go:117] "RemoveContainer" containerID="1713c5a4444163eb10ac0a5a29cafec850822743a0ed77d043a349eb0571bf7f"
Jul 09 22:33:07.037202 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.037110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:07.037202 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.037151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:07.037411 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.037110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:07.037411 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:07.037285    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:07.037411 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:07.037285    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:33:07.037411 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:07.037365    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:07.188449 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.188257    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:33:07.188916 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.188829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" event={"ID":"7b8509ee-63de-4b12-876d-c270428eba72","Type":"ContainerStarted","Data":"95603764fb7f37de787b4c05797d0a48cee4c53d89b9efd7838bab8f5a8fd7e4"}
Jul 09 22:33:07.192239 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.189805    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:33:07.192239 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.190201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:33:07.192239 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.190494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:33:07.211140 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.211114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:33:07.211313 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.211277    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:33:07.219884 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.219842    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9" podStartSLOduration=10.682428193 podStartE2EDuration="29.219829107s" totalImagesPullingTime="18.537400914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:07.219607932 +0000 UTC m=+28.701431329" watchObservedRunningTime="2026-07-09 22:33:07.219829107 +0000 UTC m=+28.701652493"
Jul 09 22:33:07.603287 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.603255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkjbc"]
Jul 09 22:33:07.603500 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.603380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:07.603500 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:07.603479    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:07.606990 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.606787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sprcl"]
Jul 09 22:33:07.606990 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.606913    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:07.607187 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:07.607026    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:33:07.607519 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.607493    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g2c72"]
Jul 09 22:33:07.607641 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:07.607600    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:07.607733 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:07.607700    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:09.037540 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:09.037510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:09.038017 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:09.037606    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:09.199631 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:09.199593    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb90fd78-cb1a-4009-860a-155f25bd679c" containerID="3dfff6d74b1179993be2e268a8dd48f5585735ee65dede3d04899a68c83b1a40" exitCode=0
Jul 09 22:33:09.199824 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:09.199676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerDied","Data":"3dfff6d74b1179993be2e268a8dd48f5585735ee65dede3d04899a68c83b1a40"}
Jul 09 22:33:10.037622 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:10.037592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:10.038075 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:10.037635    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:10.038075 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:10.037771    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:10.038075 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:10.037907    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:33:11.036903 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:11.036868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:11.037072 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:11.036984    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:11.206169 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:11.206134    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb90fd78-cb1a-4009-860a-155f25bd679c" containerID="f0f3dd3de5735439b4d04ca0b31ae93415f053b9517faa9e544a775ec42433a4" exitCode=0
Jul 09 22:33:11.206587 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:11.206201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerDied","Data":"f0f3dd3de5735439b4d04ca0b31ae93415f053b9517faa9e544a775ec42433a4"}
Jul 09 22:33:12.037155 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:12.037127    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:12.037300 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:12.037125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:12.037300 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.037247    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:33:12.037410 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.037355    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g2c72" podUID="a9a337fa-5f89-4a71-a886-c4296a87727e"
Jul 09 22:33:12.210690 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:12.210655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerStarted","Data":"790e705b9f9a984af801143fe589567cedb22139ad328c6f8ce39c38d7ec8c80"}
Jul 09 22:33:12.750277 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:12.750242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:12.750449 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:12.750281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:12.750449 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.750386    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:33:12.750449 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.750429    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:33:12.750449 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.750447    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:33:44.750429023 +0000 UTC m=+66.232252388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:33:12.750577 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.750465    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret podName:a7e7d3e0-f913-44e8-846c-b8448fc96cd0 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:44.750454288 +0000 UTC m=+66.232277653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret") pod "global-pull-secret-syncer-lkjbc" (UID: "a7e7d3e0-f913-44e8-846c-b8448fc96cd0") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:33:12.850618 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:12.850581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:12.850760 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.850711    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:33:12.850760 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.850724    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:33:12.850760 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.850733    2576 projected.go:196] Error preparing data for projected volume kube-api-access-btkfr for pod openshift-network-diagnostics/network-check-target-g2c72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:33:12.850897 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:12.850799    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr podName:a9a337fa-5f89-4a71-a886-c4296a87727e nodeName:}" failed. No retries permitted until 2026-07-09 22:33:44.850766641 +0000 UTC m=+66.332590007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btkfr" (UniqueName: "kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr") pod "network-check-target-g2c72" (UID: "a9a337fa-5f89-4a71-a886-c4296a87727e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:33:13.037596 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.037517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:13.037735 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:13.037613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkjbc" podUID="a7e7d3e0-f913-44e8-846c-b8448fc96cd0"
Jul 09 22:33:13.214635 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.214605    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb90fd78-cb1a-4009-860a-155f25bd679c" containerID="790e705b9f9a984af801143fe589567cedb22139ad328c6f8ce39c38d7ec8c80" exitCode=0
Jul 09 22:33:13.214971 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.214663    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerDied","Data":"790e705b9f9a984af801143fe589567cedb22139ad328c6f8ce39c38d7ec8c80"}
Jul 09 22:33:13.380808 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.380703    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-100.ec2.internal" event="NodeReady"
Jul 09 22:33:13.380973 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.380836    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 22:33:13.424853 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.424820    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-scvhq"]
Jul 09 22:33:13.426793 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.426758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.428837 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.428818    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4c248"]
Jul 09 22:33:13.429883 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.429858    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xdqcx\""
Jul 09 22:33:13.429977 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.429883    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 22:33:13.430030 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.430001    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 22:33:13.430344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.430327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.433066 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.433044    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 22:33:13.433194 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.433178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-twh9c\""
Jul 09 22:33:13.433252 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.433225    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 22:33:13.433871 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.433845    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 22:33:13.437915 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.437875    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-scvhq"]
Jul 09 22:33:13.441337 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.441317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4c248"]
Jul 09 22:33:13.556037 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.556005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.556037 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.556037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-tmp-dir\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.556209 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.556063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4xk\" (UniqueName: \"kubernetes.io/projected/07d4c6de-55eb-45eb-8f3e-143c4659a67d-kube-api-access-ff4xk\") pod \"ingress-canary-4c248\" (UID: \"07d4c6de-55eb-45eb-8f3e-143c4659a67d\") " pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.556209 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.556116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-config-volume\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.556209 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.556184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07d4c6de-55eb-45eb-8f3e-143c4659a67d-cert\") pod \"ingress-canary-4c248\" (UID: \"07d4c6de-55eb-45eb-8f3e-143c4659a67d\") " pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.556209 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.556202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5sq\" (UniqueName: \"kubernetes.io/projected/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-kube-api-access-2l5sq\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.657368 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.657281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4xk\" (UniqueName: \"kubernetes.io/projected/07d4c6de-55eb-45eb-8f3e-143c4659a67d-kube-api-access-ff4xk\") pod \"ingress-canary-4c248\" (UID: \"07d4c6de-55eb-45eb-8f3e-143c4659a67d\") " pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.657368 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.657323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-config-volume\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.657368 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.657364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07d4c6de-55eb-45eb-8f3e-143c4659a67d-cert\") pod \"ingress-canary-4c248\" (UID: \"07d4c6de-55eb-45eb-8f3e-143c4659a67d\") " pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.657712 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.657382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5sq\" (UniqueName: \"kubernetes.io/projected/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-kube-api-access-2l5sq\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.657712 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.657418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.657712 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.657438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-tmp-dir\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.657712 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:13.657570    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:13.657712 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:13.657657    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:14.157633501 +0000 UTC m=+35.639456868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:13.658003 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.657837    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-tmp-dir\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.658134 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.658109    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-config-volume\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.661476 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.661448    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07d4c6de-55eb-45eb-8f3e-143c4659a67d-cert\") pod \"ingress-canary-4c248\" (UID: \"07d4c6de-55eb-45eb-8f3e-143c4659a67d\") " pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.666693 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.666671    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5sq\" (UniqueName: \"kubernetes.io/projected/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-kube-api-access-2l5sq\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:13.667021 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.667001    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4xk\" (UniqueName: \"kubernetes.io/projected/07d4c6de-55eb-45eb-8f3e-143c4659a67d-kube-api-access-ff4xk\") pod \"ingress-canary-4c248\" (UID: \"07d4c6de-55eb-45eb-8f3e-143c4659a67d\") " pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.743597 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.743547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4c248"
Jul 09 22:33:13.890945 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:13.890907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4c248"]
Jul 09 22:33:13.895203 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:33:13.895180    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d4c6de_55eb_45eb_8f3e_143c4659a67d.slice/crio-3e5478c1868e87d854e294b39d6a60cd68d08d5ced234897d54ed377d4154586 WatchSource:0}: Error finding container 3e5478c1868e87d854e294b39d6a60cd68d08d5ced234897d54ed377d4154586: Status 404 returned error can't find the container with id 3e5478c1868e87d854e294b39d6a60cd68d08d5ced234897d54ed377d4154586
Jul 09 22:33:14.036769 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.036693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:14.036930 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.036696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:14.039544 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.039525    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:33:14.040789 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.040760    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjswb\""
Jul 09 22:33:14.040917 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.040789    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:33:14.040917 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.040803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d8l99\""
Jul 09 22:33:14.040917 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.040747    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:33:14.161433 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.161400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:14.161580 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:14.161535    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:14.161628 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:14.161603    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:15.16158513 +0000 UTC m=+36.643408494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:14.218508 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:14.218470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4c248" event={"ID":"07d4c6de-55eb-45eb-8f3e-143c4659a67d","Type":"ContainerStarted","Data":"3e5478c1868e87d854e294b39d6a60cd68d08d5ced234897d54ed377d4154586"}
Jul 09 22:33:15.037087 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:15.036867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:15.039910 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:15.039888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:33:15.167869 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:15.167838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:15.168066 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:15.168037    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:15.168151 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:15.168123    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:17.168101736 +0000 UTC m=+38.649925105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:17.184208 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:17.184176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:17.184602 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:17.184353    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:17.184602 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:17.184423    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:21.184405273 +0000 UTC m=+42.666228638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:17.228010 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:17.227971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4c248" event={"ID":"07d4c6de-55eb-45eb-8f3e-143c4659a67d","Type":"ContainerStarted","Data":"370437e5a555d29277a3c18c781c629d145b1bc05115b3fa61e31612ff68dc62"}
Jul 09 22:33:17.244318 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:17.244258    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4c248" podStartSLOduration=1.5465265449999999 podStartE2EDuration="4.244237058s" totalImagesPullingTime="2.697710513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:17.244224156 +0000 UTC m=+38.726047542" watchObservedRunningTime="2026-07-09 22:33:17.244237058 +0000 UTC m=+38.726060447"
Jul 09 22:33:19.235369 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:19.235327    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb90fd78-cb1a-4009-860a-155f25bd679c" containerID="0ddccb57db14dad0cc8de8c4d12701af2dac277f8de571128b98fbbc55d0bc98" exitCode=0
Jul 09 22:33:19.235798 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:19.235372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerDied","Data":"0ddccb57db14dad0cc8de8c4d12701af2dac277f8de571128b98fbbc55d0bc98"}
Jul 09 22:33:20.239933 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:20.239898    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb90fd78-cb1a-4009-860a-155f25bd679c" containerID="b15a9f979286438dc33cf941ba23a5aac15441b81c8b4dce4bc6c8a36c6683da" exitCode=0
Jul 09 22:33:20.240312 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:20.239943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerDied","Data":"b15a9f979286438dc33cf941ba23a5aac15441b81c8b4dce4bc6c8a36c6683da"}
Jul 09 22:33:21.218733 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:21.218697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:21.218931 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:21.218852    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:21.218931 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:21.218911    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:29.21889514 +0000 UTC m=+50.700718510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:21.245104 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:21.245078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" event={"ID":"cb90fd78-cb1a-4009-860a-155f25bd679c","Type":"ContainerStarted","Data":"40894568c0125940f469fdad8a70eb16600ca66b069c290bb81f84e2400b00ea"}
Jul 09 22:33:21.271456 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:21.271407    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z2f8b" podStartSLOduration=17.918013035 podStartE2EDuration="43.271390101s" totalImagesPullingTime="25.353377066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:21.269541567 +0000 UTC m=+42.751364954" watchObservedRunningTime="2026-07-09 22:33:21.271390101 +0000 UTC m=+42.753213487"
Jul 09 22:33:29.270890 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:29.270855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:29.271275 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:29.270990    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:29.271275 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:29.271051    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:33:45.271036582 +0000 UTC m=+66.752859946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:39.219519 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:39.219492    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj8p9"
Jul 09 22:33:44.775541 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.775502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:44.776041 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.775565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:33:44.778663 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.778641    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:33:44.778755 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.778733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:33:44.785771 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:44.785749    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:33:44.785882 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:44.785817    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:34:48.785801245 +0000 UTC m=+130.267624608 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : secret "metrics-daemon-secret" not found
Jul 09 22:33:44.789004 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.788985    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7e7d3e0-f913-44e8-846c-b8448fc96cd0-original-pull-secret\") pod \"global-pull-secret-syncer-lkjbc\" (UID: \"a7e7d3e0-f913-44e8-846c-b8448fc96cd0\") " pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:44.876304 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.876283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:44.879354 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.879337    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:33:44.888816 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.888799    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:33:44.899238 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.899215    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btkfr\" (UniqueName: \"kubernetes.io/projected/a9a337fa-5f89-4a71-a886-c4296a87727e-kube-api-access-btkfr\") pod \"network-check-target-g2c72\" (UID: \"a9a337fa-5f89-4a71-a886-c4296a87727e\") " pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:44.950101 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.950079    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d8l99\""
Jul 09 22:33:44.957735 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:44.957718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:45.047812 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:45.047682    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkjbc"
Jul 09 22:33:45.076679 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:45.076635    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g2c72"]
Jul 09 22:33:45.080268 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:33:45.080237    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a337fa_5f89_4a71_a886_c4296a87727e.slice/crio-86e5fdeb70494bdac16f8a5d0c52d16d39a54252c68fc48fd9ff72ac3db9a875 WatchSource:0}: Error finding container 86e5fdeb70494bdac16f8a5d0c52d16d39a54252c68fc48fd9ff72ac3db9a875: Status 404 returned error can't find the container with id 86e5fdeb70494bdac16f8a5d0c52d16d39a54252c68fc48fd9ff72ac3db9a875
Jul 09 22:33:45.164424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:45.164307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkjbc"]
Jul 09 22:33:45.166573 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:33:45.166552    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e7d3e0_f913_44e8_846c_b8448fc96cd0.slice/crio-7ccceec03f04aca74bf159c71074aae1c5120efcfff7b34abaa227e6c7bfec91 WatchSource:0}: Error finding container 7ccceec03f04aca74bf159c71074aae1c5120efcfff7b34abaa227e6c7bfec91: Status 404 returned error can't find the container with id 7ccceec03f04aca74bf159c71074aae1c5120efcfff7b34abaa227e6c7bfec91
Jul 09 22:33:45.279378 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:45.279346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:33:45.279521 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:45.279476    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:33:45.279562 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:33:45.279534    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:34:17.279519841 +0000 UTC m=+98.761343205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:33:45.298962 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:45.298899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkjbc" event={"ID":"a7e7d3e0-f913-44e8-846c-b8448fc96cd0","Type":"ContainerStarted","Data":"7ccceec03f04aca74bf159c71074aae1c5120efcfff7b34abaa227e6c7bfec91"}
Jul 09 22:33:45.300029 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:45.300008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g2c72" event={"ID":"a9a337fa-5f89-4a71-a886-c4296a87727e","Type":"ContainerStarted","Data":"86e5fdeb70494bdac16f8a5d0c52d16d39a54252c68fc48fd9ff72ac3db9a875"}
Jul 09 22:33:49.312355 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:49.312311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g2c72" event={"ID":"a9a337fa-5f89-4a71-a886-c4296a87727e","Type":"ContainerStarted","Data":"b6dd2909347628165acb378502976fc2a2e8fcafa8d20950151eb055a8c3e2d5"}
Jul 09 22:33:49.312866 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:49.312406    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:33:49.330970 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:49.330894    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g2c72" podStartSLOduration=68.033133142 podStartE2EDuration="1m11.330877051s" totalImagesPullingTime="3.297743909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:49.330569134 +0000 UTC m=+70.812392521" watchObservedRunningTime="2026-07-09 22:33:49.330877051 +0000 UTC m=+70.812700438"
Jul 09 22:33:50.316152 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:50.316111    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkjbc" event={"ID":"a7e7d3e0-f913-44e8-846c-b8448fc96cd0","Type":"ContainerStarted","Data":"6ab6854de082477fcac4046962c0789725d883ca71e4dd38d9e40e7cea6bbe09"}
Jul 09 22:33:50.333757 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:50.333709    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkjbc" podStartSLOduration=67.598082802 podStartE2EDuration="1m12.333694388s" totalImagesPullingTime="4.735611586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:50.33314855 +0000 UTC m=+71.814971937" watchObservedRunningTime="2026-07-09 22:33:50.333694388 +0000 UTC m=+71.815517773"
Jul 09 22:33:53.386408 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.386371    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"]
Jul 09 22:33:53.388991 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.388970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.391689 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.391665    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 22:33:53.393185 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.393152    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 22:33:53.393296 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.393210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 22:33:53.393296 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.393233    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gv9r2\""
Jul 09 22:33:53.393296 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.393210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 22:33:53.399478 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.399461    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"]
Jul 09 22:33:53.431010 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.430984    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"]
Jul 09 22:33:53.432791 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.432755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.435409 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.435392    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 22:33:53.438242 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.438141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks9jw\" (UniqueName: \"kubernetes.io/projected/25d30f9e-a7ac-4994-aeb2-221832e80f1d-kube-api-access-ks9jw\") pod \"managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq\" (UID: \"25d30f9e-a7ac-4994-aeb2-221832e80f1d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.438242 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.438191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25d30f9e-a7ac-4994-aeb2-221832e80f1d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq\" (UID: \"25d30f9e-a7ac-4994-aeb2-221832e80f1d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.444519 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.444500    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"]
Jul 09 22:33:53.538904 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.538877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25d30f9e-a7ac-4994-aeb2-221832e80f1d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq\" (UID: \"25d30f9e-a7ac-4994-aeb2-221832e80f1d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.539008 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.538937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-tmp\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.539008 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.538960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks9jw\" (UniqueName: \"kubernetes.io/projected/25d30f9e-a7ac-4994-aeb2-221832e80f1d-kube-api-access-ks9jw\") pod \"managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq\" (UID: \"25d30f9e-a7ac-4994-aeb2-221832e80f1d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.539008 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.538975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.539008 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.539003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6rz2\" (UniqueName: \"kubernetes.io/projected/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-kube-api-access-c6rz2\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.541205 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.541186    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25d30f9e-a7ac-4994-aeb2-221832e80f1d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq\" (UID: \"25d30f9e-a7ac-4994-aeb2-221832e80f1d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.547714 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.547695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks9jw\" (UniqueName: \"kubernetes.io/projected/25d30f9e-a7ac-4994-aeb2-221832e80f1d-kube-api-access-ks9jw\") pod \"managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq\" (UID: \"25d30f9e-a7ac-4994-aeb2-221832e80f1d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.639975 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.639916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-tmp\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.639975 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.639954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.639975 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.639975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6rz2\" (UniqueName: \"kubernetes.io/projected/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-kube-api-access-c6rz2\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.640346 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.640328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-tmp\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.642134 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.642116    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.648326 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.648301    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6rz2\" (UniqueName: \"kubernetes.io/projected/f2259d30-dba7-4a6f-a7a9-cae3b7d6f298-kube-api-access-c6rz2\") pod \"klusterlet-addon-workmgr-7f7778b498-9lwfl\" (UID: \"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.713295 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.713269    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"
Jul 09 22:33:53.740711 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.740685    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:53.848618 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.848593    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq"]
Jul 09 22:33:53.851115 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:33:53.851084    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25d30f9e_a7ac_4994_aeb2_221832e80f1d.slice/crio-473b7f7aa6325a29aed98e8c0a2659f708e087b30ff1518dfb34569ef153ce15 WatchSource:0}: Error finding container 473b7f7aa6325a29aed98e8c0a2659f708e087b30ff1518dfb34569ef153ce15: Status 404 returned error can't find the container with id 473b7f7aa6325a29aed98e8c0a2659f708e087b30ff1518dfb34569ef153ce15
Jul 09 22:33:53.867172 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:53.867152    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"]
Jul 09 22:33:53.870565 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:33:53.870541    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2259d30_dba7_4a6f_a7a9_cae3b7d6f298.slice/crio-f7c7c2a4ed04d6660d31af41b3582619c29e2481511706405baee85dea656979 WatchSource:0}: Error finding container f7c7c2a4ed04d6660d31af41b3582619c29e2481511706405baee85dea656979: Status 404 returned error can't find the container with id f7c7c2a4ed04d6660d31af41b3582619c29e2481511706405baee85dea656979
Jul 09 22:33:54.326252 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:54.326218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq" event={"ID":"25d30f9e-a7ac-4994-aeb2-221832e80f1d","Type":"ContainerStarted","Data":"473b7f7aa6325a29aed98e8c0a2659f708e087b30ff1518dfb34569ef153ce15"}
Jul 09 22:33:54.327268 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:54.327246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl" event={"ID":"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298","Type":"ContainerStarted","Data":"f7c7c2a4ed04d6660d31af41b3582619c29e2481511706405baee85dea656979"}
Jul 09 22:33:58.341972 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:58.341928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq" event={"ID":"25d30f9e-a7ac-4994-aeb2-221832e80f1d","Type":"ContainerStarted","Data":"814b40119d799ef30dfea225b1f11d5ea83727b841da3cdd7da82b5a9445770f"}
Jul 09 22:33:58.343380 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:58.343353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl" event={"ID":"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298","Type":"ContainerStarted","Data":"8bab009acbd886b09ad224eae76a6690ca69e65eaedd34d04af87753fd5487e8"}
Jul 09 22:33:58.343559 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:58.343547    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:58.345092 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:58.345075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:33:58.358076 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:58.358039    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq" podStartSLOduration=1.39716242 podStartE2EDuration="5.358026948s" totalImagesPullingTime="3.960864528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:58.357269146 +0000 UTC m=+79.839092531" watchObservedRunningTime="2026-07-09 22:33:58.358026948 +0000 UTC m=+79.839850333"
Jul 09 22:33:58.374068 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:33:58.374032    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl" podStartSLOduration=1.422137146 podStartE2EDuration="5.374020644s" totalImagesPullingTime="3.951883498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:58.37353975 +0000 UTC m=+79.855363138" watchObservedRunningTime="2026-07-09 22:33:58.374020644 +0000 UTC m=+79.855844030"
Jul 09 22:34:17.297792 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:34:17.297743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:34:17.298175 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:34:17.297888    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:34:17.298175 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:34:17.297951    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:35:21.297934512 +0000 UTC m=+162.779757876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:34:20.318338 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:34:20.318308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g2c72"
Jul 09 22:34:48.788036 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:34:48.787986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:34:48.788503 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:34:48.788125    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:34:48.788503 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:34:48.788193    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:36:50.78817813 +0000 UTC m=+252.270001493 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : secret "metrics-daemon-secret" not found
Jul 09 22:35:16.438308 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:35:16.438266    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-scvhq" podUID="a5c4d66a-ed79-4cf4-8005-c955f57ffc55"
Jul 09 22:35:16.553855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:16.553822    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scvhq"
Jul 09 22:35:17.051946 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:35:17.051909    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:35:21.310492 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:21.310449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:35:21.310893 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:35:21.310557    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:35:21.310893 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:35:21.310607    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls podName:a5c4d66a-ed79-4cf4-8005-c955f57ffc55 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:23.310594823 +0000 UTC m=+284.792418187 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls") pod "dns-default-scvhq" (UID: "a5c4d66a-ed79-4cf4-8005-c955f57ffc55") : secret "dns-default-metrics-tls" not found
Jul 09 22:35:28.037576 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:28.037519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:35:58.344179 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:58.344133    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl" podUID="f2259d30-dba7-4a6f-a7a9-cae3b7d6f298" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Jul 09 22:35:58.668231 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:58.668145    2576 generic.go:356] "Generic (PLEG): container finished" podID="f2259d30-dba7-4a6f-a7a9-cae3b7d6f298" containerID="8bab009acbd886b09ad224eae76a6690ca69e65eaedd34d04af87753fd5487e8" exitCode=1
Jul 09 22:35:58.668231 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:58.668221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl" event={"ID":"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298","Type":"ContainerDied","Data":"8bab009acbd886b09ad224eae76a6690ca69e65eaedd34d04af87753fd5487e8"}
Jul 09 22:35:58.668581 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:58.668550    2576 scope.go:117] "RemoveContainer" containerID="8bab009acbd886b09ad224eae76a6690ca69e65eaedd34d04af87753fd5487e8"
Jul 09 22:35:58.669720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:58.669695    2576 generic.go:356] "Generic (PLEG): container finished" podID="25d30f9e-a7ac-4994-aeb2-221832e80f1d" containerID="814b40119d799ef30dfea225b1f11d5ea83727b841da3cdd7da82b5a9445770f" exitCode=255
Jul 09 22:35:58.669840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:58.669729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq" event={"ID":"25d30f9e-a7ac-4994-aeb2-221832e80f1d","Type":"ContainerDied","Data":"814b40119d799ef30dfea225b1f11d5ea83727b841da3cdd7da82b5a9445770f"}
Jul 09 22:35:58.675353 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:58.675337    2576 scope.go:117] "RemoveContainer" containerID="814b40119d799ef30dfea225b1f11d5ea83727b841da3cdd7da82b5a9445770f"
Jul 09 22:35:59.673812 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:59.673760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b6d9f6b6-p4jjq" event={"ID":"25d30f9e-a7ac-4994-aeb2-221832e80f1d","Type":"ContainerStarted","Data":"938f881c17d4f65b96a6929da32d91b7b38f0f4b47df5fef5a1d981c20348b6d"}
Jul 09 22:35:59.675552 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:59.675526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl" event={"ID":"f2259d30-dba7-4a6f-a7a9-cae3b7d6f298","Type":"ContainerStarted","Data":"c79beec36a65f164ae59a16d4e7751c851869cbe0796ac34191865e2b1c7c26e"}
Jul 09 22:35:59.675801 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:59.675786    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:35:59.679594 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:35:59.679572    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f7778b498-9lwfl"
Jul 09 22:36:50.799080 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:50.799041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:36:50.799532 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:50.799168    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:36:50.799532 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:50.799230    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs podName:dc07053a-3a65-4a47-8a8b-fe1646890faf nodeName:}" failed. No retries permitted until 2026-07-09 22:38:52.799215797 +0000 UTC m=+374.281039162 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs") pod "network-metrics-daemon-sprcl" (UID: "dc07053a-3a65-4a47-8a8b-fe1646890faf") : secret "metrics-daemon-secret" not found
Jul 09 22:36:53.304057 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.304026    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-757b46bf55-4nxhf"]
Jul 09 22:36:53.306003 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.305982    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.309368 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.309345    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.309507 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.309404    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 22:36:53.309984 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.309963    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 22:36:53.310164 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.309969    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 22:36:53.310231 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.310196    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.310303 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.310288    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tsbdk\""
Jul 09 22:36:53.310804 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.310792    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 22:36:53.329331 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.329307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-757b46bf55-4nxhf"]
Jul 09 22:36:53.399735 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.399712    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"]
Jul 09 22:36:53.401538 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.401525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.404394 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.404377    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 09 22:36:53.404837 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.404819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 09 22:36:53.405314 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.405299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:36:53.405383 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.405371    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4kjfv\""
Jul 09 22:36:53.405433 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.405379    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 09 22:36:53.412204 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.412186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-default-certificate\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.412281 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.412210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-stats-auth\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.412281 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.412240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.412351 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.412339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65ddk\" (UniqueName: \"kubernetes.io/projected/f33d731e-5a76-4dea-ac58-0b8fd82779b9-kube-api-access-65ddk\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.412384 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.412363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.415152 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.415131    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"]
Jul 09 22:36:53.513452 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65ddk\" (UniqueName: \"kubernetes.io/projected/f33d731e-5a76-4dea-ac58-0b8fd82779b9-kube-api-access-65ddk\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.513452 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.513615 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-default-certificate\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.513615 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-stats-auth\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.513615 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34dc3511-2f8a-4461-a27e-a8dc5952910d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.513615 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34dc3511-2f8a-4461-a27e-a8dc5952910d-config\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.513615 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:53.513565    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 22:36:53.513892 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:53.513627    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:54.013606078 +0000 UTC m=+255.495429444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : secret "router-metrics-certs-default" not found
Jul 09 22:36:53.513892 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwvw\" (UniqueName: \"kubernetes.io/projected/34dc3511-2f8a-4461-a27e-a8dc5952910d-kube-api-access-rtwvw\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.513892 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.513681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.513892 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:53.513764    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:54.013756025 +0000 UTC m=+255.495579389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : configmap references non-existent config key: service-ca.crt
Jul 09 22:36:53.515819 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.515801    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-stats-auth\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.515905 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.515858    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-default-certificate\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.523829 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.523807    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65ddk\" (UniqueName: \"kubernetes.io/projected/f33d731e-5a76-4dea-ac58-0b8fd82779b9-kube-api-access-65ddk\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:53.614258 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.614234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34dc3511-2f8a-4461-a27e-a8dc5952910d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.614401 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.614265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34dc3511-2f8a-4461-a27e-a8dc5952910d-config\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.614401 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.614283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwvw\" (UniqueName: \"kubernetes.io/projected/34dc3511-2f8a-4461-a27e-a8dc5952910d-kube-api-access-rtwvw\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.614813 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.614770    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34dc3511-2f8a-4461-a27e-a8dc5952910d-config\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.616247 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.616230    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34dc3511-2f8a-4461-a27e-a8dc5952910d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.622868 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.622843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwvw\" (UniqueName: \"kubernetes.io/projected/34dc3511-2f8a-4461-a27e-a8dc5952910d-kube-api-access-rtwvw\") pod \"service-ca-operator-5d46d9ffd4-ltsdj\" (UID: \"34dc3511-2f8a-4461-a27e-a8dc5952910d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.709922 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.709895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"
Jul 09 22:36:53.826969 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:53.826943    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj"]
Jul 09 22:36:53.830219 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:36:53.830194    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dc3511_2f8a_4461_a27e_a8dc5952910d.slice/crio-fd9ccde6c96de730f886245440392cba77374a2d8c9f3cd23cac98b104ef615e WatchSource:0}: Error finding container fd9ccde6c96de730f886245440392cba77374a2d8c9f3cd23cac98b104ef615e: Status 404 returned error can't find the container with id fd9ccde6c96de730f886245440392cba77374a2d8c9f3cd23cac98b104ef615e
Jul 09 22:36:54.017584 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:54.017511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:54.017584 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:54.017566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:54.017765 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:54.017644    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 22:36:54.017765 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:54.017700    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:55.017684242 +0000 UTC m=+256.499507611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : secret "router-metrics-certs-default" not found
Jul 09 22:36:54.017765 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:54.017713    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:55.017707185 +0000 UTC m=+256.499530549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : configmap references non-existent config key: service-ca.crt
Jul 09 22:36:54.829719 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:54.829687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj" event={"ID":"34dc3511-2f8a-4461-a27e-a8dc5952910d","Type":"ContainerStarted","Data":"fd9ccde6c96de730f886245440392cba77374a2d8c9f3cd23cac98b104ef615e"}
Jul 09 22:36:55.024675 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:55.024636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:55.024872 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:55.024715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:55.024872 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:55.024810    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 22:36:55.025005 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:55.024875    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:57.024855508 +0000 UTC m=+258.506678876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : configmap references non-existent config key: service-ca.crt
Jul 09 22:36:55.025005 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:55.024896    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:57.024887433 +0000 UTC m=+258.506710801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : secret "router-metrics-certs-default" not found
Jul 09 22:36:56.837691 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:56.837624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj" event={"ID":"34dc3511-2f8a-4461-a27e-a8dc5952910d","Type":"ContainerStarted","Data":"92baebef54ded1184387bd96b03e5d277f2bd0a195ca6651fd710eeca2ce89cf"}
Jul 09 22:36:56.854630 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:56.854580    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj" podStartSLOduration=1.464753446 podStartE2EDuration="3.854565194s" totalImagesPullingTime="2.389811748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:56.852532011 +0000 UTC m=+258.334355398" watchObservedRunningTime="2026-07-09 22:36:56.854565194 +0000 UTC m=+258.336388579"
Jul 09 22:36:57.041498 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:57.041471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:57.041683 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:57.041530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:36:57.041683 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:57.041622    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 22:36:57.041683 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:57.041650    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.041628262 +0000 UTC m=+262.523451626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : configmap references non-existent config key: service-ca.crt
Jul 09 22:36:57.041683 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:57.041670    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.041661743 +0000 UTC m=+262.523485111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : secret "router-metrics-certs-default" not found
Jul 09 22:36:58.030587 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.030552    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nt5c6"]
Jul 09 22:36:58.033794 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.033762    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.036893 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.036868    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pvkvm\""
Jul 09 22:36:58.037006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.036870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 22:36:58.037917 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.037889    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 22:36:58.038045 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.038006    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 22:36:58.038045 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.038033    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 22:36:58.045813 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.045770    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nt5c6"]
Jul 09 22:36:58.149168 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.149140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1fc9281-f315-460d-a892-d3b469fb0d29-data-volume\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.149297 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.149176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1fc9281-f315-460d-a892-d3b469fb0d29-crio-socket\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.149297 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.149208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxh5b\" (UniqueName: \"kubernetes.io/projected/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-api-access-jxh5b\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.149297 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.149250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.149297 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.149284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.250002 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.249976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.250100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.250038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1fc9281-f315-460d-a892-d3b469fb0d29-data-volume\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.250100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.250056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1fc9281-f315-460d-a892-d3b469fb0d29-crio-socket\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.250100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.250074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxh5b\" (UniqueName: \"kubernetes.io/projected/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-api-access-jxh5b\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.250242 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.250101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.250242 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.250112    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:58.250242 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.250156    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.250242 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.250173    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:58.750154143 +0000 UTC m=+260.231977510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:58.250242 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.250167    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1fc9281-f315-460d-a892-d3b469fb0d29-crio-socket\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.250242 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.250194    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:58.750182967 +0000 UTC m=+260.232006332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.250502 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.250384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1fc9281-f315-460d-a892-d3b469fb0d29-data-volume\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.260559 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.260531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxh5b\" (UniqueName: \"kubernetes.io/projected/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-api-access-jxh5b\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.753836 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.753797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.754004 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:58.753848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:58.754004 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.753852    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.754004 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.753929    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:59.753907834 +0000 UTC m=+261.235731211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : configmap "kube-rbac-proxy" not found
Jul 09 22:36:58.754004 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.753999    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:58.754204 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:58.754062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:36:59.754047735 +0000 UTC m=+261.235871102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:59.761100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:59.761071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:59.761100 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:36:59.761103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:36:59.761511 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:59.761188    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:36:59.761511 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:59.761200    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:36:59.761511 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:59.761245    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.761230652 +0000 UTC m=+263.243054017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : configmap "kube-rbac-proxy" not found
Jul 09 22:36:59.761511 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:36:59.761259    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:01.761252795 +0000 UTC m=+263.243076160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:00.010936 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:00.010900    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qnnt7_753b0678-cea9-43dd-8ad3-c877bba38890/dns-node-resolver/0.log"
Jul 09 22:37:01.006766 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:01.006698    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ljvbg_bc362340-c7bb-4c6d-ba2f-28d38341dabf/node-ca/0.log"
Jul 09 22:37:01.071448 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:01.071419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:01.071582 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:01.071494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:01.071624 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:01.071581    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:09.071563551 +0000 UTC m=+270.553386918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : configmap references non-existent config key: service-ca.crt
Jul 09 22:37:01.071624 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:01.071597    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 22:37:01.071693 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:01.071638    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:09.071624525 +0000 UTC m=+270.553447890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : secret "router-metrics-certs-default" not found
Jul 09 22:37:01.606657 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:01.606633    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4c248_07d4c6de-55eb-45eb-8f3e-143c4659a67d/serve-healthcheck-canary/0.log"
Jul 09 22:37:01.776604 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:01.776560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:01.776604 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:01.776608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:01.776834 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:01.776686    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:37:01.776834 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:01.776730    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:01.776834 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:01.776750    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:05.776734599 +0000 UTC m=+267.258557963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : configmap "kube-rbac-proxy" not found
Jul 09 22:37:01.776834 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:01.776770    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:05.776757307 +0000 UTC m=+267.258580671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:05.805010 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:05.804972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:05.805010 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:05.805015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:05.805460 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:05.805097    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:37:05.805460 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:05.805119    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:05.805460 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:05.805162    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:13.805147688 +0000 UTC m=+275.286971052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : configmap "kube-rbac-proxy" not found
Jul 09 22:37:05.805460 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:05.805176    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:13.805169837 +0000 UTC m=+275.286993200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:09.130036 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:09.129998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:09.130426 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:09.130071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:09.130426 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:09.130170    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle podName:f33d731e-5a76-4dea-ac58-0b8fd82779b9 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:25.130153378 +0000 UTC m=+286.611976743 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle") pod "router-default-757b46bf55-4nxhf" (UID: "f33d731e-5a76-4dea-ac58-0b8fd82779b9") : configmap references non-existent config key: service-ca.crt
Jul 09 22:37:09.132480 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:09.132442    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f33d731e-5a76-4dea-ac58-0b8fd82779b9-metrics-certs\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:13.863161 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:13.863111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:13.863161 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:13.863168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:13.863616 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:13.863286    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:13.863616 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:13.863337    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls podName:a1fc9281-f315-460d-a892-d3b469fb0d29 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:29.863324001 +0000 UTC m=+291.345147364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt5c6" (UID: "a1fc9281-f315-460d-a892-d3b469fb0d29") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:37:13.863616 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:13.863603    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1fc9281-f315-460d-a892-d3b469fb0d29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:19.554456 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:19.554417    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-scvhq" podUID="a5c4d66a-ed79-4cf4-8005-c955f57ffc55"
Jul 09 22:37:19.904387 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:19.904360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scvhq"
Jul 09 22:37:21.631964 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.631931    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-766c7c59d6-2zgtw"]
Jul 09 22:37:21.635034 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.635013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.638949 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.638926    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 22:37:21.639382 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.639365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 22:37:21.639472 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.639396    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 22:37:21.640272 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.640251    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6gjz6\""
Jul 09 22:37:21.644857 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.644839    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 22:37:21.658310 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.658288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766c7c59d6-2zgtw"]
Jul 09 22:37:21.720687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a97aca7-18a0-47be-8859-4d44647d6384-image-registry-private-configuration\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.720813 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a97aca7-18a0-47be-8859-4d44647d6384-registry-certificates\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.720813 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbbd\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-kube-api-access-sqbbd\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.720813 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-registry-tls\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.720938 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a97aca7-18a0-47be-8859-4d44647d6384-installation-pull-secrets\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.720938 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a97aca7-18a0-47be-8859-4d44647d6384-ca-trust-extracted\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.720938 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a97aca7-18a0-47be-8859-4d44647d6384-trusted-ca\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.720938 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.720915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-bound-sa-token\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821430 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-bound-sa-token\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a97aca7-18a0-47be-8859-4d44647d6384-image-registry-private-configuration\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a97aca7-18a0-47be-8859-4d44647d6384-registry-certificates\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbbd\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-kube-api-access-sqbbd\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-registry-tls\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821764 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a97aca7-18a0-47be-8859-4d44647d6384-installation-pull-secrets\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821764 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a97aca7-18a0-47be-8859-4d44647d6384-ca-trust-extracted\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.821764 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.821716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a97aca7-18a0-47be-8859-4d44647d6384-trusted-ca\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.822278 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.822230    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a97aca7-18a0-47be-8859-4d44647d6384-ca-trust-extracted\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.822631 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.822603    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a97aca7-18a0-47be-8859-4d44647d6384-trusted-ca\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.822729 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.822659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a97aca7-18a0-47be-8859-4d44647d6384-registry-certificates\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.824091 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.824071    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-registry-tls\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.824177 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.824106    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a97aca7-18a0-47be-8859-4d44647d6384-image-registry-private-configuration\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.824250 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.824230    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a97aca7-18a0-47be-8859-4d44647d6384-installation-pull-secrets\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.830053 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.830030    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-bound-sa-token\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.830514 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.830490    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbbd\" (UniqueName: \"kubernetes.io/projected/5a97aca7-18a0-47be-8859-4d44647d6384-kube-api-access-sqbbd\") pod \"image-registry-766c7c59d6-2zgtw\" (UID: \"5a97aca7-18a0-47be-8859-4d44647d6384\") " pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:21.944687 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:21.944603    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:22.067644 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:22.067489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766c7c59d6-2zgtw"]
Jul 09 22:37:22.070032 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:22.070004    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a97aca7_18a0_47be_8859_4d44647d6384.slice/crio-4d8e6f1a32d11b7e3881dbc2c419ea5110365a0bc99bc5b564c5f7506e6fff3d WatchSource:0}: Error finding container 4d8e6f1a32d11b7e3881dbc2c419ea5110365a0bc99bc5b564c5f7506e6fff3d: Status 404 returned error can't find the container with id 4d8e6f1a32d11b7e3881dbc2c419ea5110365a0bc99bc5b564c5f7506e6fff3d
Jul 09 22:37:22.913747 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:22.913702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw" event={"ID":"5a97aca7-18a0-47be-8859-4d44647d6384","Type":"ContainerStarted","Data":"e053cd254293e673d85375f8f0eb14a612fe6262391b902c7f72341dc04b5d38"}
Jul 09 22:37:22.914170 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:22.913810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw" event={"ID":"5a97aca7-18a0-47be-8859-4d44647d6384","Type":"ContainerStarted","Data":"4d8e6f1a32d11b7e3881dbc2c419ea5110365a0bc99bc5b564c5f7506e6fff3d"}
Jul 09 22:37:22.914170 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:22.913930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:22.933934 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:22.933888    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw" podStartSLOduration=1.933873596 podStartE2EDuration="1.933873596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:22.932746991 +0000 UTC m=+284.414570377" watchObservedRunningTime="2026-07-09 22:37:22.933873596 +0000 UTC m=+284.415696981"
Jul 09 22:37:23.333184 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:23.333159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:37:23.335482 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:23.335457    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5c4d66a-ed79-4cf4-8005-c955f57ffc55-metrics-tls\") pod \"dns-default-scvhq\" (UID: \"a5c4d66a-ed79-4cf4-8005-c955f57ffc55\") " pod="openshift-dns/dns-default-scvhq"
Jul 09 22:37:23.507823 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:23.507797    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xdqcx\""
Jul 09 22:37:23.515468 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:23.515446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-scvhq"
Jul 09 22:37:23.635753 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:23.635725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-scvhq"]
Jul 09 22:37:23.638362 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:23.638336    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c4d66a_ed79_4cf4_8005_c955f57ffc55.slice/crio-b68f17e4885424b8812da81bb033eea3a09adc7632740104ff80c19f2f912b06 WatchSource:0}: Error finding container b68f17e4885424b8812da81bb033eea3a09adc7632740104ff80c19f2f912b06: Status 404 returned error can't find the container with id b68f17e4885424b8812da81bb033eea3a09adc7632740104ff80c19f2f912b06
Jul 09 22:37:23.918010 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:23.917928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-scvhq" event={"ID":"a5c4d66a-ed79-4cf4-8005-c955f57ffc55","Type":"ContainerStarted","Data":"b68f17e4885424b8812da81bb033eea3a09adc7632740104ff80c19f2f912b06"}
Jul 09 22:37:25.147992 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.147964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:25.148685 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.148661    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33d731e-5a76-4dea-ac58-0b8fd82779b9-service-ca-bundle\") pod \"router-default-757b46bf55-4nxhf\" (UID: \"f33d731e-5a76-4dea-ac58-0b8fd82779b9\") " pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:25.414907 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.414753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:25.553523 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.553487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-757b46bf55-4nxhf"]
Jul 09 22:37:25.557681 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:25.557653    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33d731e_5a76_4dea_ac58_0b8fd82779b9.slice/crio-134a73e2ca72957bddc958aad21315b2535d0114c19a0d05e089d51e07cb6b89 WatchSource:0}: Error finding container 134a73e2ca72957bddc958aad21315b2535d0114c19a0d05e089d51e07cb6b89: Status 404 returned error can't find the container with id 134a73e2ca72957bddc958aad21315b2535d0114c19a0d05e089d51e07cb6b89
Jul 09 22:37:25.925830 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.925797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-scvhq" event={"ID":"a5c4d66a-ed79-4cf4-8005-c955f57ffc55","Type":"ContainerStarted","Data":"8a44c8bf1a5d427c5647b5e5142b35ed5a077b806a46dce905b577ca87775729"}
Jul 09 22:37:25.926024 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.925929    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-scvhq"
Jul 09 22:37:25.926024 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.925975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-scvhq" event={"ID":"a5c4d66a-ed79-4cf4-8005-c955f57ffc55","Type":"ContainerStarted","Data":"9558ed4a6352edb751ed761e64b407faf79c8f8c456d69920f6e24a6a447056c"}
Jul 09 22:37:25.927185 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.927163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-757b46bf55-4nxhf" event={"ID":"f33d731e-5a76-4dea-ac58-0b8fd82779b9","Type":"ContainerStarted","Data":"66dc3619c8e04d3b516e97578a944c42f215ca81f58906afd203dd4eb880c9a0"}
Jul 09 22:37:25.927298 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.927194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-757b46bf55-4nxhf" event={"ID":"f33d731e-5a76-4dea-ac58-0b8fd82779b9","Type":"ContainerStarted","Data":"134a73e2ca72957bddc958aad21315b2535d0114c19a0d05e089d51e07cb6b89"}
Jul 09 22:37:25.943936 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.943895    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-scvhq" podStartSLOduration=251.181663476 podStartE2EDuration="4m12.943882552s" totalImagesPullingTime="1.762219076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:25.943005164 +0000 UTC m=+287.424828549" watchObservedRunningTime="2026-07-09 22:37:25.943882552 +0000 UTC m=+287.425705946"
Jul 09 22:37:25.971727 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:25.971689    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-757b46bf55-4nxhf" podStartSLOduration=32.971675379 podStartE2EDuration="32.971675379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:25.971095444 +0000 UTC m=+287.452918831" watchObservedRunningTime="2026-07-09 22:37:25.971675379 +0000 UTC m=+287.453498773"
Jul 09 22:37:26.415531 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:26.415499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:26.418250 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:26.418227    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:26.930858 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:26.930823    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:26.931861 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:26.931841    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-757b46bf55-4nxhf"
Jul 09 22:37:29.886945 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:29.886903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:29.889168 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:29.889146    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1fc9281-f315-460d-a892-d3b469fb0d29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt5c6\" (UID: \"a1fc9281-f315-460d-a892-d3b469fb0d29\") " pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:30.142412 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:30.142333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nt5c6"
Jul 09 22:37:30.265899 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:30.265870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nt5c6"]
Jul 09 22:37:30.268596 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:30.268573    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1fc9281_f315_460d_a892_d3b469fb0d29.slice/crio-27f697cf609d2a3b4b086c8b567cc05b5173f80d0055f6874514d323fa3251aa WatchSource:0}: Error finding container 27f697cf609d2a3b4b086c8b567cc05b5173f80d0055f6874514d323fa3251aa: Status 404 returned error can't find the container with id 27f697cf609d2a3b4b086c8b567cc05b5173f80d0055f6874514d323fa3251aa
Jul 09 22:37:30.945675 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:30.945640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt5c6" event={"ID":"a1fc9281-f315-460d-a892-d3b469fb0d29","Type":"ContainerStarted","Data":"27f697cf609d2a3b4b086c8b567cc05b5173f80d0055f6874514d323fa3251aa"}
Jul 09 22:37:31.038631 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:31.038586    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sprcl" podUID="dc07053a-3a65-4a47-8a8b-fe1646890faf"
Jul 09 22:37:31.360634 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.360601    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"]
Jul 09 22:37:31.363564 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.363545    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.366535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.366509    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 22:37:31.368070 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.367890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 22:37:31.368070 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.367915    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 22:37:31.368070 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.367934    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 22:37:31.368070 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.367895    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 22:37:31.368337 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.368259    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2hlkj\""
Jul 09 22:37:31.374978 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.374948    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"]
Jul 09 22:37:31.398502 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.398473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.398637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.398566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.398637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.398608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86mz6\" (UniqueName: \"kubernetes.io/projected/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-kube-api-access-86mz6\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.398637 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.398631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.499653 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.499620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86mz6\" (UniqueName: \"kubernetes.io/projected/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-kube-api-access-86mz6\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.499851 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.499661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.499851 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.499685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.499851 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.499788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.499851 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:31.499799    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 09 22:37:31.500079 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:31.499868    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-tls podName:f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:31.999849728 +0000 UTC m=+293.481673096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-gwcpk" (UID: "f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26") : secret "prometheus-operator-tls" not found
Jul 09 22:37:31.500513 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.500479    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.502473 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.502449    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:31.508721 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:31.508697    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86mz6\" (UniqueName: \"kubernetes.io/projected/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-kube-api-access-86mz6\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:32.004751 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:32.004711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:32.007276 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:32.007248    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gwcpk\" (UID: \"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:32.274490 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:32.274401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"
Jul 09 22:37:33.946121 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.945154    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-765f97b679-pdclk"]
Jul 09 22:37:33.949601 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.949577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:33.952564 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.952541    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 22:37:33.952682 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.952609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xrw77\""
Jul 09 22:37:33.952682 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.952617    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 22:37:33.954019 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.953995    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 22:37:33.954121 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.954109    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 22:37:33.954184 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.954112    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 22:37:33.954237 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.954219    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 22:37:33.954383 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.954367    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 22:37:33.958508 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.958475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765f97b679-pdclk"]
Jul 09 22:37:33.981421 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:33.981395    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk"]
Jul 09 22:37:33.984238 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:33.984215    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2017e89_9dfc_42e9_a4b5_8fb1dd0aba26.slice/crio-26c74728b213e925f49ada3c9d383d69ccc97d61efae31b960754508f5c02540 WatchSource:0}: Error finding container 26c74728b213e925f49ada3c9d383d69ccc97d61efae31b960754508f5c02540: Status 404 returned error can't find the container with id 26c74728b213e925f49ada3c9d383d69ccc97d61efae31b960754508f5c02540
Jul 09 22:37:34.024974 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.024944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-service-ca\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.024974 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.024977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-oauth-serving-cert\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.025221 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.024999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-oauth-config\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.025221 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.025026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-serving-cert\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.025221 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.025086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-console-config\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.025221 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.025115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dn6v\" (UniqueName: \"kubernetes.io/projected/6d87357e-916a-4322-999f-9ef82fe0a57e-kube-api-access-4dn6v\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.126440 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.126349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-console-config\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.126440 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.126397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dn6v\" (UniqueName: \"kubernetes.io/projected/6d87357e-916a-4322-999f-9ef82fe0a57e-kube-api-access-4dn6v\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.126440 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.126444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-service-ca\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.126677 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.126462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-oauth-serving-cert\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.126677 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.126499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-oauth-config\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.126677 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.126518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-serving-cert\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.127186 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.127158    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-oauth-serving-cert\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.127294 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.127199    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-console-config\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.127294 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.127199    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-service-ca\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.129052 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.129023    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-oauth-config\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.129136 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.129087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-serving-cert\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.135178 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.135148    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dn6v\" (UniqueName: \"kubernetes.io/projected/6d87357e-916a-4322-999f-9ef82fe0a57e-kube-api-access-4dn6v\") pod \"console-765f97b679-pdclk\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") " pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.273924 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.273891    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:37:34.407536 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.407454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765f97b679-pdclk"]
Jul 09 22:37:34.411218 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:34.411175    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d87357e_916a_4322_999f_9ef82fe0a57e.slice/crio-bb8e0985846fccc0920e1b609117a22b4302a06f614b2c645883f51361340b28 WatchSource:0}: Error finding container bb8e0985846fccc0920e1b609117a22b4302a06f614b2c645883f51361340b28: Status 404 returned error can't find the container with id bb8e0985846fccc0920e1b609117a22b4302a06f614b2c645883f51361340b28
Jul 09 22:37:34.963059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.963022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk" event={"ID":"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26","Type":"ContainerStarted","Data":"26c74728b213e925f49ada3c9d383d69ccc97d61efae31b960754508f5c02540"}
Jul 09 22:37:34.964671 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.964643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt5c6" event={"ID":"a1fc9281-f315-460d-a892-d3b469fb0d29","Type":"ContainerStarted","Data":"8ad16bc9ff128ad44eb78d94e1b1b73dc7cf913be060bad5d553967a7f43b5a4"}
Jul 09 22:37:34.964809 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.964693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt5c6" event={"ID":"a1fc9281-f315-460d-a892-d3b469fb0d29","Type":"ContainerStarted","Data":"94bffd8aefa9d6e3af135db7ec7dd7ca1dbbdf3d49377e25ea96ce7802fa1a78"}
Jul 09 22:37:34.965738 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:34.965717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765f97b679-pdclk" event={"ID":"6d87357e-916a-4322-999f-9ef82fe0a57e","Type":"ContainerStarted","Data":"bb8e0985846fccc0920e1b609117a22b4302a06f614b2c645883f51361340b28"}
Jul 09 22:37:35.933403 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:35.933339    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-scvhq"
Jul 09 22:37:35.976700 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:35.976620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk" event={"ID":"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26","Type":"ContainerStarted","Data":"023a0ad067541c694f522249ac384b1092c3ba7dae82891b03f3d53fd7967b91"}
Jul 09 22:37:35.976700 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:35.976686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk" event={"ID":"f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26","Type":"ContainerStarted","Data":"d9f421301dba5c6de5f8876136869041d773c17d29b7f86a7ca1c6b74aaa2adb"}
Jul 09 22:37:35.995363 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:35.995297    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gwcpk" podStartSLOduration=3.214823404 podStartE2EDuration="4.995273603s" totalImagesPullingTime="1.780450199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:35.994099627 +0000 UTC m=+297.475923015" watchObservedRunningTime="2026-07-09 22:37:35.995273603 +0000 UTC m=+297.477096991"
Jul 09 22:37:37.696134 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.696100    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-spwj2"]
Jul 09 22:37:37.699558 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.699531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.703991 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.703960    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 22:37:37.704139 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.704081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-drsgl\""
Jul 09 22:37:37.704139 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.704081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 22:37:37.704399 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.704378    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 22:37:37.758469 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758469 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-tls\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758697 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758697 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-root\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758697 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-wtmp\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758697 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-metrics-client-ca\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758894 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-sys\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758894 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-textfile\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.758894 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.758817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jq8l\" (UniqueName: \"kubernetes.io/projected/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-kube-api-access-2jq8l\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860339 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-root\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860339 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-wtmp\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-metrics-client-ca\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-sys\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-textfile\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jq8l\" (UniqueName: \"kubernetes.io/projected/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-kube-api-access-2jq8l\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860477    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-sys\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-wtmp\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-tls\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.860585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.861007 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860431    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-root\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.861007 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:37.860604    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 22:37:37.861007 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:37:37.860659    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-tls podName:8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa nodeName:}" failed. No retries permitted until 2026-07-09 22:37:38.360640231 +0000 UTC m=+299.842463614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-tls") pod "node-exporter-spwj2" (UID: "8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa") : secret "node-exporter-tls" not found
Jul 09 22:37:37.861007 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.860799    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-textfile\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.861230 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.861087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-accelerators-collector-config\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.861230 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.861208    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-metrics-client-ca\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.863191 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.863165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:37.877481 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:37.877454    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jq8l\" (UniqueName: \"kubernetes.io/projected/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-kube-api-access-2jq8l\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:38.365985 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.365952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-tls\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:38.368461 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.368429    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa-node-exporter-tls\") pod \"node-exporter-spwj2\" (UID: \"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa\") " pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:38.610634 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.610604    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-spwj2"
Jul 09 22:37:38.621285 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:38.621255    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf8b8ae_a5d5_447c_95cb_70dba15f8eaa.slice/crio-d4a793e51845b1c11cc22da112f95a347b6104e02c0d3c2fb425f79e09b22502 WatchSource:0}: Error finding container d4a793e51845b1c11cc22da112f95a347b6104e02c0d3c2fb425f79e09b22502: Status 404 returned error can't find the container with id d4a793e51845b1c11cc22da112f95a347b6104e02c0d3c2fb425f79e09b22502
Jul 09 22:37:38.903066 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.902986    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:37:38.904024 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.904003    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:37:38.908129 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.908112    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 22:37:38.990209 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.990155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt5c6" event={"ID":"a1fc9281-f315-460d-a892-d3b469fb0d29","Type":"ContainerStarted","Data":"5e1547fd79310674f2806cbe881c66cb6b59e51e3967a07c094957f6e85dc436"}
Jul 09 22:37:38.991512 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.991484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spwj2" event={"ID":"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa","Type":"ContainerStarted","Data":"d4a793e51845b1c11cc22da112f95a347b6104e02c0d3c2fb425f79e09b22502"}
Jul 09 22:37:38.993050 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:38.993019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765f97b679-pdclk" event={"ID":"6d87357e-916a-4322-999f-9ef82fe0a57e","Type":"ContainerStarted","Data":"472b10bdcdb6f6b097bdd341d24ba8fd95a4eca2efadf29a39b18263fc158d33"}
Jul 09 22:37:39.014795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:39.014731    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nt5c6" podStartSLOduration=32.948454445 podStartE2EDuration="41.014713683s" totalImagesPullingTime="8.066259238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:36:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:39.012803342 +0000 UTC m=+300.494626728" watchObservedRunningTime="2026-07-09 22:37:39.014713683 +0000 UTC m=+300.496537068"
Jul 09 22:37:39.033674 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:39.033628    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-765f97b679-pdclk" podStartSLOduration=1.975635539 podStartE2EDuration="6.033613109s" totalImagesPullingTime="4.05797757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:39.032918824 +0000 UTC m=+300.514742223" watchObservedRunningTime="2026-07-09 22:37:39.033613109 +0000 UTC m=+300.515436516"
Jul 09 22:37:39.998024 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:39.997937    2576 generic.go:356] "Generic (PLEG): container finished" podID="8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa" containerID="3ea62fffdc9b4374128e8a2470c76586d9b3e4c9a10759f69931c704084c0ab9" exitCode=0
Jul 09 22:37:39.998437 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:39.998022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spwj2" event={"ID":"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa","Type":"ContainerDied","Data":"3ea62fffdc9b4374128e8a2470c76586d9b3e4c9a10759f69931c704084c0ab9"}
Jul 09 22:37:41.003693 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:41.003666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spwj2" event={"ID":"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa","Type":"ContainerStarted","Data":"988d4b4cecc18d4b1c381fe94a0a2c7bd3fe8cbfba2ba843b43e4d4ceb0d2686"}
Jul 09 22:37:41.004096 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:41.003714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spwj2" event={"ID":"8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa","Type":"ContainerStarted","Data":"18ebde1afeca36ba7bd698e100e4a9e2e4ac270e2b59233bf074f1094aa60606"}
Jul 09 22:37:41.026070 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:41.026021    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-spwj2" podStartSLOduration=2.904123674 podStartE2EDuration="4.0260075s" totalImagesPullingTime="1.054760935s" totalInitContainerRuntime="67.122891ms" isStatefulPod=true podCreationTimestamp="2026-07-09 22:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:41.024422555 +0000 UTC m=+302.506245940" watchObservedRunningTime="2026-07-09 22:37:41.0260075 +0000 UTC m=+302.507830885"
Jul 09 22:37:42.127836 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.127794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65c9688d7c-n2mzx"]
Jul 09 22:37:42.130863 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.130845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.134440 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.134421    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 22:37:42.134545 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.134472    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 22:37:42.135762 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.135743    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 22:37:42.135762 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.135761    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 22:37:42.135945 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.135746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5jltd\""
Jul 09 22:37:42.135945 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.135862    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3irn0ivqoq103\""
Jul 09 22:37:42.150450 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.150430    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65c9688d7c-n2mzx"]
Jul 09 22:37:42.199033 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.199008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7c023f4-05a9-4c63-a5c0-45edc08da563-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.199156 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.199050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-client-ca-bundle\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.199156 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.199077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggsv4\" (UniqueName: \"kubernetes.io/projected/e7c023f4-05a9-4c63-a5c0-45edc08da563-kube-api-access-ggsv4\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.199156 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.199113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7c023f4-05a9-4c63-a5c0-45edc08da563-audit-log\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.199156 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.199133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-secret-metrics-server-client-certs\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.199345 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.199228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7c023f4-05a9-4c63-a5c0-45edc08da563-metrics-server-audit-profiles\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.199345 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.199274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-secret-metrics-server-tls\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.299676 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.299648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7c023f4-05a9-4c63-a5c0-45edc08da563-metrics-server-audit-profiles\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.299676 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.299679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-secret-metrics-server-tls\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.299874 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.299709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7c023f4-05a9-4c63-a5c0-45edc08da563-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.299874 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.299742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-client-ca-bundle\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.299874 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.299763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggsv4\" (UniqueName: \"kubernetes.io/projected/e7c023f4-05a9-4c63-a5c0-45edc08da563-kube-api-access-ggsv4\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.299874 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.299816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7c023f4-05a9-4c63-a5c0-45edc08da563-audit-log\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.299874 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.299834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-secret-metrics-server-client-certs\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.300313 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.300282    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7c023f4-05a9-4c63-a5c0-45edc08da563-audit-log\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.300556 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.300533    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7c023f4-05a9-4c63-a5c0-45edc08da563-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.300728 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.300708    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7c023f4-05a9-4c63-a5c0-45edc08da563-metrics-server-audit-profiles\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.302288 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.302270    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-secret-metrics-server-tls\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.302362 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.302329    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-client-ca-bundle\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.302487 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.302464    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7c023f4-05a9-4c63-a5c0-45edc08da563-secret-metrics-server-client-certs\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.308449 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.308428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggsv4\" (UniqueName: \"kubernetes.io/projected/e7c023f4-05a9-4c63-a5c0-45edc08da563-kube-api-access-ggsv4\") pod \"metrics-server-65c9688d7c-n2mzx\" (UID: \"e7c023f4-05a9-4c63-a5c0-45edc08da563\") " pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.440539 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.440462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:37:42.568972 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.568939    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65c9688d7c-n2mzx"]
Jul 09 22:37:42.571514 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:37:42.571488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c023f4_05a9_4c63_a5c0_45edc08da563.slice/crio-2bd338a4675e90c43c07c601935b702b862898f66976a2d45db21fa3d6a868a2 WatchSource:0}: Error finding container 2bd338a4675e90c43c07c601935b702b862898f66976a2d45db21fa3d6a868a2: Status 404 returned error can't find the container with id 2bd338a4675e90c43c07c601935b702b862898f66976a2d45db21fa3d6a868a2
Jul 09 22:37:42.573513 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.573497    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:37:42.759551 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:42.759466    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765f97b679-pdclk"]
Jul 09 22:37:43.011151 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:43.011061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx" event={"ID":"e7c023f4-05a9-4c63-a5c0-45edc08da563","Type":"ContainerStarted","Data":"2bd338a4675e90c43c07c601935b702b862898f66976a2d45db21fa3d6a868a2"}
Jul 09 22:37:43.922593 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:43.922567    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-766c7c59d6-2zgtw"
Jul 09 22:37:44.019194 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:44.019163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx" event={"ID":"e7c023f4-05a9-4c63-a5c0-45edc08da563","Type":"ContainerStarted","Data":"03eafd0342bc3901da806254e648280560cdb14e968128256b570739423a0850"}
Jul 09 22:37:44.037173 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:44.037141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:37:44.274456 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:37:44.274367    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:38:02.440740 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:02.440707    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:38:02.441204 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:02.440798    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:38:07.779057 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:07.779014    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-765f97b679-pdclk" podUID="6d87357e-916a-4322-999f-9ef82fe0a57e" containerName="console" containerID="cri-o://472b10bdcdb6f6b097bdd341d24ba8fd95a4eca2efadf29a39b18263fc158d33" gracePeriod=15
Jul 09 22:38:08.097642 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.097614    2576 generic.go:356] "Generic (PLEG): container finished" podID="6d87357e-916a-4322-999f-9ef82fe0a57e" containerID="472b10bdcdb6f6b097bdd341d24ba8fd95a4eca2efadf29a39b18263fc158d33" exitCode=0
Jul 09 22:38:08.097642 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.097645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765f97b679-pdclk" event={"ID":"6d87357e-916a-4322-999f-9ef82fe0a57e","Type":"ContainerDied","Data":"472b10bdcdb6f6b097bdd341d24ba8fd95a4eca2efadf29a39b18263fc158d33"}
Jul 09 22:38:08.555236 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.555212    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:38:08.578302 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.574659    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx" podStartSLOduration=25.212686838 podStartE2EDuration="26.574639149s" totalImagesPullingTime="1.361952311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:44.044064051 +0000 UTC m=+305.525887439" watchObservedRunningTime="2026-07-09 22:38:08.574639149 +0000 UTC m=+330.056462536"
Jul 09 22:38:08.607588 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.607567    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dn6v\" (UniqueName: \"kubernetes.io/projected/6d87357e-916a-4322-999f-9ef82fe0a57e-kube-api-access-4dn6v\") pod \"6d87357e-916a-4322-999f-9ef82fe0a57e\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") "
Jul 09 22:38:08.607685 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.607601    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-serving-cert\") pod \"6d87357e-916a-4322-999f-9ef82fe0a57e\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") "
Jul 09 22:38:08.607685 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.607634    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-console-config\") pod \"6d87357e-916a-4322-999f-9ef82fe0a57e\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") "
Jul 09 22:38:08.607860 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.607838    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-service-ca\") pod \"6d87357e-916a-4322-999f-9ef82fe0a57e\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") "
Jul 09 22:38:08.607978 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.607870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-oauth-config\") pod \"6d87357e-916a-4322-999f-9ef82fe0a57e\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") "
Jul 09 22:38:08.607978 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.607957    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-console-config" (OuterVolumeSpecName: "console-config") pod "6d87357e-916a-4322-999f-9ef82fe0a57e" (UID: "6d87357e-916a-4322-999f-9ef82fe0a57e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:08.608106 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.608090    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-console-config\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:38:08.608170 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.608148    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d87357e-916a-4322-999f-9ef82fe0a57e" (UID: "6d87357e-916a-4322-999f-9ef82fe0a57e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:08.609756 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.609732    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d87357e-916a-4322-999f-9ef82fe0a57e" (UID: "6d87357e-916a-4322-999f-9ef82fe0a57e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:38:08.609897 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.609788    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d87357e-916a-4322-999f-9ef82fe0a57e" (UID: "6d87357e-916a-4322-999f-9ef82fe0a57e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:38:08.609897 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.609804    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d87357e-916a-4322-999f-9ef82fe0a57e-kube-api-access-4dn6v" (OuterVolumeSpecName: "kube-api-access-4dn6v") pod "6d87357e-916a-4322-999f-9ef82fe0a57e" (UID: "6d87357e-916a-4322-999f-9ef82fe0a57e"). InnerVolumeSpecName "kube-api-access-4dn6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:38:08.709255 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.709202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-oauth-serving-cert\") pod \"6d87357e-916a-4322-999f-9ef82fe0a57e\" (UID: \"6d87357e-916a-4322-999f-9ef82fe0a57e\") "
Jul 09 22:38:08.709364 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.709353    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-service-ca\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:38:08.709407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.709367    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-oauth-config\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:38:08.709407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.709376    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dn6v\" (UniqueName: \"kubernetes.io/projected/6d87357e-916a-4322-999f-9ef82fe0a57e-kube-api-access-4dn6v\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:38:08.709407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.709385    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d87357e-916a-4322-999f-9ef82fe0a57e-console-serving-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:38:08.709499 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.709461    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d87357e-916a-4322-999f-9ef82fe0a57e" (UID: "6d87357e-916a-4322-999f-9ef82fe0a57e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:38:08.810059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:08.810029    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d87357e-916a-4322-999f-9ef82fe0a57e-oauth-serving-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:38:09.101489 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:09.101468    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765f97b679-pdclk"
Jul 09 22:38:09.101640 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:09.101467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765f97b679-pdclk" event={"ID":"6d87357e-916a-4322-999f-9ef82fe0a57e","Type":"ContainerDied","Data":"bb8e0985846fccc0920e1b609117a22b4302a06f614b2c645883f51361340b28"}
Jul 09 22:38:09.101640 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:09.101597    2576 scope.go:117] "RemoveContainer" containerID="472b10bdcdb6f6b097bdd341d24ba8fd95a4eca2efadf29a39b18263fc158d33"
Jul 09 22:38:09.119088 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:09.119066    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765f97b679-pdclk"]
Jul 09 22:38:09.122896 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:09.122878    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-765f97b679-pdclk"]
Jul 09 22:38:11.041220 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:11.041189    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d87357e-916a-4322-999f-9ef82fe0a57e" path="/var/lib/kubelet/pods/6d87357e-916a-4322-999f-9ef82fe0a57e/volumes"
Jul 09 22:38:22.446065 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:22.446040    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:38:22.449804 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:22.449770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65c9688d7c-n2mzx"
Jul 09 22:38:27.159510 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:27.159478    2576 generic.go:356] "Generic (PLEG): container finished" podID="34dc3511-2f8a-4461-a27e-a8dc5952910d" containerID="92baebef54ded1184387bd96b03e5d277f2bd0a195ca6651fd710eeca2ce89cf" exitCode=0
Jul 09 22:38:27.159894 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:27.159519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj" event={"ID":"34dc3511-2f8a-4461-a27e-a8dc5952910d","Type":"ContainerDied","Data":"92baebef54ded1184387bd96b03e5d277f2bd0a195ca6651fd710eeca2ce89cf"}
Jul 09 22:38:27.159894 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:27.159799    2576 scope.go:117] "RemoveContainer" containerID="92baebef54ded1184387bd96b03e5d277f2bd0a195ca6651fd710eeca2ce89cf"
Jul 09 22:38:28.164389 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:28.164356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ltsdj" event={"ID":"34dc3511-2f8a-4461-a27e-a8dc5952910d","Type":"ContainerStarted","Data":"ba4014c00b229c20405e3a3c7e8ab16c76c149e25af702f97bf9f0296a19717e"}
Jul 09 22:38:52.843328 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:52.843291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:38:52.845562 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:52.845539    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc07053a-3a65-4a47-8a8b-fe1646890faf-metrics-certs\") pod \"network-metrics-daemon-sprcl\" (UID: \"dc07053a-3a65-4a47-8a8b-fe1646890faf\") " pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:38:53.041282 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:53.041253    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjswb\""
Jul 09 22:38:53.048636 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:53.048616    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sprcl"
Jul 09 22:38:53.167879 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:53.167758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sprcl"]
Jul 09 22:38:53.170618 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:38:53.170586    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc07053a_3a65_4a47_8a8b_fe1646890faf.slice/crio-78614f655dfa8ba090103a5387504239e9da98827c468aba8b08e1acec63ba1b WatchSource:0}: Error finding container 78614f655dfa8ba090103a5387504239e9da98827c468aba8b08e1acec63ba1b: Status 404 returned error can't find the container with id 78614f655dfa8ba090103a5387504239e9da98827c468aba8b08e1acec63ba1b
Jul 09 22:38:53.248260 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:53.248234    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sprcl" event={"ID":"dc07053a-3a65-4a47-8a8b-fe1646890faf","Type":"ContainerStarted","Data":"78614f655dfa8ba090103a5387504239e9da98827c468aba8b08e1acec63ba1b"}
Jul 09 22:38:55.257229 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:55.257195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sprcl" event={"ID":"dc07053a-3a65-4a47-8a8b-fe1646890faf","Type":"ContainerStarted","Data":"d08dd21ec901b8ac59a8addad2b4b53eaa0b3a015838fa31f7239740670f16b2"}
Jul 09 22:38:55.257603 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:55.257244    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sprcl" event={"ID":"dc07053a-3a65-4a47-8a8b-fe1646890faf","Type":"ContainerStarted","Data":"22de9370e8577e21c91823d09850c0f466d3b064578ab36bfa5f8b90764ed107"}
Jul 09 22:38:55.273716 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:38:55.273674    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sprcl" podStartSLOduration=376.147995712 podStartE2EDuration="6m17.273660286s" totalImagesPullingTime="1.125664574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:38:55.271832695 +0000 UTC m=+376.753656126" watchObservedRunningTime="2026-07-09 22:38:55.273660286 +0000 UTC m=+376.755483672"
Jul 09 22:39:06.388448 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.388410    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-865dbcff7-qwn2s"]
Jul 09 22:39:06.388912 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.388754    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d87357e-916a-4322-999f-9ef82fe0a57e" containerName="console"
Jul 09 22:39:06.388912 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.388770    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d87357e-916a-4322-999f-9ef82fe0a57e" containerName="console"
Jul 09 22:39:06.388912 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.388858    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d87357e-916a-4322-999f-9ef82fe0a57e" containerName="console"
Jul 09 22:39:06.390939 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.390918    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.395315 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.395140    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 22:39:06.395954 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.395929    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 22:39:06.397311 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.396120    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 22:39:06.397453 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.396256    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 22:39:06.397635 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.396955    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 22:39:06.397805 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.397028    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 22:39:06.397935 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.397071    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 22:39:06.398006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.397090    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xrw77\""
Jul 09 22:39:06.401081 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.401065    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 22:39:06.403575 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.403555    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865dbcff7-qwn2s"]
Jul 09 22:39:06.541105 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.541078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-oauth-serving-cert\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.541344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.541117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-trusted-ca-bundle\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.541344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.541139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-service-ca\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.541344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.541207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-console-config\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.541344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.541260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59tc9\" (UniqueName: \"kubernetes.io/projected/9cf691db-8b6a-4341-8dff-348be94c1532-kube-api-access-59tc9\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.541344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.541313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-oauth-config\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.541344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.541338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-serving-cert\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642098 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.641997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-service-ca\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642098 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-console-config\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642098 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59tc9\" (UniqueName: \"kubernetes.io/projected/9cf691db-8b6a-4341-8dff-348be94c1532-kube-api-access-59tc9\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642385 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-oauth-config\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642385 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-serving-cert\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642385 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-oauth-serving-cert\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642385 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-trusted-ca-bundle\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.642929 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642904    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-oauth-serving-cert\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.643048 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-console-config\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.643048 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.642927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-service-ca\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.643293 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.643271    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-trusted-ca-bundle\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.644527 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.644505    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-oauth-config\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.644722 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.644705    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-serving-cert\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.650140 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.650123    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59tc9\" (UniqueName: \"kubernetes.io/projected/9cf691db-8b6a-4341-8dff-348be94c1532-kube-api-access-59tc9\") pod \"console-865dbcff7-qwn2s\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") " pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.703599 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.703567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:06.823887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:06.823863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865dbcff7-qwn2s"]
Jul 09 22:39:06.826574 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:39:06.826543    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf691db_8b6a_4341_8dff_348be94c1532.slice/crio-fb950f3b72a117f9625f97e49b9433f551131b299c169c846407858a6439da14 WatchSource:0}: Error finding container fb950f3b72a117f9625f97e49b9433f551131b299c169c846407858a6439da14: Status 404 returned error can't find the container with id fb950f3b72a117f9625f97e49b9433f551131b299c169c846407858a6439da14
Jul 09 22:39:07.299644 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:07.299610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865dbcff7-qwn2s" event={"ID":"9cf691db-8b6a-4341-8dff-348be94c1532","Type":"ContainerStarted","Data":"81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2"}
Jul 09 22:39:07.299644 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:07.299651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865dbcff7-qwn2s" event={"ID":"9cf691db-8b6a-4341-8dff-348be94c1532","Type":"ContainerStarted","Data":"fb950f3b72a117f9625f97e49b9433f551131b299c169c846407858a6439da14"}
Jul 09 22:39:07.319795 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:07.319732    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-865dbcff7-qwn2s" podStartSLOduration=1.319715806 podStartE2EDuration="1.319715806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:39:07.318681132 +0000 UTC m=+388.800504517" watchObservedRunningTime="2026-07-09 22:39:07.319715806 +0000 UTC m=+388.801539190"
Jul 09 22:39:16.704272 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:16.704218    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:16.704749 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:16.704292    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:16.709075 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:16.709054    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:39:17.336621 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:39:17.336595    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:40:16.136717 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.136643    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b884dbd58-lzg26"]
Jul 09 22:40:16.138655 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.138636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.153436 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.153416    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b884dbd58-lzg26"]
Jul 09 22:40:16.219607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.219578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdt4m\" (UniqueName: \"kubernetes.io/projected/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-kube-api-access-qdt4m\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.219607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.219608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-service-ca\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.219847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.219631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-oauth-serving-cert\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.219847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.219647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-config\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.219847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.219663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-trusted-ca-bundle\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.219847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.219724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-oauth-config\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.219847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.219764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-serving-cert\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.320914 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.320884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdt4m\" (UniqueName: \"kubernetes.io/projected/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-kube-api-access-qdt4m\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.321035 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.320919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-service-ca\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.321035 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.320941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-oauth-serving-cert\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.321035 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.320960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-config\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.321035 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.320985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-trusted-ca-bundle\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.321232 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.321100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-oauth-config\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.322305 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.321493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-serving-cert\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.322305 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.322224    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-service-ca\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.322305 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.322233    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-config\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.322530 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.322324    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-trusted-ca-bundle\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.322530 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.322343    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-oauth-serving-cert\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.326735 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.324996    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-oauth-config\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.326735 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.325098    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-serving-cert\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.338057 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.338038    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdt4m\" (UniqueName: \"kubernetes.io/projected/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-kube-api-access-qdt4m\") pod \"console-5b884dbd58-lzg26\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") " pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.447431 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.447355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:16.568618 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:16.568576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b884dbd58-lzg26"]
Jul 09 22:40:16.571514 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:40:16.571487    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cb47dc_5cdf_4f81_9e68_cf6ef0adf1a7.slice/crio-d9fad97ba50599d887b41706faa8deadf2dbf8dc035d7e085a8217fe15224df1 WatchSource:0}: Error finding container d9fad97ba50599d887b41706faa8deadf2dbf8dc035d7e085a8217fe15224df1: Status 404 returned error can't find the container with id d9fad97ba50599d887b41706faa8deadf2dbf8dc035d7e085a8217fe15224df1
Jul 09 22:40:17.535154 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:17.535055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b884dbd58-lzg26" event={"ID":"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7","Type":"ContainerStarted","Data":"15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f"}
Jul 09 22:40:17.535154 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:17.535109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b884dbd58-lzg26" event={"ID":"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7","Type":"ContainerStarted","Data":"d9fad97ba50599d887b41706faa8deadf2dbf8dc035d7e085a8217fe15224df1"}
Jul 09 22:40:17.552967 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:17.552818    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b884dbd58-lzg26" podStartSLOduration=1.552800967 podStartE2EDuration="1.552800967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:40:17.552421804 +0000 UTC m=+459.034245190" watchObservedRunningTime="2026-07-09 22:40:17.552800967 +0000 UTC m=+459.034624347"
Jul 09 22:40:26.448033 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:26.447983    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:26.448499 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:26.448181    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:26.452907 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:26.452886    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:26.568349 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:26.568322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:40:26.613525 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:26.613496    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865dbcff7-qwn2s"]
Jul 09 22:40:51.634256 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:51.634197    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-865dbcff7-qwn2s" podUID="9cf691db-8b6a-4341-8dff-348be94c1532" containerName="console" containerID="cri-o://81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2" gracePeriod=15
Jul 09 22:40:51.873102 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:51.873081    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:40:52.002133 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002057    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-console-config\") pod \"9cf691db-8b6a-4341-8dff-348be94c1532\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") "
Jul 09 22:40:52.002133 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-serving-cert\") pod \"9cf691db-8b6a-4341-8dff-348be94c1532\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") "
Jul 09 22:40:52.002336 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002135    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59tc9\" (UniqueName: \"kubernetes.io/projected/9cf691db-8b6a-4341-8dff-348be94c1532-kube-api-access-59tc9\") pod \"9cf691db-8b6a-4341-8dff-348be94c1532\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") "
Jul 09 22:40:52.002336 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002166    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-oauth-config\") pod \"9cf691db-8b6a-4341-8dff-348be94c1532\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") "
Jul 09 22:40:52.002336 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002190    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-trusted-ca-bundle\") pod \"9cf691db-8b6a-4341-8dff-348be94c1532\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") "
Jul 09 22:40:52.002485 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002350    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-oauth-serving-cert\") pod \"9cf691db-8b6a-4341-8dff-348be94c1532\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") "
Jul 09 22:40:52.002485 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002395    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-service-ca\") pod \"9cf691db-8b6a-4341-8dff-348be94c1532\" (UID: \"9cf691db-8b6a-4341-8dff-348be94c1532\") "
Jul 09 22:40:52.002618 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002525    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-console-config" (OuterVolumeSpecName: "console-config") pod "9cf691db-8b6a-4341-8dff-348be94c1532" (UID: "9cf691db-8b6a-4341-8dff-348be94c1532"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:40:52.002675 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002624    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9cf691db-8b6a-4341-8dff-348be94c1532" (UID: "9cf691db-8b6a-4341-8dff-348be94c1532"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:40:52.002727 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002717    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-console-config\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:40:52.002801 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002735    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-trusted-ca-bundle\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:40:52.002801 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002709    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9cf691db-8b6a-4341-8dff-348be94c1532" (UID: "9cf691db-8b6a-4341-8dff-348be94c1532"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:40:52.002955 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.002934    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-service-ca" (OuterVolumeSpecName: "service-ca") pod "9cf691db-8b6a-4341-8dff-348be94c1532" (UID: "9cf691db-8b6a-4341-8dff-348be94c1532"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:40:52.004281 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.004245    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9cf691db-8b6a-4341-8dff-348be94c1532" (UID: "9cf691db-8b6a-4341-8dff-348be94c1532"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:40:52.004384 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.004289    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9cf691db-8b6a-4341-8dff-348be94c1532" (UID: "9cf691db-8b6a-4341-8dff-348be94c1532"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:40:52.004384 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.004337    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf691db-8b6a-4341-8dff-348be94c1532-kube-api-access-59tc9" (OuterVolumeSpecName: "kube-api-access-59tc9") pod "9cf691db-8b6a-4341-8dff-348be94c1532" (UID: "9cf691db-8b6a-4341-8dff-348be94c1532"). InnerVolumeSpecName "kube-api-access-59tc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:40:52.103392 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.103370    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-serving-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:40:52.103392 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.103388    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59tc9\" (UniqueName: \"kubernetes.io/projected/9cf691db-8b6a-4341-8dff-348be94c1532-kube-api-access-59tc9\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:40:52.103524 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.103397    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cf691db-8b6a-4341-8dff-348be94c1532-console-oauth-config\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:40:52.103524 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.103405    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-oauth-serving-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:40:52.103524 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.103413    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf691db-8b6a-4341-8dff-348be94c1532-service-ca\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:40:52.655259 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.655224    2576 generic.go:356] "Generic (PLEG): container finished" podID="9cf691db-8b6a-4341-8dff-348be94c1532" containerID="81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2" exitCode=0
Jul 09 22:40:52.655654 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.655279    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865dbcff7-qwn2s"
Jul 09 22:40:52.655654 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.655281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865dbcff7-qwn2s" event={"ID":"9cf691db-8b6a-4341-8dff-348be94c1532","Type":"ContainerDied","Data":"81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2"}
Jul 09 22:40:52.655654 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.655331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865dbcff7-qwn2s" event={"ID":"9cf691db-8b6a-4341-8dff-348be94c1532","Type":"ContainerDied","Data":"fb950f3b72a117f9625f97e49b9433f551131b299c169c846407858a6439da14"}
Jul 09 22:40:52.655654 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.655358    2576 scope.go:117] "RemoveContainer" containerID="81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2"
Jul 09 22:40:52.663574 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.663558    2576 scope.go:117] "RemoveContainer" containerID="81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2"
Jul 09 22:40:52.663836 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:40:52.663818    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2\": container with ID starting with 81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2 not found: ID does not exist" containerID="81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2"
Jul 09 22:40:52.663895 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.663844    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2"} err="failed to get container status \"81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2\": rpc error: code = NotFound desc = could not find container \"81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2\": container with ID starting with 81e7587a3d1c144f297dabba172fd12574839f849ec99e027fe1bade552773e2 not found: ID does not exist"
Jul 09 22:40:52.677512 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.677483    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865dbcff7-qwn2s"]
Jul 09 22:40:52.681345 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:52.681324    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-865dbcff7-qwn2s"]
Jul 09 22:40:53.041446 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:40:53.041368    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf691db-8b6a-4341-8dff-348be94c1532" path="/var/lib/kubelet/pods/9cf691db-8b6a-4341-8dff-348be94c1532/volumes"
Jul 09 22:41:33.364178 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.364102    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"]
Jul 09 22:41:33.364689 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.364330    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf691db-8b6a-4341-8dff-348be94c1532" containerName="console"
Jul 09 22:41:33.364689 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.364340    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf691db-8b6a-4341-8dff-348be94c1532" containerName="console"
Jul 09 22:41:33.364689 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.364391    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf691db-8b6a-4341-8dff-348be94c1532" containerName="console"
Jul 09 22:41:33.367012 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.366997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.369849 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.369830    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 22:41:33.371093 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.371077    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hz598\""
Jul 09 22:41:33.371157 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.371077    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 22:41:33.376968 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.376943    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"]
Jul 09 22:41:33.392147 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.392118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gt8r\" (UniqueName: \"kubernetes.io/projected/b5d81b0d-4488-4fec-b4cd-1b21125f7869-kube-api-access-9gt8r\") pod \"cert-manager-cainjector-559cdd8c87-jmxjw\" (UID: \"b5d81b0d-4488-4fec-b4cd-1b21125f7869\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.392233 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.392169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5d81b0d-4488-4fec-b4cd-1b21125f7869-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jmxjw\" (UID: \"b5d81b0d-4488-4fec-b4cd-1b21125f7869\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.492576 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.492549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gt8r\" (UniqueName: \"kubernetes.io/projected/b5d81b0d-4488-4fec-b4cd-1b21125f7869-kube-api-access-9gt8r\") pod \"cert-manager-cainjector-559cdd8c87-jmxjw\" (UID: \"b5d81b0d-4488-4fec-b4cd-1b21125f7869\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.492689 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.492607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5d81b0d-4488-4fec-b4cd-1b21125f7869-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jmxjw\" (UID: \"b5d81b0d-4488-4fec-b4cd-1b21125f7869\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.500972 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.500939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gt8r\" (UniqueName: \"kubernetes.io/projected/b5d81b0d-4488-4fec-b4cd-1b21125f7869-kube-api-access-9gt8r\") pod \"cert-manager-cainjector-559cdd8c87-jmxjw\" (UID: \"b5d81b0d-4488-4fec-b4cd-1b21125f7869\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.500972 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.500960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5d81b0d-4488-4fec-b4cd-1b21125f7869-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jmxjw\" (UID: \"b5d81b0d-4488-4fec-b4cd-1b21125f7869\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.675611 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.675534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"
Jul 09 22:41:33.800065 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:33.800037    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw"]
Jul 09 22:41:33.803234 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:41:33.803212    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5d81b0d_4488_4fec_b4cd_1b21125f7869.slice/crio-d67d63c27bf05134d46174a0aa9d32e0d5f5b2d779042c5d47d709486705d894 WatchSource:0}: Error finding container d67d63c27bf05134d46174a0aa9d32e0d5f5b2d779042c5d47d709486705d894: Status 404 returned error can't find the container with id d67d63c27bf05134d46174a0aa9d32e0d5f5b2d779042c5d47d709486705d894
Jul 09 22:41:34.807412 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:34.807374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw" event={"ID":"b5d81b0d-4488-4fec-b4cd-1b21125f7869","Type":"ContainerStarted","Data":"d67d63c27bf05134d46174a0aa9d32e0d5f5b2d779042c5d47d709486705d894"}
Jul 09 22:41:49.861999 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:49.861963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw" event={"ID":"b5d81b0d-4488-4fec-b4cd-1b21125f7869","Type":"ContainerStarted","Data":"e0f816245dc024de257ec7f201ee05bf6a6b202abaff19f72a3da268b8126e88"}
Jul 09 22:41:49.878449 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:41:49.878406    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jmxjw" podStartSLOduration=1.555266231 podStartE2EDuration="16.87839266s" totalImagesPullingTime="15.323126429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:41:49.877043867 +0000 UTC m=+551.358867265" watchObservedRunningTime="2026-07-09 22:41:49.87839266 +0000 UTC m=+551.360216046"
Jul 09 22:42:14.406667 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.406632    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"]
Jul 09 22:42:14.409804 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.409772    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.412789 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.412751    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 22:42:14.413105 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.413088    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k9dxk\""
Jul 09 22:42:14.413215 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.413195    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 22:42:14.413274 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.413248    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 22:42:14.413382 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.413368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 22:42:14.429681 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.429655    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"]
Jul 09 22:42:14.505758 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.505731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcdcb477-ad9d-420e-81f7-a5b7de34064f-tmp\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.505888 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.505763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fcdcb477-ad9d-420e-81f7-a5b7de34064f-manifests\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.505888 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.505800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fcdcb477-ad9d-420e-81f7-a5b7de34064f-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.505888 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.505844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fcdcb477-ad9d-420e-81f7-a5b7de34064f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.505888 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.505864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqvd7\" (UniqueName: \"kubernetes.io/projected/fcdcb477-ad9d-420e-81f7-a5b7de34064f-kube-api-access-vqvd7\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.606555 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.606524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcdcb477-ad9d-420e-81f7-a5b7de34064f-tmp\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.606682 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.606557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fcdcb477-ad9d-420e-81f7-a5b7de34064f-manifests\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.606682 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.606580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fcdcb477-ad9d-420e-81f7-a5b7de34064f-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.606751 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.606708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fcdcb477-ad9d-420e-81f7-a5b7de34064f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.606815 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.606750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqvd7\" (UniqueName: \"kubernetes.io/projected/fcdcb477-ad9d-420e-81f7-a5b7de34064f-kube-api-access-vqvd7\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.607034 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.607011    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fcdcb477-ad9d-420e-81f7-a5b7de34064f-manifests\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.608952 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.608921    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcdcb477-ad9d-420e-81f7-a5b7de34064f-tmp\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.609143 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.609125    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fcdcb477-ad9d-420e-81f7-a5b7de34064f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.609184 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.609125    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fcdcb477-ad9d-420e-81f7-a5b7de34064f-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.616589 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.616566    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqvd7\" (UniqueName: \"kubernetes.io/projected/fcdcb477-ad9d-420e-81f7-a5b7de34064f-kube-api-access-vqvd7\") pod \"opendatahub-operator-controller-manager-54dbdc554f-brz4b\" (UID: \"fcdcb477-ad9d-420e-81f7-a5b7de34064f\") " pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.719345 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.719275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:14.856639 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:42:14.856610    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdcb477_ad9d_420e_81f7_a5b7de34064f.slice/crio-ce0befe86ed4bb886753eda9696073f3f35309907b72fe41185154d3cef09fc0 WatchSource:0}: Error finding container ce0befe86ed4bb886753eda9696073f3f35309907b72fe41185154d3cef09fc0: Status 404 returned error can't find the container with id ce0befe86ed4bb886753eda9696073f3f35309907b72fe41185154d3cef09fc0
Jul 09 22:42:14.856754 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.856733    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"]
Jul 09 22:42:14.954807 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:14.954755    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b" event={"ID":"fcdcb477-ad9d-420e-81f7-a5b7de34064f","Type":"ContainerStarted","Data":"ce0befe86ed4bb886753eda9696073f3f35309907b72fe41185154d3cef09fc0"}
Jul 09 22:42:17.974589 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:17.974499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b" event={"ID":"fcdcb477-ad9d-420e-81f7-a5b7de34064f","Type":"ContainerStarted","Data":"c73777336e4d4c9503fe64345517c478196b771ed1e1dfe5582c4a3c83a59662"}
Jul 09 22:42:18.979981 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:18.979946    2576 generic.go:356] "Generic (PLEG): container finished" podID="fcdcb477-ad9d-420e-81f7-a5b7de34064f" containerID="c73777336e4d4c9503fe64345517c478196b771ed1e1dfe5582c4a3c83a59662" exitCode=0
Jul 09 22:42:18.980387 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:18.980015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b" event={"ID":"fcdcb477-ad9d-420e-81f7-a5b7de34064f","Type":"ContainerDied","Data":"c73777336e4d4c9503fe64345517c478196b771ed1e1dfe5582c4a3c83a59662"}
Jul 09 22:42:19.985816 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:19.985743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b" event={"ID":"fcdcb477-ad9d-420e-81f7-a5b7de34064f","Type":"ContainerStarted","Data":"b5d57b4aec0966b110f843bd0220d01039fcbc25d1c60a2c788afdfcedae7556"}
Jul 09 22:42:19.986181 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:19.985868    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:20.015388 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:20.015343    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b" podStartSLOduration=1.754756699 podStartE2EDuration="6.015324148s" totalImagesPullingTime="3.215304614s" totalInitContainerRuntime="1.045262835s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:20.013290013 +0000 UTC m=+581.495113399" watchObservedRunningTime="2026-07-09 22:42:20.015324148 +0000 UTC m=+581.497147533"
Jul 09 22:42:30.991716 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:30.991682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54dbdc554f-brz4b"
Jul 09 22:42:33.486854 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.486815    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6965988765-gdglp"]
Jul 09 22:42:33.489439 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.489422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.493341 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.493313    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 22:42:33.493341 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.493328    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 22:42:33.530319 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.530287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6965988765-gdglp"]
Jul 09 22:42:33.658361 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.658319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tls-certs\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.658566 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.658462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tmp\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.658566 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.658509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fklp\" (UniqueName: \"kubernetes.io/projected/e2d6dc02-d430-4889-b4f5-40f80cd9f222-kube-api-access-8fklp\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.759530 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.759434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tls-certs\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.759530 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.759520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tmp\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.759764 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.759554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fklp\" (UniqueName: \"kubernetes.io/projected/e2d6dc02-d430-4889-b4f5-40f80cd9f222-kube-api-access-8fklp\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.759764 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:42:33.759588    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 09 22:42:33.759764 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:42:33.759671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tls-certs podName:e2d6dc02-d430-4889-b4f5-40f80cd9f222 nodeName:}" failed. No retries permitted until 2026-07-09 22:42:34.259652551 +0000 UTC m=+595.741475937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tls-certs") pod "kube-auth-proxy-6965988765-gdglp" (UID: "e2d6dc02-d430-4889-b4f5-40f80cd9f222") : secret "kube-auth-proxy-tls" not found
Jul 09 22:42:33.762005 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.761980    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tmp\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.773495 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.773465    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fklp\" (UniqueName: \"kubernetes.io/projected/e2d6dc02-d430-4889-b4f5-40f80cd9f222-kube-api-access-8fklp\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:33.783716 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.783688    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ff6bg"]
Jul 09 22:42:33.786282 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.786267    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:33.788926 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.788905    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 22:42:33.789044 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.788928    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6xg2p\""
Jul 09 22:42:33.798847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.798824    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ff6bg"]
Jul 09 22:42:33.961417 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.961381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnglx\" (UniqueName: \"kubernetes.io/projected/9209a16c-0c41-4aa1-8d5b-31799ec88369-kube-api-access-tnglx\") pod \"odh-model-controller-7998c67dc4-ff6bg\" (UID: \"9209a16c-0c41-4aa1-8d5b-31799ec88369\") " pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:33.961607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:33.961462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9209a16c-0c41-4aa1-8d5b-31799ec88369-cert\") pod \"odh-model-controller-7998c67dc4-ff6bg\" (UID: \"9209a16c-0c41-4aa1-8d5b-31799ec88369\") " pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:34.062038 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.062001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnglx\" (UniqueName: \"kubernetes.io/projected/9209a16c-0c41-4aa1-8d5b-31799ec88369-kube-api-access-tnglx\") pod \"odh-model-controller-7998c67dc4-ff6bg\" (UID: \"9209a16c-0c41-4aa1-8d5b-31799ec88369\") " pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:34.062245 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.062061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9209a16c-0c41-4aa1-8d5b-31799ec88369-cert\") pod \"odh-model-controller-7998c67dc4-ff6bg\" (UID: \"9209a16c-0c41-4aa1-8d5b-31799ec88369\") " pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:34.064823 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.064762    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9209a16c-0c41-4aa1-8d5b-31799ec88369-cert\") pod \"odh-model-controller-7998c67dc4-ff6bg\" (UID: \"9209a16c-0c41-4aa1-8d5b-31799ec88369\") " pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:34.073123 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.073101    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnglx\" (UniqueName: \"kubernetes.io/projected/9209a16c-0c41-4aa1-8d5b-31799ec88369-kube-api-access-tnglx\") pod \"odh-model-controller-7998c67dc4-ff6bg\" (UID: \"9209a16c-0c41-4aa1-8d5b-31799ec88369\") " pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:34.095964 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.095934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:34.247928 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.247905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ff6bg"]
Jul 09 22:42:34.251016 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:42:34.250990    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9209a16c_0c41_4aa1_8d5b_31799ec88369.slice/crio-9bfa833cda3975fd55f93e9f6d6a1e96917fb4e1984dcae40bc7bcd12311d3a0 WatchSource:0}: Error finding container 9bfa833cda3975fd55f93e9f6d6a1e96917fb4e1984dcae40bc7bcd12311d3a0: Status 404 returned error can't find the container with id 9bfa833cda3975fd55f93e9f6d6a1e96917fb4e1984dcae40bc7bcd12311d3a0
Jul 09 22:42:34.264461 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.264436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tls-certs\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:34.267267 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.267241    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2d6dc02-d430-4889-b4f5-40f80cd9f222-tls-certs\") pod \"kube-auth-proxy-6965988765-gdglp\" (UID: \"e2d6dc02-d430-4889-b4f5-40f80cd9f222\") " pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:34.399320 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.399236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp"
Jul 09 22:42:34.539681 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.539656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6965988765-gdglp"]
Jul 09 22:42:34.542679 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:42:34.542648    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d6dc02_d430_4889_b4f5_40f80cd9f222.slice/crio-2205407402ec480f872d7ab04e14e8f2dd7b69edd3355fc4f33c12669a509237 WatchSource:0}: Error finding container 2205407402ec480f872d7ab04e14e8f2dd7b69edd3355fc4f33c12669a509237: Status 404 returned error can't find the container with id 2205407402ec480f872d7ab04e14e8f2dd7b69edd3355fc4f33c12669a509237
Jul 09 22:42:34.702132 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.702056    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqt8l"]
Jul 09 22:42:34.705879 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.705860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:34.708898 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.708873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 22:42:34.719101 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.719070    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqt8l"]
Jul 09 22:42:34.768452 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.768414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21458a95-2e1c-47f3-9397-b2010c427f59-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqt8l\" (UID: \"21458a95-2e1c-47f3-9397-b2010c427f59\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:34.768452 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.768456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpqf7\" (UniqueName: \"kubernetes.io/projected/21458a95-2e1c-47f3-9397-b2010c427f59-kube-api-access-jpqf7\") pod \"model-serving-api-54d89bd5fc-cqt8l\" (UID: \"21458a95-2e1c-47f3-9397-b2010c427f59\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:34.832977 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.832934    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"]
Jul 09 22:42:34.836224 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.836203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.838974 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.838952    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 22:42:34.839098 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.838974    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 22:42:34.839157 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.839112    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 22:42:34.839214 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.839151    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ldsds\""
Jul 09 22:42:34.839383 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.839369    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 22:42:34.854376 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.854347    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"]
Jul 09 22:42:34.869398 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-token\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.869546 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-cacerts\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.869546 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.869546 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.869683 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfrg\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-kube-api-access-sgfrg\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.869683 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21458a95-2e1c-47f3-9397-b2010c427f59-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqt8l\" (UID: \"21458a95-2e1c-47f3-9397-b2010c427f59\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:34.869683 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-local-certs\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.869847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpqf7\" (UniqueName: \"kubernetes.io/projected/21458a95-2e1c-47f3-9397-b2010c427f59-kube-api-access-jpqf7\") pod \"model-serving-api-54d89bd5fc-cqt8l\" (UID: \"21458a95-2e1c-47f3-9397-b2010c427f59\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:34.869847 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.869815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.869847 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:42:34.869828    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 09 22:42:34.869982 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:42:34.869899    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21458a95-2e1c-47f3-9397-b2010c427f59-tls-certs podName:21458a95-2e1c-47f3-9397-b2010c427f59 nodeName:}" failed. No retries permitted until 2026-07-09 22:42:35.369876731 +0000 UTC m=+596.851700099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/21458a95-2e1c-47f3-9397-b2010c427f59-tls-certs") pod "model-serving-api-54d89bd5fc-cqt8l" (UID: "21458a95-2e1c-47f3-9397-b2010c427f59") : secret "model-serving-api-tls" not found
Jul 09 22:42:34.884390 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.884340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpqf7\" (UniqueName: \"kubernetes.io/projected/21458a95-2e1c-47f3-9397-b2010c427f59-kube-api-access-jpqf7\") pod \"model-serving-api-54d89bd5fc-cqt8l\" (UID: \"21458a95-2e1c-47f3-9397-b2010c427f59\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:34.970766 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.970678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-token\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.970766 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.970747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-cacerts\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.971018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.970793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.971018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.970836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.971018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.970863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfrg\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-kube-api-access-sgfrg\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.971018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.970908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-local-certs\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.971018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.970946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.971607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.971578    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.973742 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.973692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-local-certs\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.973923 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.973899    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-cacerts\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.974443 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.974420    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.974535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.974516    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.979805 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.979767    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-token\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:34.980151 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:34.980134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfrg\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-kube-api-access-sgfrg\") pod \"istiod-openshift-gateway-7574459656-tbvcg\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:35.047122 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.047081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp" event={"ID":"e2d6dc02-d430-4889-b4f5-40f80cd9f222","Type":"ContainerStarted","Data":"2205407402ec480f872d7ab04e14e8f2dd7b69edd3355fc4f33c12669a509237"}
Jul 09 22:42:35.048791 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.048742    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg" event={"ID":"9209a16c-0c41-4aa1-8d5b-31799ec88369","Type":"ContainerStarted","Data":"9bfa833cda3975fd55f93e9f6d6a1e96917fb4e1984dcae40bc7bcd12311d3a0"}
Jul 09 22:42:35.146914 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.146707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:35.318330 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.318251    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"]
Jul 09 22:42:35.374375 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.374262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21458a95-2e1c-47f3-9397-b2010c427f59-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqt8l\" (UID: \"21458a95-2e1c-47f3-9397-b2010c427f59\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:35.378086 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.378029    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21458a95-2e1c-47f3-9397-b2010c427f59-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqt8l\" (UID: \"21458a95-2e1c-47f3-9397-b2010c427f59\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:35.616791 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.616730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:35.800079 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:35.799993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqt8l"]
Jul 09 22:42:35.805248 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:42:35.805208    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21458a95_2e1c_47f3_9397_b2010c427f59.slice/crio-b28ef12af3ad4f00d1906dba463d1de8372916c75d771a7a2021452ad2a445a7 WatchSource:0}: Error finding container b28ef12af3ad4f00d1906dba463d1de8372916c75d771a7a2021452ad2a445a7: Status 404 returned error can't find the container with id b28ef12af3ad4f00d1906dba463d1de8372916c75d771a7a2021452ad2a445a7
Jul 09 22:42:36.055846 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:36.055749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l" event={"ID":"21458a95-2e1c-47f3-9397-b2010c427f59","Type":"ContainerStarted","Data":"b28ef12af3ad4f00d1906dba463d1de8372916c75d771a7a2021452ad2a445a7"}
Jul 09 22:42:36.057549 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:36.057510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg" event={"ID":"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce","Type":"ContainerStarted","Data":"871f330459c113ebeed95490e9c09e670d7e4c63e7bc3abaeb7792eb7fe6894f"}
Jul 09 22:42:39.957665 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:39.957638    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 22:42:39.962400 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:39.962367    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:42:39.962512 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:39.962432    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:42:39.978842 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:39.978818    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:42:39.979814 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:39.979794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:42:40.079468 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.079434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg" event={"ID":"9209a16c-0c41-4aa1-8d5b-31799ec88369","Type":"ContainerStarted","Data":"a1565d315245134849034285d0aa6c128fc5f0c6d78443975604c429078a108f"}
Jul 09 22:42:40.080389 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.080208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:40.082467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.082432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg" event={"ID":"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce","Type":"ContainerStarted","Data":"eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0"}
Jul 09 22:42:40.083069 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.083045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:40.085697 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.085665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l" event={"ID":"21458a95-2e1c-47f3-9397-b2010c427f59","Type":"ContainerStarted","Data":"d1cad6a6eb2131b1b1a90fcde82a95e24f15bc3af32ed9da503e07d83b9a1d00"}
Jul 09 22:42:40.086236 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.086212    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:42:40.088242 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.088214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp" event={"ID":"e2d6dc02-d430-4889-b4f5-40f80cd9f222","Type":"ContainerStarted","Data":"3efd5c1dd30a70b0789ce2b2f6f8707a8f3d33827904f2c5577ad87efb709cc7"}
Jul 09 22:42:40.098966 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.098897    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg" podStartSLOduration=1.392354941 podStartE2EDuration="7.098872991s" totalImagesPullingTime="5.70651805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:40.098336329 +0000 UTC m=+601.580159803" watchObservedRunningTime="2026-07-09 22:42:40.098872991 +0000 UTC m=+601.580696380"
Jul 09 22:42:40.118442 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.118380    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg" podStartSLOduration=1.481037619 podStartE2EDuration="6.118362537s" totalImagesPullingTime="4.637324918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:40.117754175 +0000 UTC m=+601.599577562" watchObservedRunningTime="2026-07-09 22:42:40.118362537 +0000 UTC m=+601.600185924"
Jul 09 22:42:40.136798 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.136705    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l" podStartSLOduration=1.981797894 podStartE2EDuration="6.136681212s" totalImagesPullingTime="4.154883318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:40.134349793 +0000 UTC m=+601.616173182" watchObservedRunningTime="2026-07-09 22:42:40.136681212 +0000 UTC m=+601.618504591"
Jul 09 22:42:40.154417 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:40.153095    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6965988765-gdglp" podStartSLOduration=1.742749176 podStartE2EDuration="7.153072421s" totalImagesPullingTime="5.410323245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:40.151827701 +0000 UTC m=+601.633651089" watchObservedRunningTime="2026-07-09 22:42:40.153072421 +0000 UTC m=+601.634895808"
Jul 09 22:42:41.093855 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:41.093821    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-tbvcg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 22:42:41.094221 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:41.093881    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg" podUID="a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 22:42:42.097078 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:42.097053    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:45.076321 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.076290    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"]
Jul 09 22:42:45.080144 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.080123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.083266 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.083242    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 22:42:45.083377 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.083348    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rmwv8\""
Jul 09 22:42:45.095158 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.095137    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"]
Jul 09 22:42:45.097753 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.097731    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"]
Jul 09 22:42:45.101037 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.101017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.103836 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.103816    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 22:42:45.103984 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.103968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pwj7r\""
Jul 09 22:42:45.112977 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.112952    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"]
Jul 09 22:42:45.171868 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.171835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7j6s\" (UniqueName: \"kubernetes.io/projected/77dbfc96-106b-4cb7-8d93-d480d89c7c51-kube-api-access-p7j6s\") pod \"kserve-controller-manager-d6f4b65b8-s9v4k\" (UID: \"77dbfc96-106b-4cb7-8d93-d480d89c7c51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.171994 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.171895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77dbfc96-106b-4cb7-8d93-d480d89c7c51-cert\") pod \"kserve-controller-manager-d6f4b65b8-s9v4k\" (UID: \"77dbfc96-106b-4cb7-8d93-d480d89c7c51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.172048 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.171989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23e02090-d9cd-47fa-aa4c-43e89e1ba363-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r462n\" (UID: \"23e02090-d9cd-47fa-aa4c-43e89e1ba363\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.172048 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.172035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjtd8\" (UniqueName: \"kubernetes.io/projected/23e02090-d9cd-47fa-aa4c-43e89e1ba363-kube-api-access-fjtd8\") pod \"llmisvc-controller-manager-777c6bd7d5-r462n\" (UID: \"23e02090-d9cd-47fa-aa4c-43e89e1ba363\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.273305 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.273275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77dbfc96-106b-4cb7-8d93-d480d89c7c51-cert\") pod \"kserve-controller-manager-d6f4b65b8-s9v4k\" (UID: \"77dbfc96-106b-4cb7-8d93-d480d89c7c51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.273461 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.273326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23e02090-d9cd-47fa-aa4c-43e89e1ba363-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r462n\" (UID: \"23e02090-d9cd-47fa-aa4c-43e89e1ba363\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.273461 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.273448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjtd8\" (UniqueName: \"kubernetes.io/projected/23e02090-d9cd-47fa-aa4c-43e89e1ba363-kube-api-access-fjtd8\") pod \"llmisvc-controller-manager-777c6bd7d5-r462n\" (UID: \"23e02090-d9cd-47fa-aa4c-43e89e1ba363\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.273655 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.273498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7j6s\" (UniqueName: \"kubernetes.io/projected/77dbfc96-106b-4cb7-8d93-d480d89c7c51-kube-api-access-p7j6s\") pod \"kserve-controller-manager-d6f4b65b8-s9v4k\" (UID: \"77dbfc96-106b-4cb7-8d93-d480d89c7c51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.275924 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.275899    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23e02090-d9cd-47fa-aa4c-43e89e1ba363-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r462n\" (UID: \"23e02090-d9cd-47fa-aa4c-43e89e1ba363\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.276051 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.276030    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77dbfc96-106b-4cb7-8d93-d480d89c7c51-cert\") pod \"kserve-controller-manager-d6f4b65b8-s9v4k\" (UID: \"77dbfc96-106b-4cb7-8d93-d480d89c7c51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.291286 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.291263    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjtd8\" (UniqueName: \"kubernetes.io/projected/23e02090-d9cd-47fa-aa4c-43e89e1ba363-kube-api-access-fjtd8\") pod \"llmisvc-controller-manager-777c6bd7d5-r462n\" (UID: \"23e02090-d9cd-47fa-aa4c-43e89e1ba363\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.291819 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.291801    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7j6s\" (UniqueName: \"kubernetes.io/projected/77dbfc96-106b-4cb7-8d93-d480d89c7c51-kube-api-access-p7j6s\") pod \"kserve-controller-manager-d6f4b65b8-s9v4k\" (UID: \"77dbfc96-106b-4cb7-8d93-d480d89c7c51\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.390573 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.390521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:45.411502 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.411482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:45.541001 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.540946    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"]
Jul 09 22:42:45.545027 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:42:45.544993    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77dbfc96_106b_4cb7_8d93_d480d89c7c51.slice/crio-a01eb59dc7f2a72b140451455a1ecac26bfa46d2d91fe622eaff0b4e8b776760 WatchSource:0}: Error finding container a01eb59dc7f2a72b140451455a1ecac26bfa46d2d91fe622eaff0b4e8b776760: Status 404 returned error can't find the container with id a01eb59dc7f2a72b140451455a1ecac26bfa46d2d91fe622eaff0b4e8b776760
Jul 09 22:42:45.546953 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.546934    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:42:45.565036 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:45.565003    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"]
Jul 09 22:42:45.567166 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:42:45.567142    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod23e02090_d9cd_47fa_aa4c_43e89e1ba363.slice/crio-99b5cb5cf3ed44a01b74f2f99b391066c81ad37c19a1509ce77ee75c0ce731aa WatchSource:0}: Error finding container 99b5cb5cf3ed44a01b74f2f99b391066c81ad37c19a1509ce77ee75c0ce731aa: Status 404 returned error can't find the container with id 99b5cb5cf3ed44a01b74f2f99b391066c81ad37c19a1509ce77ee75c0ce731aa
Jul 09 22:42:46.115368 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:46.115333    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k" event={"ID":"77dbfc96-106b-4cb7-8d93-d480d89c7c51","Type":"ContainerStarted","Data":"a01eb59dc7f2a72b140451455a1ecac26bfa46d2d91fe622eaff0b4e8b776760"}
Jul 09 22:42:46.116453 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:46.116434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n" event={"ID":"23e02090-d9cd-47fa-aa4c-43e89e1ba363","Type":"ContainerStarted","Data":"99b5cb5cf3ed44a01b74f2f99b391066c81ad37c19a1509ce77ee75c0ce731aa"}
Jul 09 22:42:48.330030 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:48.329997    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"]
Jul 09 22:42:48.330449 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:48.330205    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg" podUID="a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" containerName="discovery" containerID="cri-o://eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0" gracePeriod=30
Jul 09 22:42:49.097754 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.097732    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:49.130750 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.130725    2576 generic.go:356] "Generic (PLEG): container finished" podID="a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" containerID="eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0" exitCode=0
Jul 09 22:42:49.130869 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.130802    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"
Jul 09 22:42:49.130869 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.130819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg" event={"ID":"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce","Type":"ContainerDied","Data":"eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0"}
Jul 09 22:42:49.130986 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.130911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg" event={"ID":"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce","Type":"ContainerDied","Data":"871f330459c113ebeed95490e9c09e670d7e4c63e7bc3abaeb7792eb7fe6894f"}
Jul 09 22:42:49.130986 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.130940    2576 scope.go:117] "RemoveContainer" containerID="eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0"
Jul 09 22:42:49.132656 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.132596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k" event={"ID":"77dbfc96-106b-4cb7-8d93-d480d89c7c51","Type":"ContainerStarted","Data":"7111693c62de175c94889e73482f77e36450c11edf6c36fab0b3a71fb73905f5"}
Jul 09 22:42:49.132765 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.132679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:42:49.140353 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.140339    2576 scope.go:117] "RemoveContainer" containerID="eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0"
Jul 09 22:42:49.140604 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:42:49.140589    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0\": container with ID starting with eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0 not found: ID does not exist" containerID="eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0"
Jul 09 22:42:49.140651 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.140611    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0"} err="failed to get container status \"eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0\": rpc error: code = NotFound desc = could not find container \"eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0\": container with ID starting with eb36b7032a42ed47c167c664acd8d132657b48bd6be046c1b29e96faa2f594d0 not found: ID does not exist"
Jul 09 22:42:49.151935 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.151898    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k" podStartSLOduration=1.311363815 podStartE2EDuration="4.151885027s" totalImagesPullingTime="2.840521212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:49.150480358 +0000 UTC m=+610.632303757" watchObservedRunningTime="2026-07-09 22:42:49.151885027 +0000 UTC m=+610.633708413"
Jul 09 22:42:49.206714 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.206693    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-cacerts\") pod \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") "
Jul 09 22:42:49.206827 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.206801    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgfrg\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-kube-api-access-sgfrg\") pod \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") "
Jul 09 22:42:49.206871 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.206830    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-local-certs\") pod \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") "
Jul 09 22:42:49.206871 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.206858    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-ca-configmap\") pod \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") "
Jul 09 22:42:49.206938 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.206910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-token\") pod \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") "
Jul 09 22:42:49.206995 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.206934    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-dns-cert\") pod \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") "
Jul 09 22:42:49.207578 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.207092    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-kubeconfig\") pod \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\" (UID: \"a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce\") "
Jul 09 22:42:49.207578 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.207293    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" (UID: "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:42:49.207578 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.207412    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-ca-configmap\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:42:49.209364 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.209304    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-cacerts" (OuterVolumeSpecName: "cacerts") pod "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" (UID: "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:42:49.209468 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.209402    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-kube-api-access-sgfrg" (OuterVolumeSpecName: "kube-api-access-sgfrg") pod "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" (UID: "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce"). InnerVolumeSpecName "kube-api-access-sgfrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:42:49.209468 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.209402    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" (UID: "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:42:49.209468 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.209436    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" (UID: "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:42:49.209468 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.209450    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-local-certs" (OuterVolumeSpecName: "local-certs") pod "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" (UID: "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:42:49.209468 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.209455    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" (UID: "a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:42:49.308242 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.308216    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-cacerts\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:42:49.308242 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.308242    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgfrg\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-kube-api-access-sgfrg\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:42:49.308407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.308256    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-local-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:42:49.308407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.308270    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-token\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:42:49.308407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.308281    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-csr-dns-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:42:49.308407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.308293    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce-istio-kubeconfig\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:42:49.453019 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.452986    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"]
Jul 09 22:42:49.456929 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:49.456897    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tbvcg"]
Jul 09 22:42:50.141276 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:50.141240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n" event={"ID":"23e02090-d9cd-47fa-aa4c-43e89e1ba363","Type":"ContainerStarted","Data":"115b8aebfd0bdd2563242bce8ebd4d532adda18b8890509dadacd7e7521ae90b"}
Jul 09 22:42:50.186991 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:50.186945    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n" podStartSLOduration=1.760711316 podStartE2EDuration="5.186929271s" totalImagesPullingTime="3.426217955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:42:50.185325169 +0000 UTC m=+611.667148555" watchObservedRunningTime="2026-07-09 22:42:50.186929271 +0000 UTC m=+611.668752698"
Jul 09 22:42:51.043506 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:51.043474    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" path="/var/lib/kubelet/pods/a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce/volumes"
Jul 09 22:42:51.144839 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:51.144813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:42:52.098452 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:52.098423    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ff6bg"
Jul 09 22:42:52.100327 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:42:52.100310    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cqt8l"
Jul 09 22:43:20.146727 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:20.146689    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-s9v4k"
Jul 09 22:43:22.152679 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:22.152651    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r462n"
Jul 09 22:43:34.507948 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.507910    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pg8l"]
Jul 09 22:43:34.508409 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.508367    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" containerName="discovery"
Jul 09 22:43:34.508409 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.508385    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" containerName="discovery"
Jul 09 22:43:34.508522 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.508479    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a589a2e6-43e3-4a3e-a3e3-8a7cfa1ba3ce" containerName="discovery"
Jul 09 22:43:34.510801 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.510757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l"
Jul 09 22:43:34.513520 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.513499    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 22:43:34.514006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.513987    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 22:43:34.514102 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.513987    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l6rbf\""
Jul 09 22:43:34.521405 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.521383    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pg8l"]
Jul 09 22:43:34.558831 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.558803    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6w2h\" (UniqueName: \"kubernetes.io/projected/01a27343-81d8-4383-bad5-d97fb480c498-kube-api-access-b6w2h\") pod \"kuadrant-operator-catalog-4pg8l\" (UID: \"01a27343-81d8-4383-bad5-d97fb480c498\") " pod="kuadrant-system/kuadrant-operator-catalog-4pg8l"
Jul 09 22:43:34.659400 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.659375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6w2h\" (UniqueName: \"kubernetes.io/projected/01a27343-81d8-4383-bad5-d97fb480c498-kube-api-access-b6w2h\") pod \"kuadrant-operator-catalog-4pg8l\" (UID: \"01a27343-81d8-4383-bad5-d97fb480c498\") " pod="kuadrant-system/kuadrant-operator-catalog-4pg8l"
Jul 09 22:43:34.667843 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.667817    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6w2h\" (UniqueName: \"kubernetes.io/projected/01a27343-81d8-4383-bad5-d97fb480c498-kube-api-access-b6w2h\") pod \"kuadrant-operator-catalog-4pg8l\" (UID: \"01a27343-81d8-4383-bad5-d97fb480c498\") " pod="kuadrant-system/kuadrant-operator-catalog-4pg8l"
Jul 09 22:43:34.821304 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.821272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l"
Jul 09 22:43:34.864785 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.864744    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pg8l"]
Jul 09 22:43:34.956171 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:34.956133    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pg8l"]
Jul 09 22:43:34.958550 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:43:34.958524    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a27343_81d8_4383_bad5_d97fb480c498.slice/crio-e41513b1be4b9d48978efb6a7fb08c43253df567ca593ddd8bd85d748ba686c1 WatchSource:0}: Error finding container e41513b1be4b9d48978efb6a7fb08c43253df567ca593ddd8bd85d748ba686c1: Status 404 returned error can't find the container with id e41513b1be4b9d48978efb6a7fb08c43253df567ca593ddd8bd85d748ba686c1
Jul 09 22:43:35.072329 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.072271    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9psd2"]
Jul 09 22:43:35.075354 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.075340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:35.088528 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.088505    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9psd2"]
Jul 09 22:43:35.163513 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.163486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxgm5\" (UniqueName: \"kubernetes.io/projected/213fb219-39c2-4f73-913d-d5cb1d90b83b-kube-api-access-sxgm5\") pod \"kuadrant-operator-catalog-9psd2\" (UID: \"213fb219-39c2-4f73-913d-d5cb1d90b83b\") " pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:35.264842 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.264811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxgm5\" (UniqueName: \"kubernetes.io/projected/213fb219-39c2-4f73-913d-d5cb1d90b83b-kube-api-access-sxgm5\") pod \"kuadrant-operator-catalog-9psd2\" (UID: \"213fb219-39c2-4f73-913d-d5cb1d90b83b\") " pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:35.277823 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.277795    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxgm5\" (UniqueName: \"kubernetes.io/projected/213fb219-39c2-4f73-913d-d5cb1d90b83b-kube-api-access-sxgm5\") pod \"kuadrant-operator-catalog-9psd2\" (UID: \"213fb219-39c2-4f73-913d-d5cb1d90b83b\") " pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:35.335424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.335351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l" event={"ID":"01a27343-81d8-4383-bad5-d97fb480c498","Type":"ContainerStarted","Data":"e41513b1be4b9d48978efb6a7fb08c43253df567ca593ddd8bd85d748ba686c1"}
Jul 09 22:43:35.384954 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.384932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:35.521090 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:35.521063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9psd2"]
Jul 09 22:43:35.538866 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:43:35.538833    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213fb219_39c2_4f73_913d_d5cb1d90b83b.slice/crio-8086320bdd5207711b20def2f633248cb2768ed193f5a0d26c3fba47c831c66b WatchSource:0}: Error finding container 8086320bdd5207711b20def2f633248cb2768ed193f5a0d26c3fba47c831c66b: Status 404 returned error can't find the container with id 8086320bdd5207711b20def2f633248cb2768ed193f5a0d26c3fba47c831c66b
Jul 09 22:43:36.342416 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:36.342379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9psd2" event={"ID":"213fb219-39c2-4f73-913d-d5cb1d90b83b","Type":"ContainerStarted","Data":"8086320bdd5207711b20def2f633248cb2768ed193f5a0d26c3fba47c831c66b"}
Jul 09 22:43:37.347698 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.347664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9psd2" event={"ID":"213fb219-39c2-4f73-913d-d5cb1d90b83b","Type":"ContainerStarted","Data":"c151f1b71ac5b2d1bc2c7db7334dfcd9da95f4cc556f411560fccc0148987918"}
Jul 09 22:43:37.349165 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.349142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l" event={"ID":"01a27343-81d8-4383-bad5-d97fb480c498","Type":"ContainerStarted","Data":"963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62"}
Jul 09 22:43:37.349271 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.349222    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l" podUID="01a27343-81d8-4383-bad5-d97fb480c498" containerName="registry-server" containerID="cri-o://963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62" gracePeriod=2
Jul 09 22:43:37.365785 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.365734    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9psd2" podStartSLOduration=0.864510666 podStartE2EDuration="2.365720356s" totalImagesPullingTime="1.50120969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:43:37.364243446 +0000 UTC m=+658.846066835" watchObservedRunningTime="2026-07-09 22:43:37.365720356 +0000 UTC m=+658.847543743"
Jul 09 22:43:37.381569 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.381532    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l" podStartSLOduration=1.303256498 podStartE2EDuration="3.381519279s" totalImagesPullingTime="2.078262781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:43:37.3802851 +0000 UTC m=+658.862108485" watchObservedRunningTime="2026-07-09 22:43:37.381519279 +0000 UTC m=+658.863342683"
Jul 09 22:43:37.611320 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.611251    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l"
Jul 09 22:43:37.686958 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.686927    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6w2h\" (UniqueName: \"kubernetes.io/projected/01a27343-81d8-4383-bad5-d97fb480c498-kube-api-access-b6w2h\") pod \"01a27343-81d8-4383-bad5-d97fb480c498\" (UID: \"01a27343-81d8-4383-bad5-d97fb480c498\") "
Jul 09 22:43:37.689073 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.689047    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a27343-81d8-4383-bad5-d97fb480c498-kube-api-access-b6w2h" (OuterVolumeSpecName: "kube-api-access-b6w2h") pod "01a27343-81d8-4383-bad5-d97fb480c498" (UID: "01a27343-81d8-4383-bad5-d97fb480c498"). InnerVolumeSpecName "kube-api-access-b6w2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:43:37.787632 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:37.787595    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6w2h\" (UniqueName: \"kubernetes.io/projected/01a27343-81d8-4383-bad5-d97fb480c498-kube-api-access-b6w2h\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:43:38.354311 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.354215    2576 generic.go:356] "Generic (PLEG): container finished" podID="01a27343-81d8-4383-bad5-d97fb480c498" containerID="963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62" exitCode=0
Jul 09 22:43:38.354311 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.354256    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l"
Jul 09 22:43:38.354311 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.354301    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l" event={"ID":"01a27343-81d8-4383-bad5-d97fb480c498","Type":"ContainerDied","Data":"963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62"}
Jul 09 22:43:38.354834 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.354345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4pg8l" event={"ID":"01a27343-81d8-4383-bad5-d97fb480c498","Type":"ContainerDied","Data":"e41513b1be4b9d48978efb6a7fb08c43253df567ca593ddd8bd85d748ba686c1"}
Jul 09 22:43:38.354834 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.354368    2576 scope.go:117] "RemoveContainer" containerID="963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62"
Jul 09 22:43:38.363107 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.363092    2576 scope.go:117] "RemoveContainer" containerID="963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62"
Jul 09 22:43:38.363349 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:43:38.363333    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62\": container with ID starting with 963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62 not found: ID does not exist" containerID="963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62"
Jul 09 22:43:38.363398 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.363356    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62"} err="failed to get container status \"963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62\": rpc error: code = NotFound desc = could not find container \"963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62\": container with ID starting with 963f9428f7d651812ea67f8013540848dc62dfef8eb1199eb3cbc3a25a6b4b62 not found: ID does not exist"
Jul 09 22:43:38.376841 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.376820    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pg8l"]
Jul 09 22:43:38.378793 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:38.378753    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4pg8l"]
Jul 09 22:43:39.042178 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:39.042154    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a27343-81d8-4383-bad5-d97fb480c498" path="/var/lib/kubelet/pods/01a27343-81d8-4383-bad5-d97fb480c498/volumes"
Jul 09 22:43:45.385707 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:45.385666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:45.386113 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:45.385734    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:45.407644 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:45.407624    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:43:46.407889 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:43:46.407863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9psd2"
Jul 09 22:44:09.855305 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.855274    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"]
Jul 09 22:44:09.855895 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.855575    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a27343-81d8-4383-bad5-d97fb480c498" containerName="registry-server"
Jul 09 22:44:09.855895 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.855590    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a27343-81d8-4383-bad5-d97fb480c498" containerName="registry-server"
Jul 09 22:44:09.855895 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.855647    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01a27343-81d8-4383-bad5-d97fb480c498" containerName="registry-server"
Jul 09 22:44:09.862134 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.862115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:09.866363 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.866347    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gnpth\""
Jul 09 22:44:09.879061 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.879041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"]
Jul 09 22:44:09.944474 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.944449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrtln\" (UniqueName: \"kubernetes.io/projected/b14164d0-bab6-4f9d-82a4-1b65d3628f51-kube-api-access-hrtln\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:09.944607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:09.944478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14164d0-bab6-4f9d-82a4-1b65d3628f51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:10.045707 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.045678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrtln\" (UniqueName: \"kubernetes.io/projected/b14164d0-bab6-4f9d-82a4-1b65d3628f51-kube-api-access-hrtln\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:10.045890 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.045712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14164d0-bab6-4f9d-82a4-1b65d3628f51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:10.046118 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.046101    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14164d0-bab6-4f9d-82a4-1b65d3628f51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:10.060639 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.060614    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrtln\" (UniqueName: \"kubernetes.io/projected/b14164d0-bab6-4f9d-82a4-1b65d3628f51-kube-api-access-hrtln\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:10.171554 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.171477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:10.306216 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.306176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"]
Jul 09 22:44:10.313031 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:44:10.312999    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14164d0_bab6_4f9d_82a4_1b65d3628f51.slice/crio-415f919825101676a0e3dd28199e2bedae88a4434f9d3649658fbe751a3f9e39 WatchSource:0}: Error finding container 415f919825101676a0e3dd28199e2bedae88a4434f9d3649658fbe751a3f9e39: Status 404 returned error can't find the container with id 415f919825101676a0e3dd28199e2bedae88a4434f9d3649658fbe751a3f9e39
Jul 09 22:44:10.482505 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.482427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn" event={"ID":"b14164d0-bab6-4f9d-82a4-1b65d3628f51","Type":"ContainerStarted","Data":"415f919825101676a0e3dd28199e2bedae88a4434f9d3649658fbe751a3f9e39"}
Jul 09 22:44:10.784226 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.784145    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554bc48674-vcx5q"]
Jul 09 22:44:10.788747 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.788732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:10.805089 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.805065    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554bc48674-vcx5q"]
Jul 09 22:44:10.953287 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.953256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-service-ca\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:10.953649 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.953297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7wmj\" (UniqueName: \"kubernetes.io/projected/db936990-f0b0-4b2a-880e-2b51f147e0bf-kube-api-access-g7wmj\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:10.953649 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.953366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-oauth-serving-cert\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:10.953649 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.953394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-oauth-config\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:10.953649 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.953445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-trusted-ca-bundle\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:10.953649 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.953469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-serving-cert\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:10.953649 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:10.953517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-config\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054077 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-oauth-serving-cert\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054077 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-oauth-config\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054077 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-trusted-ca-bundle\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054077 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-serving-cert\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-config\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-service-ca\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7wmj\" (UniqueName: \"kubernetes.io/projected/db936990-f0b0-4b2a-880e-2b51f147e0bf-kube-api-access-g7wmj\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054897 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054872    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-oauth-serving-cert\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.054897 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054888    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-config\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.055031 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.054897    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-trusted-ca-bundle\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.055031 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.055011    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db936990-f0b0-4b2a-880e-2b51f147e0bf-service-ca\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.056447 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.056424    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-oauth-config\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.056524 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.056501    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db936990-f0b0-4b2a-880e-2b51f147e0bf-console-serving-cert\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.065057 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.065036    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7wmj\" (UniqueName: \"kubernetes.io/projected/db936990-f0b0-4b2a-880e-2b51f147e0bf-kube-api-access-g7wmj\") pod \"console-554bc48674-vcx5q\" (UID: \"db936990-f0b0-4b2a-880e-2b51f147e0bf\") " pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.097413 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.097390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:11.261554 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.261510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554bc48674-vcx5q"]
Jul 09 22:44:11.264313 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:44:11.264270    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb936990_f0b0_4b2a_880e_2b51f147e0bf.slice/crio-011c017a47df4b08fb1e0d7f8d02ff1b31eb8720c497c26f39f7e8ca1abae5af WatchSource:0}: Error finding container 011c017a47df4b08fb1e0d7f8d02ff1b31eb8720c497c26f39f7e8ca1abae5af: Status 404 returned error can't find the container with id 011c017a47df4b08fb1e0d7f8d02ff1b31eb8720c497c26f39f7e8ca1abae5af
Jul 09 22:44:11.488095 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.488056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554bc48674-vcx5q" event={"ID":"db936990-f0b0-4b2a-880e-2b51f147e0bf","Type":"ContainerStarted","Data":"fd58c4d4738676aeb69785d552ae21f233a86966bd44982259efa011d49c168d"}
Jul 09 22:44:11.488280 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.488109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554bc48674-vcx5q" event={"ID":"db936990-f0b0-4b2a-880e-2b51f147e0bf","Type":"ContainerStarted","Data":"011c017a47df4b08fb1e0d7f8d02ff1b31eb8720c497c26f39f7e8ca1abae5af"}
Jul 09 22:44:11.515051 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:11.515002    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554bc48674-vcx5q" podStartSLOduration=1.514986909 podStartE2EDuration="1.514986909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:11.512408038 +0000 UTC m=+692.994231450" watchObservedRunningTime="2026-07-09 22:44:11.514986909 +0000 UTC m=+692.996810292"
Jul 09 22:44:13.288755 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.288727    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"]
Jul 09 22:44:13.292757 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.292734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"
Jul 09 22:44:13.296463 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.296435    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lnnmz\""
Jul 09 22:44:13.313647 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.313626    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"]
Jul 09 22:44:13.372556 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.372529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnl9c\" (UniqueName: \"kubernetes.io/projected/51da3c3f-c2c1-44d8-b352-be9e55a57512-kube-api-access-cnl9c\") pod \"authorino-operator-75cc8d5cb7-mcvzd\" (UID: \"51da3c3f-c2c1-44d8-b352-be9e55a57512\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"
Jul 09 22:44:13.472947 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.472921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnl9c\" (UniqueName: \"kubernetes.io/projected/51da3c3f-c2c1-44d8-b352-be9e55a57512-kube-api-access-cnl9c\") pod \"authorino-operator-75cc8d5cb7-mcvzd\" (UID: \"51da3c3f-c2c1-44d8-b352-be9e55a57512\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"
Jul 09 22:44:13.486986 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.486967    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnl9c\" (UniqueName: \"kubernetes.io/projected/51da3c3f-c2c1-44d8-b352-be9e55a57512-kube-api-access-cnl9c\") pod \"authorino-operator-75cc8d5cb7-mcvzd\" (UID: \"51da3c3f-c2c1-44d8-b352-be9e55a57512\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"
Jul 09 22:44:13.605620 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.605594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"
Jul 09 22:44:13.748735 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:13.748701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"]
Jul 09 22:44:13.751139 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:44:13.751107    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51da3c3f_c2c1_44d8_b352_be9e55a57512.slice/crio-37f6ceb8c231d8f1ac703e3255f6204a75a4e61da4a14199f60ccbc84a808e1a WatchSource:0}: Error finding container 37f6ceb8c231d8f1ac703e3255f6204a75a4e61da4a14199f60ccbc84a808e1a: Status 404 returned error can't find the container with id 37f6ceb8c231d8f1ac703e3255f6204a75a4e61da4a14199f60ccbc84a808e1a
Jul 09 22:44:14.509577 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:14.509534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd" event={"ID":"51da3c3f-c2c1-44d8-b352-be9e55a57512","Type":"ContainerStarted","Data":"37f6ceb8c231d8f1ac703e3255f6204a75a4e61da4a14199f60ccbc84a808e1a"}
Jul 09 22:44:16.278439 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.278407    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"]
Jul 09 22:44:16.287292 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.287269    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:16.291262 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.291239    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j2wrb\""
Jul 09 22:44:16.294410 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.294385    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"]
Jul 09 22:44:16.398647 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.398614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7nt\" (UniqueName: \"kubernetes.io/projected/39438948-4ed0-46bc-80c3-948326bd2a95-kube-api-access-nx7nt\") pod \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" (UID: \"39438948-4ed0-46bc-80c3-948326bd2a95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:16.499372 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.499338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7nt\" (UniqueName: \"kubernetes.io/projected/39438948-4ed0-46bc-80c3-948326bd2a95-kube-api-access-nx7nt\") pod \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" (UID: \"39438948-4ed0-46bc-80c3-948326bd2a95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:16.512677 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.512654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7nt\" (UniqueName: \"kubernetes.io/projected/39438948-4ed0-46bc-80c3-948326bd2a95-kube-api-access-nx7nt\") pod \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" (UID: \"39438948-4ed0-46bc-80c3-948326bd2a95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:16.600607 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.600579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:16.946347 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:16.946325    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"]
Jul 09 22:44:16.948504 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:44:16.948476    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39438948_4ed0_46bc_80c3_948326bd2a95.slice/crio-eb2c1d33c396748af29c0772a10c9d0778fe522989d944c7a7f819b020ba37f2 WatchSource:0}: Error finding container eb2c1d33c396748af29c0772a10c9d0778fe522989d944c7a7f819b020ba37f2: Status 404 returned error can't find the container with id eb2c1d33c396748af29c0772a10c9d0778fe522989d944c7a7f819b020ba37f2
Jul 09 22:44:17.527633 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:17.527543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn" event={"ID":"b14164d0-bab6-4f9d-82a4-1b65d3628f51","Type":"ContainerStarted","Data":"4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d"}
Jul 09 22:44:17.528067 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:17.527724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:17.529197 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:17.529174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd" event={"ID":"51da3c3f-c2c1-44d8-b352-be9e55a57512","Type":"ContainerStarted","Data":"c90a786e21e05b664adf6b122eff80b2f36c6f1dbdc8aa72ccd5e954000c38b8"}
Jul 09 22:44:17.529332 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:17.529230    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"
Jul 09 22:44:17.530363 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:17.530344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl" event={"ID":"39438948-4ed0-46bc-80c3-948326bd2a95","Type":"ContainerStarted","Data":"eb2c1d33c396748af29c0772a10c9d0778fe522989d944c7a7f819b020ba37f2"}
Jul 09 22:44:17.553412 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:17.553368    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn" podStartSLOduration=2.014540331 podStartE2EDuration="8.553352286s" totalImagesPullingTime="6.538811955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:17.550223484 +0000 UTC m=+699.032046871" watchObservedRunningTime="2026-07-09 22:44:17.553352286 +0000 UTC m=+699.035175673"
Jul 09 22:44:17.573729 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:17.573683    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd" podStartSLOduration=1.461702451 podStartE2EDuration="4.573668246s" totalImagesPullingTime="3.111965795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:17.57118195 +0000 UTC m=+699.053005335" watchObservedRunningTime="2026-07-09 22:44:17.573668246 +0000 UTC m=+699.055491633"
Jul 09 22:44:19.539887 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.539853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl" event={"ID":"39438948-4ed0-46bc-80c3-948326bd2a95","Type":"ContainerStarted","Data":"967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2"}
Jul 09 22:44:19.540233 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.539971    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:19.843237 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.843181    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl" podStartSLOduration=2.228178885 podStartE2EDuration="3.843160562s" totalImagesPullingTime="1.614981677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:19.567680431 +0000 UTC m=+701.049503815" watchObservedRunningTime="2026-07-09 22:44:19.843160562 +0000 UTC m=+701.324983950"
Jul 09 22:44:19.844757 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.844732    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"]
Jul 09 22:44:19.848066 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.848046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:19.850787 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.850741    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 22:44:19.850787 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.850746    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 22:44:19.850787 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.850790    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x6swm\""
Jul 09 22:44:19.860445 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.860418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"]
Jul 09 22:44:19.927846 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.927814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ngpt\" (UniqueName: \"kubernetes.io/projected/77294efb-435c-44ac-a528-c52d30b102bb-kube-api-access-9ngpt\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:19.928003 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.927863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77294efb-435c-44ac-a528-c52d30b102bb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:19.928003 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:19.927932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77294efb-435c-44ac-a528-c52d30b102bb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.028833 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.028797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77294efb-435c-44ac-a528-c52d30b102bb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.028986 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.028860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ngpt\" (UniqueName: \"kubernetes.io/projected/77294efb-435c-44ac-a528-c52d30b102bb-kube-api-access-9ngpt\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.028986 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.028900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77294efb-435c-44ac-a528-c52d30b102bb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.029059 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:20.029009    2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 22:44:20.029091 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:20.029075    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77294efb-435c-44ac-a528-c52d30b102bb-plugin-serving-cert podName:77294efb-435c-44ac-a528-c52d30b102bb nodeName:}" failed. No retries permitted until 2026-07-09 22:44:20.529055307 +0000 UTC m=+702.010878670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/77294efb-435c-44ac-a528-c52d30b102bb-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-kzr82" (UID: "77294efb-435c-44ac-a528-c52d30b102bb") : secret "plugin-serving-cert" not found
Jul 09 22:44:20.029447 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.029429    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77294efb-435c-44ac-a528-c52d30b102bb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.039801 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.039742    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ngpt\" (UniqueName: \"kubernetes.io/projected/77294efb-435c-44ac-a528-c52d30b102bb-kube-api-access-9ngpt\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.532932 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.532899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77294efb-435c-44ac-a528-c52d30b102bb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.535197 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.535171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77294efb-435c-44ac-a528-c52d30b102bb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kzr82\" (UID: \"77294efb-435c-44ac-a528-c52d30b102bb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.756638 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.756603    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"
Jul 09 22:44:20.888469 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:20.888443    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82"]
Jul 09 22:44:20.890022 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:44:20.889992    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77294efb_435c_44ac_a528_c52d30b102bb.slice/crio-c9b9e70ed610cd446823b8f51d85941cb096213f87221c189dde21c9c841830a WatchSource:0}: Error finding container c9b9e70ed610cd446823b8f51d85941cb096213f87221c189dde21c9c841830a: Status 404 returned error can't find the container with id c9b9e70ed610cd446823b8f51d85941cb096213f87221c189dde21c9c841830a
Jul 09 22:44:21.098077 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:21.098047    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:21.098255 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:21.098101    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:21.102582 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:21.102550    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:21.551604 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:21.551517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82" event={"ID":"77294efb-435c-44ac-a528-c52d30b102bb","Type":"ContainerStarted","Data":"c9b9e70ed610cd446823b8f51d85941cb096213f87221c189dde21c9c841830a"}
Jul 09 22:44:21.556159 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:21.556136    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554bc48674-vcx5q"
Jul 09 22:44:21.642943 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:21.642576    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b884dbd58-lzg26"]
Jul 09 22:44:28.537467 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:28.537431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:28.538041 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:28.537639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mcvzd"
Jul 09 22:44:30.547000 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.546906    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:30.574406 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.574368    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"]
Jul 09 22:44:30.574599 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.574564    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" containerName="manager" containerID="cri-o://4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d" gracePeriod=2
Jul 09 22:44:30.576193 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.576166    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"]
Jul 09 22:44:30.586034 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:30.585998    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:30.596081 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.596037    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"]
Jul 09 22:44:30.600267 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.600225    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" containerName="manager" containerID="cri-o://967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2" gracePeriod=2
Jul 09 22:44:30.603718 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:30.603599    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:30.606320 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:30.606283    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:30.606722 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.606676    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"]
Jul 09 22:44:30.624980 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.624955    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"]
Jul 09 22:44:30.625400 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.625379    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" containerName="manager"
Jul 09 22:44:30.625400 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.625401    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" containerName="manager"
Jul 09 22:44:30.625543 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.625422    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" containerName="manager"
Jul 09 22:44:30.625543 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.625428    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" containerName="manager"
Jul 09 22:44:30.625543 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.625498    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" containerName="manager"
Jul 09 22:44:30.625543 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.625516    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" containerName="manager"
Jul 09 22:44:30.630362 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.630341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:30.657266 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.657236    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"]
Jul 09 22:44:30.662321 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.662244    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"
Jul 09 22:44:30.664102 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.664080    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"]
Jul 09 22:44:30.684321 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.684292    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"]
Jul 09 22:44:30.694720 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:30.694686    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:30.698241 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:30.698215    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:30.700824 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:30.700793    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:30.725309 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.725273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5kp\" (UniqueName: \"kubernetes.io/projected/f34dd198-cbdf-4407-8e71-d57ec65ec88e-kube-api-access-vc5kp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7vg9\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:30.725420 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.725330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34dd198-cbdf-4407-8e71-d57ec65ec88e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7vg9\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:30.725477 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.725436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmfsn\" (UniqueName: \"kubernetes.io/projected/4fbffb9f-f144-4735-9643-76f42e0492c5-kube-api-access-wmfsn\") pod \"limitador-operator-controller-manager-859d7b78bd-8jqfn\" (UID: \"4fbffb9f-f144-4735-9643-76f42e0492c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"
Jul 09 22:44:30.729826 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:30.729795    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:30.826398 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.826358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5kp\" (UniqueName: \"kubernetes.io/projected/f34dd198-cbdf-4407-8e71-d57ec65ec88e-kube-api-access-vc5kp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7vg9\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:30.826595 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.826520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34dd198-cbdf-4407-8e71-d57ec65ec88e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7vg9\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:30.826595 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.826560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmfsn\" (UniqueName: \"kubernetes.io/projected/4fbffb9f-f144-4735-9643-76f42e0492c5-kube-api-access-wmfsn\") pod \"limitador-operator-controller-manager-859d7b78bd-8jqfn\" (UID: \"4fbffb9f-f144-4735-9643-76f42e0492c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"
Jul 09 22:44:30.826955 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.826932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34dd198-cbdf-4407-8e71-d57ec65ec88e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7vg9\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:30.836844 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.836814    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmfsn\" (UniqueName: \"kubernetes.io/projected/4fbffb9f-f144-4735-9643-76f42e0492c5-kube-api-access-wmfsn\") pod \"limitador-operator-controller-manager-859d7b78bd-8jqfn\" (UID: \"4fbffb9f-f144-4735-9643-76f42e0492c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"
Jul 09 22:44:30.838325 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:30.838300    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5kp\" (UniqueName: \"kubernetes.io/projected/f34dd198-cbdf-4407-8e71-d57ec65ec88e-kube-api-access-vc5kp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g7vg9\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:31.004331 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:31.004109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:31.009208 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:31.009180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"
Jul 09 22:44:41.446319 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.446244    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:41.449611 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.449535    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:41.452964 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.452942    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:41.455309 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.455272    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:41.457761 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.457733    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:41.475472 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.475448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"]
Jul 09 22:44:41.477550 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:44:41.477523    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbffb9f_f144_4735_9643_76f42e0492c5.slice/crio-a133be80a1046817a386cc39797273ed164869bf203c406977557f9bd469bfb5 WatchSource:0}: Error finding container a133be80a1046817a386cc39797273ed164869bf203c406977557f9bd469bfb5: Status 404 returned error can't find the container with id a133be80a1046817a386cc39797273ed164869bf203c406977557f9bd469bfb5
Jul 09 22:44:41.501406 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.501384    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"]
Jul 09 22:44:41.505810 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:44:41.505763    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34dd198_cbdf_4407_8e71_d57ec65ec88e.slice/crio-f336e166894af8582e71d174bda792f49e1fbb83f584f71a90d53db741524de3 WatchSource:0}: Error finding container f336e166894af8582e71d174bda792f49e1fbb83f584f71a90d53db741524de3: Status 404 returned error can't find the container with id f336e166894af8582e71d174bda792f49e1fbb83f584f71a90d53db741524de3
Jul 09 22:44:41.531587 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.531569    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14164d0-bab6-4f9d-82a4-1b65d3628f51-extensions-socket-volume\") pod \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") "
Jul 09 22:44:41.531679 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.531612    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx7nt\" (UniqueName: \"kubernetes.io/projected/39438948-4ed0-46bc-80c3-948326bd2a95-kube-api-access-nx7nt\") pod \"39438948-4ed0-46bc-80c3-948326bd2a95\" (UID: \"39438948-4ed0-46bc-80c3-948326bd2a95\") "
Jul 09 22:44:41.531679 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.531654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrtln\" (UniqueName: \"kubernetes.io/projected/b14164d0-bab6-4f9d-82a4-1b65d3628f51-kube-api-access-hrtln\") pod \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\" (UID: \"b14164d0-bab6-4f9d-82a4-1b65d3628f51\") "
Jul 09 22:44:41.532091 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.532065    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14164d0-bab6-4f9d-82a4-1b65d3628f51-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b14164d0-bab6-4f9d-82a4-1b65d3628f51" (UID: "b14164d0-bab6-4f9d-82a4-1b65d3628f51"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:44:41.533903 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.533878    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39438948-4ed0-46bc-80c3-948326bd2a95-kube-api-access-nx7nt" (OuterVolumeSpecName: "kube-api-access-nx7nt") pod "39438948-4ed0-46bc-80c3-948326bd2a95" (UID: "39438948-4ed0-46bc-80c3-948326bd2a95"). InnerVolumeSpecName "kube-api-access-nx7nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:44:41.534184 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.534155    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14164d0-bab6-4f9d-82a4-1b65d3628f51-kube-api-access-hrtln" (OuterVolumeSpecName: "kube-api-access-hrtln") pod "b14164d0-bab6-4f9d-82a4-1b65d3628f51" (UID: "b14164d0-bab6-4f9d-82a4-1b65d3628f51"). InnerVolumeSpecName "kube-api-access-hrtln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:44:41.632442 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.632414    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14164d0-bab6-4f9d-82a4-1b65d3628f51-extensions-socket-volume\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:41.632442 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.632443    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx7nt\" (UniqueName: \"kubernetes.io/projected/39438948-4ed0-46bc-80c3-948326bd2a95-kube-api-access-nx7nt\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:41.632587 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.632456    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrtln\" (UniqueName: \"kubernetes.io/projected/b14164d0-bab6-4f9d-82a4-1b65d3628f51-kube-api-access-hrtln\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:41.659113 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.659081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn" event={"ID":"4fbffb9f-f144-4735-9643-76f42e0492c5","Type":"ContainerStarted","Data":"169f92f2a328ea165c9ecf1ade01fdc20abb424aba8d641735180b3c37c37535"}
Jul 09 22:44:41.659243 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.659133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn" event={"ID":"4fbffb9f-f144-4735-9643-76f42e0492c5","Type":"ContainerStarted","Data":"a133be80a1046817a386cc39797273ed164869bf203c406977557f9bd469bfb5"}
Jul 09 22:44:41.659243 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.659173    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"
Jul 09 22:44:41.660560 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.660531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82" event={"ID":"77294efb-435c-44ac-a528-c52d30b102bb","Type":"ContainerStarted","Data":"f1d20046dde620d32636b015ad58bb7fb8fd88258f06a7ed747794b4bcd57292"}
Jul 09 22:44:41.661722 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.661703    2576 generic.go:356] "Generic (PLEG): container finished" podID="39438948-4ed0-46bc-80c3-948326bd2a95" containerID="967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2" exitCode=0
Jul 09 22:44:41.661816 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.661744    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:41.661816 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.661803    2576 scope.go:117] "RemoveContainer" containerID="967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2"
Jul 09 22:44:41.662744 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.662636    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:41.663697 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.663666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9" event={"ID":"f34dd198-cbdf-4407-8e71-d57ec65ec88e","Type":"ContainerStarted","Data":"5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f"}
Jul 09 22:44:41.663835 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.663719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9" event={"ID":"f34dd198-cbdf-4407-8e71-d57ec65ec88e","Type":"ContainerStarted","Data":"f336e166894af8582e71d174bda792f49e1fbb83f584f71a90d53db741524de3"}
Jul 09 22:44:41.663835 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.663750    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:41.665023 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.664994    2576 generic.go:356] "Generic (PLEG): container finished" podID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" containerID="4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d" exitCode=0
Jul 09 22:44:41.665113 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.665052    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:41.670076 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.670047    2576 scope.go:117] "RemoveContainer" containerID="967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2"
Jul 09 22:44:41.670312 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.670293    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2\": container with ID starting with 967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2 not found: ID does not exist" containerID="967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2"
Jul 09 22:44:41.670398 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.670322    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2"} err="failed to get container status \"967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2\": rpc error: code = NotFound desc = could not find container \"967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2\": container with ID starting with 967b228f9a2764f035e477c2d000eac922493fcfe84d90d82990a3e308558ae2 not found: ID does not exist"
Jul 09 22:44:41.670398 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.670342    2576 scope.go:117] "RemoveContainer" containerID="4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d"
Jul 09 22:44:41.678175 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.678163    2576 scope.go:117] "RemoveContainer" containerID="4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d"
Jul 09 22:44:41.678394 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.678377    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d\": container with ID starting with 4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d not found: ID does not exist" containerID="4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d"
Jul 09 22:44:41.678444 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.678398    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d"} err="failed to get container status \"4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d\": rpc error: code = NotFound desc = could not find container \"4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d\": container with ID starting with 4d1a0185a91d87d576bd2d83ff58c5144f3d10c262af0b08662b68d6abe6f28d not found: ID does not exist"
Jul 09 22:44:41.687836 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.687765    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn" podStartSLOduration=11.68775066 podStartE2EDuration="11.68775066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:41.687028984 +0000 UTC m=+723.168852391" watchObservedRunningTime="2026-07-09 22:44:41.68775066 +0000 UTC m=+723.169574046"
Jul 09 22:44:41.690690 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.690670    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:41.694355 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.694334    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvkfn\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvkfn"
Jul 09 22:44:41.699533 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:41.699512    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-x2dwl\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x2dwl"
Jul 09 22:44:41.722016 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.721969    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kzr82" podStartSLOduration=2.256035889 podStartE2EDuration="22.721953335s" totalImagesPullingTime="20.465917446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:41.719704213 +0000 UTC m=+723.201527598" watchObservedRunningTime="2026-07-09 22:44:41.721953335 +0000 UTC m=+723.203776724"
Jul 09 22:44:41.747056 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:41.747017    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9" podStartSLOduration=11.74700301 podStartE2EDuration="11.74700301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:44:41.745726227 +0000 UTC m=+723.227549616" watchObservedRunningTime="2026-07-09 22:44:41.74700301 +0000 UTC m=+723.228826393"
Jul 09 22:44:43.043047 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:43.043017    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39438948-4ed0-46bc-80c3-948326bd2a95" path="/var/lib/kubelet/pods/39438948-4ed0-46bc-80c3-948326bd2a95/volumes"
Jul 09 22:44:43.043392 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:43.043333    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14164d0-bab6-4f9d-82a4-1b65d3628f51" path="/var/lib/kubelet/pods/b14164d0-bab6-4f9d-82a4-1b65d3628f51/volumes"
Jul 09 22:44:46.672634 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:46.672572    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b884dbd58-lzg26" podUID="58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" containerName="console" containerID="cri-o://15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f" gracePeriod=15
Jul 09 22:44:47.473659 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.473630    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:44:47.580054 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.579963    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-trusted-ca-bundle\") pod \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") "
Jul 09 22:44:47.580222 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580063    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdt4m\" (UniqueName: \"kubernetes.io/projected/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-kube-api-access-qdt4m\") pod \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") "
Jul 09 22:44:47.580222 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580094    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-service-ca\") pod \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") "
Jul 09 22:44:47.580222 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-serving-cert\") pod \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") "
Jul 09 22:44:47.580222 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580156    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-config\") pod \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") "
Jul 09 22:44:47.580222 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580193    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-oauth-serving-cert\") pod \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") "
Jul 09 22:44:47.580222 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-oauth-config\") pod \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\" (UID: \"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7\") "
Jul 09 22:44:47.580498 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580442    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" (UID: "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:44:47.580534 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580516    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" (UID: "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:44:47.580600 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580570    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" (UID: "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:44:47.580858 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.580836    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-config" (OuterVolumeSpecName: "console-config") pod "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" (UID: "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:44:47.582297 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.582276    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" (UID: "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:44:47.582403 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.582313    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" (UID: "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:44:47.582460 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.582416    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-kube-api-access-qdt4m" (OuterVolumeSpecName: "kube-api-access-qdt4m") pod "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" (UID: "58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7"). InnerVolumeSpecName "kube-api-access-qdt4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:44:47.680878 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.680850    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdt4m\" (UniqueName: \"kubernetes.io/projected/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-kube-api-access-qdt4m\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:47.680878 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.680876    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-service-ca\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:47.680878 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.680885    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-serving-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:47.681290 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.680894    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-config\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:47.681290 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.680904    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-oauth-serving-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:47.681290 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.680911    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-console-oauth-config\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:47.681290 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.680920    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7-trusted-ca-bundle\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:47.696550 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.696522    2576 generic.go:356] "Generic (PLEG): container finished" podID="58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" containerID="15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f" exitCode=0
Jul 09 22:44:47.696720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.696564    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b884dbd58-lzg26"
Jul 09 22:44:47.696720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.696568    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b884dbd58-lzg26" event={"ID":"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7","Type":"ContainerDied","Data":"15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f"}
Jul 09 22:44:47.696720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.696616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b884dbd58-lzg26" event={"ID":"58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7","Type":"ContainerDied","Data":"d9fad97ba50599d887b41706faa8deadf2dbf8dc035d7e085a8217fe15224df1"}
Jul 09 22:44:47.696720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.696640    2576 scope.go:117] "RemoveContainer" containerID="15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f"
Jul 09 22:44:47.705945 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.705921    2576 scope.go:117] "RemoveContainer" containerID="15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f"
Jul 09 22:44:47.706220 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:47.706200    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f\": container with ID starting with 15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f not found: ID does not exist" containerID="15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f"
Jul 09 22:44:47.706276 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.706230    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f"} err="failed to get container status \"15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f\": rpc error: code = NotFound desc = could not find container \"15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f\": container with ID starting with 15a8200749ac8e7f079cb8d6fdda11216dbbef00890510c02ef9c1e3ffc42f7f not found: ID does not exist"
Jul 09 22:44:47.727326 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.727303    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b884dbd58-lzg26"]
Jul 09 22:44:47.735629 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:47.735600    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b884dbd58-lzg26"]
Jul 09 22:44:48.040016 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.039927    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"]
Jul 09 22:44:48.040192 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.040138    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9" podUID="f34dd198-cbdf-4407-8e71-d57ec65ec88e" containerName="manager" containerID="cri-o://5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f" gracePeriod=10
Jul 09 22:44:48.042048 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.042024    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:48.312948 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.312921    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:48.387119 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.387084    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc5kp\" (UniqueName: \"kubernetes.io/projected/f34dd198-cbdf-4407-8e71-d57ec65ec88e-kube-api-access-vc5kp\") pod \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") "
Jul 09 22:44:48.387271 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.387153    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34dd198-cbdf-4407-8e71-d57ec65ec88e-extensions-socket-volume\") pod \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\" (UID: \"f34dd198-cbdf-4407-8e71-d57ec65ec88e\") "
Jul 09 22:44:48.387502 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.387483    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34dd198-cbdf-4407-8e71-d57ec65ec88e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f34dd198-cbdf-4407-8e71-d57ec65ec88e" (UID: "f34dd198-cbdf-4407-8e71-d57ec65ec88e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:44:48.389209 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.389180    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34dd198-cbdf-4407-8e71-d57ec65ec88e-kube-api-access-vc5kp" (OuterVolumeSpecName: "kube-api-access-vc5kp") pod "f34dd198-cbdf-4407-8e71-d57ec65ec88e" (UID: "f34dd198-cbdf-4407-8e71-d57ec65ec88e"). InnerVolumeSpecName "kube-api-access-vc5kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:44:48.487741 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.487711    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc5kp\" (UniqueName: \"kubernetes.io/projected/f34dd198-cbdf-4407-8e71-d57ec65ec88e-kube-api-access-vc5kp\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:48.487741 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.487735    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f34dd198-cbdf-4407-8e71-d57ec65ec88e-extensions-socket-volume\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:44:48.703295 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.703261    2576 generic.go:356] "Generic (PLEG): container finished" podID="f34dd198-cbdf-4407-8e71-d57ec65ec88e" containerID="5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f" exitCode=0
Jul 09 22:44:48.703699 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.703319    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"
Jul 09 22:44:48.703699 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.703323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9" event={"ID":"f34dd198-cbdf-4407-8e71-d57ec65ec88e","Type":"ContainerDied","Data":"5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f"}
Jul 09 22:44:48.703699 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.703389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9" event={"ID":"f34dd198-cbdf-4407-8e71-d57ec65ec88e","Type":"ContainerDied","Data":"f336e166894af8582e71d174bda792f49e1fbb83f584f71a90d53db741524de3"}
Jul 09 22:44:48.703699 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.703410    2576 scope.go:117] "RemoveContainer" containerID="5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f"
Jul 09 22:44:48.711994 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.711976    2576 scope.go:117] "RemoveContainer" containerID="5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f"
Jul 09 22:44:48.712224 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:44:48.712204    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f\": container with ID starting with 5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f not found: ID does not exist" containerID="5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f"
Jul 09 22:44:48.712267 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.712234    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f"} err="failed to get container status \"5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f\": rpc error: code = NotFound desc = could not find container \"5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f\": container with ID starting with 5b54426ea748365eb94b4b5d1d2504d28d0fc183b49e8a006eb47ac2a351bc3f not found: ID does not exist"
Jul 09 22:44:48.733014 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.732981    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"]
Jul 09 22:44:48.734585 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:48.734568    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g7vg9"]
Jul 09 22:44:49.043761 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:49.043689    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" path="/var/lib/kubelet/pods/58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7/volumes"
Jul 09 22:44:49.044052 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:49.044040    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34dd198-cbdf-4407-8e71-d57ec65ec88e" path="/var/lib/kubelet/pods/f34dd198-cbdf-4407-8e71-d57ec65ec88e/volumes"
Jul 09 22:44:52.674215 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:44:52.674184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8jqfn"
Jul 09 22:45:04.660099 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.660070    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"]
Jul 09 22:45:04.660535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.660388    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" containerName="console"
Jul 09 22:45:04.660535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.660400    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" containerName="console"
Jul 09 22:45:04.660535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.660418    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34dd198-cbdf-4407-8e71-d57ec65ec88e" containerName="manager"
Jul 09 22:45:04.660535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.660423    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34dd198-cbdf-4407-8e71-d57ec65ec88e" containerName="manager"
Jul 09 22:45:04.660535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.660471    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34dd198-cbdf-4407-8e71-d57ec65ec88e" containerName="manager"
Jul 09 22:45:04.660535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.660482    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cb47dc-5cdf-4f81-9e68-cf6ef0adf1a7" containerName="console"
Jul 09 22:45:04.662420 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.662405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.667560 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.667536    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 22:45:04.667664 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.667536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rtz99\""
Jul 09 22:45:04.681119 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.681097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"]
Jul 09 22:45:04.822404 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3741202c-f808-4479-8181-2f4162f3262e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822404 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3741202c-f808-4479-8181-2f4162f3262e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822667 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822667 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3741202c-f808-4479-8181-2f4162f3262e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822667 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822667 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822667 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsrl8\" (UniqueName: \"kubernetes.io/projected/3741202c-f808-4479-8181-2f4162f3262e-kube-api-access-rsrl8\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822902 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.822902 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.822704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924170 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3741202c-f808-4479-8181-2f4162f3262e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924170 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3741202c-f808-4479-8181-2f4162f3262e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924170 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3741202c-f808-4479-8181-2f4162f3262e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924540 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924540 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrl8\" (UniqueName: \"kubernetes.io/projected/3741202c-f808-4479-8181-2f4162f3262e-kube-api-access-rsrl8\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924540 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924540 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924715 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924768 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924740    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.924934 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924906    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3741202c-f808-4479-8181-2f4162f3262e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.925074 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.925074 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.924980    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.926715 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.926694    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3741202c-f808-4479-8181-2f4162f3262e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.926853 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.926835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3741202c-f808-4479-8181-2f4162f3262e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.933205 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.933182    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3741202c-f808-4479-8181-2f4162f3262e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.933317 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.933265    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrl8\" (UniqueName: \"kubernetes.io/projected/3741202c-f808-4479-8181-2f4162f3262e-kube-api-access-rsrl8\") pod \"maas-default-gateway-openshift-default-56654dcf7-qnxtw\" (UID: \"3741202c-f808-4479-8181-2f4162f3262e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:04.971832 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:04.971803    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:05.132646 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:05.132621    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"]
Jul 09 22:45:05.134577 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:05.134542    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3741202c_f808_4479_8181_2f4162f3262e.slice/crio-4b4f0a9f96eb4cd931e10bb45fce901c5761b56488b7fb3eb98bea6cce4aa6b0 WatchSource:0}: Error finding container 4b4f0a9f96eb4cd931e10bb45fce901c5761b56488b7fb3eb98bea6cce4aa6b0: Status 404 returned error can't find the container with id 4b4f0a9f96eb4cd931e10bb45fce901c5761b56488b7fb3eb98bea6cce4aa6b0
Jul 09 22:45:05.781102 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:05.781068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" event={"ID":"3741202c-f808-4479-8181-2f4162f3262e","Type":"ContainerStarted","Data":"4b4f0a9f96eb4cd931e10bb45fce901c5761b56488b7fb3eb98bea6cce4aa6b0"}
Jul 09 22:45:09.676155 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:09.676115    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:45:09.676558 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:09.676203    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:45:09.676558 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:09.676249    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:45:09.802835 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:09.802799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" event={"ID":"3741202c-f808-4479-8181-2f4162f3262e","Type":"ContainerStarted","Data":"b3434adbd191ea8093b0fb814373763ece682ce27c94b3144445826c749b6227"}
Jul 09 22:45:09.828835 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:09.828772    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" podStartSLOduration=1.28958931 podStartE2EDuration="5.828756243s" totalImagesPullingTime="4.539166933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:09.82681784 +0000 UTC m=+751.308641225" watchObservedRunningTime="2026-07-09 22:45:09.828756243 +0000 UTC m=+751.310579628"
Jul 09 22:45:09.971925 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:09.971862    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:10.957011 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:10.956979    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"]
Jul 09 22:45:10.960479 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:10.960464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:10.963312 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:10.963295    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 22:45:10.974046 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:10.974029    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"]
Jul 09 22:45:10.976623 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:10.976604    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:11.046997 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.046971    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"]
Jul 09 22:45:11.081759 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.081728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/86f2f709-0350-44d3-9259-0a5d68c9f0f4-config-file\") pod \"limitador-limitador-64c94fd64f-9qrfm\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:11.081918 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.081841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjqqb\" (UniqueName: \"kubernetes.io/projected/86f2f709-0350-44d3-9259-0a5d68c9f0f4-kube-api-access-qjqqb\") pod \"limitador-limitador-64c94fd64f-9qrfm\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:11.182822 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.182796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjqqb\" (UniqueName: \"kubernetes.io/projected/86f2f709-0350-44d3-9259-0a5d68c9f0f4-kube-api-access-qjqqb\") pod \"limitador-limitador-64c94fd64f-9qrfm\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:11.183017 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.182869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/86f2f709-0350-44d3-9259-0a5d68c9f0f4-config-file\") pod \"limitador-limitador-64c94fd64f-9qrfm\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:11.183407 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.183390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/86f2f709-0350-44d3-9259-0a5d68c9f0f4-config-file\") pod \"limitador-limitador-64c94fd64f-9qrfm\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:11.191816 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.191795    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjqqb\" (UniqueName: \"kubernetes.io/projected/86f2f709-0350-44d3-9259-0a5d68c9f0f4-kube-api-access-qjqqb\") pod \"limitador-limitador-64c94fd64f-9qrfm\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:11.269882 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.269819    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:11.401659 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.401636    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"]
Jul 09 22:45:11.404251 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:11.404226    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f2f709_0350_44d3_9259_0a5d68c9f0f4.slice/crio-79fd7ddd787cad041c335a46cdee7cf9961725a65e475fd426296f6f8b79870b WatchSource:0}: Error finding container 79fd7ddd787cad041c335a46cdee7cf9961725a65e475fd426296f6f8b79870b: Status 404 returned error can't find the container with id 79fd7ddd787cad041c335a46cdee7cf9961725a65e475fd426296f6f8b79870b
Jul 09 22:45:11.790085 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.790054    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-65lns"]
Jul 09 22:45:11.795352 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.795325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-65lns"
Jul 09 22:45:11.799220 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.799200    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8rr2c\""
Jul 09 22:45:11.802633 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.802600    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-65lns"]
Jul 09 22:45:11.813155 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.813128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm" event={"ID":"86f2f709-0350-44d3-9259-0a5d68c9f0f4","Type":"ContainerStarted","Data":"79fd7ddd787cad041c335a46cdee7cf9961725a65e475fd426296f6f8b79870b"}
Jul 09 22:45:11.813343 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.813328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:11.814224 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.814209    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:45:11.889786 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.889746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dj6m\" (UniqueName: \"kubernetes.io/projected/57027efe-ab69-422b-af39-123810928b37-kube-api-access-8dj6m\") pod \"authorino-58cd955675-65lns\" (UID: \"57027efe-ab69-422b-af39-123810928b37\") " pod="kuadrant-system/authorino-58cd955675-65lns"
Jul 09 22:45:11.951713 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.951685    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4mhzj"]
Jul 09 22:45:11.954966 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.954950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4mhzj"
Jul 09 22:45:11.963140 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.963122    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4mhzj"]
Jul 09 22:45:11.990630 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.990607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dj6m\" (UniqueName: \"kubernetes.io/projected/57027efe-ab69-422b-af39-123810928b37-kube-api-access-8dj6m\") pod \"authorino-58cd955675-65lns\" (UID: \"57027efe-ab69-422b-af39-123810928b37\") " pod="kuadrant-system/authorino-58cd955675-65lns"
Jul 09 22:45:11.999947 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:11.999928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dj6m\" (UniqueName: \"kubernetes.io/projected/57027efe-ab69-422b-af39-123810928b37-kube-api-access-8dj6m\") pod \"authorino-58cd955675-65lns\" (UID: \"57027efe-ab69-422b-af39-123810928b37\") " pod="kuadrant-system/authorino-58cd955675-65lns"
Jul 09 22:45:12.091353 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.091325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/4c8f5701-fe47-490b-a150-459a7aa35911-kube-api-access-tgbdx\") pod \"authorino-75d556bd77-4mhzj\" (UID: \"4c8f5701-fe47-490b-a150-459a7aa35911\") " pod="kuadrant-system/authorino-75d556bd77-4mhzj"
Jul 09 22:45:12.107021 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.106988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-65lns"
Jul 09 22:45:12.192743 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.192708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/4c8f5701-fe47-490b-a150-459a7aa35911-kube-api-access-tgbdx\") pod \"authorino-75d556bd77-4mhzj\" (UID: \"4c8f5701-fe47-490b-a150-459a7aa35911\") " pod="kuadrant-system/authorino-75d556bd77-4mhzj"
Jul 09 22:45:12.203237 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.203204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/4c8f5701-fe47-490b-a150-459a7aa35911-kube-api-access-tgbdx\") pod \"authorino-75d556bd77-4mhzj\" (UID: \"4c8f5701-fe47-490b-a150-459a7aa35911\") " pod="kuadrant-system/authorino-75d556bd77-4mhzj"
Jul 09 22:45:12.264282 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.264041    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4mhzj"
Jul 09 22:45:12.285156 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.284741    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-65lns"]
Jul 09 22:45:12.290187 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:12.290156    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57027efe_ab69_422b_af39_123810928b37.slice/crio-9f28b204030878f0a4495f2ba01ef5d1525ba15f0d526259ef2fa6ff5683ef7f WatchSource:0}: Error finding container 9f28b204030878f0a4495f2ba01ef5d1525ba15f0d526259ef2fa6ff5683ef7f: Status 404 returned error can't find the container with id 9f28b204030878f0a4495f2ba01ef5d1525ba15f0d526259ef2fa6ff5683ef7f
Jul 09 22:45:12.463966 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.463932    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4mhzj"]
Jul 09 22:45:12.468086 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:12.468040    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c8f5701_fe47_490b_a150_459a7aa35911.slice/crio-5cccf1e928c41d1ab50a0991f7e9324d11888553f72d511c28795baaf7605264 WatchSource:0}: Error finding container 5cccf1e928c41d1ab50a0991f7e9324d11888553f72d511c28795baaf7605264: Status 404 returned error can't find the container with id 5cccf1e928c41d1ab50a0991f7e9324d11888553f72d511c28795baaf7605264
Jul 09 22:45:12.820537 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.820503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4mhzj" event={"ID":"4c8f5701-fe47-490b-a150-459a7aa35911","Type":"ContainerStarted","Data":"5cccf1e928c41d1ab50a0991f7e9324d11888553f72d511c28795baaf7605264"}
Jul 09 22:45:12.822060 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:12.822026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-65lns" event={"ID":"57027efe-ab69-422b-af39-123810928b37","Type":"ContainerStarted","Data":"9f28b204030878f0a4495f2ba01ef5d1525ba15f0d526259ef2fa6ff5683ef7f"}
Jul 09 22:45:16.846702 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.846661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm" event={"ID":"86f2f709-0350-44d3-9259-0a5d68c9f0f4","Type":"ContainerStarted","Data":"24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210"}
Jul 09 22:45:16.847182 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.846750    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:16.848160 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.848136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4mhzj" event={"ID":"4c8f5701-fe47-490b-a150-459a7aa35911","Type":"ContainerStarted","Data":"64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1"}
Jul 09 22:45:16.849410 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.849384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-65lns" event={"ID":"57027efe-ab69-422b-af39-123810928b37","Type":"ContainerStarted","Data":"19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1"}
Jul 09 22:45:16.884208 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.884167    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm" podStartSLOduration=2.154120423 podStartE2EDuration="6.884153199s" totalImagesPullingTime="4.730032776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:16.88396976 +0000 UTC m=+758.365793145" watchObservedRunningTime="2026-07-09 22:45:16.884153199 +0000 UTC m=+758.365976583"
Jul 09 22:45:16.910720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.910682    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4mhzj" podStartSLOduration=2.237397009 podStartE2EDuration="5.910670523s" totalImagesPullingTime="3.673273514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:16.91024104 +0000 UTC m=+758.392064423" watchObservedRunningTime="2026-07-09 22:45:16.910670523 +0000 UTC m=+758.392493908"
Jul 09 22:45:16.937324 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.937280    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-65lns" podStartSLOduration=2.140407107 podStartE2EDuration="5.93726698s" totalImagesPullingTime="3.796859873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:16.935102938 +0000 UTC m=+758.416926315" watchObservedRunningTime="2026-07-09 22:45:16.93726698 +0000 UTC m=+758.419090395"
Jul 09 22:45:16.950598 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:16.950562    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-65lns"]
Jul 09 22:45:18.858793 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:18.858746    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-65lns" podUID="57027efe-ab69-422b-af39-123810928b37" containerName="authorino" containerID="cri-o://19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1" gracePeriod=30
Jul 09 22:45:19.104120 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.104089    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-65lns"
Jul 09 22:45:19.153613 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.153544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dj6m\" (UniqueName: \"kubernetes.io/projected/57027efe-ab69-422b-af39-123810928b37-kube-api-access-8dj6m\") pod \"57027efe-ab69-422b-af39-123810928b37\" (UID: \"57027efe-ab69-422b-af39-123810928b37\") "
Jul 09 22:45:19.155376 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.155351    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57027efe-ab69-422b-af39-123810928b37-kube-api-access-8dj6m" (OuterVolumeSpecName: "kube-api-access-8dj6m") pod "57027efe-ab69-422b-af39-123810928b37" (UID: "57027efe-ab69-422b-af39-123810928b37"). InnerVolumeSpecName "kube-api-access-8dj6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:19.254830 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.254805    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dj6m\" (UniqueName: \"kubernetes.io/projected/57027efe-ab69-422b-af39-123810928b37-kube-api-access-8dj6m\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:45:19.866085 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.866055    2576 generic.go:356] "Generic (PLEG): container finished" podID="57027efe-ab69-422b-af39-123810928b37" containerID="19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1" exitCode=0
Jul 09 22:45:19.866472 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.866090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-65lns" event={"ID":"57027efe-ab69-422b-af39-123810928b37","Type":"ContainerDied","Data":"19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1"}
Jul 09 22:45:19.866472 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.866121    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-65lns"
Jul 09 22:45:19.866472 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.866137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-65lns" event={"ID":"57027efe-ab69-422b-af39-123810928b37","Type":"ContainerDied","Data":"9f28b204030878f0a4495f2ba01ef5d1525ba15f0d526259ef2fa6ff5683ef7f"}
Jul 09 22:45:19.866472 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.866155    2576 scope.go:117] "RemoveContainer" containerID="19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1"
Jul 09 22:45:19.875096 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.875080    2576 scope.go:117] "RemoveContainer" containerID="19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1"
Jul 09 22:45:19.875407 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:45:19.875387    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1\": container with ID starting with 19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1 not found: ID does not exist" containerID="19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1"
Jul 09 22:45:19.875463 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.875415    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1"} err="failed to get container status \"19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1\": rpc error: code = NotFound desc = could not find container \"19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1\": container with ID starting with 19df1fc0e85b2350d7b93747e380e7dc16fd122d3b744fbcd7c7ed30b7d0a6c1 not found: ID does not exist"
Jul 09 22:45:19.887929 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.887905    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-65lns"]
Jul 09 22:45:19.892495 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:19.892474    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-65lns"]
Jul 09 22:45:21.043163 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:21.043132    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57027efe-ab69-422b-af39-123810928b37" path="/var/lib/kubelet/pods/57027efe-ab69-422b-af39-123810928b37/volumes"
Jul 09 22:45:26.179563 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.179528    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"]
Jul 09 22:45:26.180026 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.179769    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm" podUID="86f2f709-0350-44d3-9259-0a5d68c9f0f4" containerName="limitador" containerID="cri-o://24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210" gracePeriod=30
Jul 09 22:45:26.180444 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.180348    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:26.718146 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.718123    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:26.806254 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.806235    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/86f2f709-0350-44d3-9259-0a5d68c9f0f4-config-file\") pod \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") "
Jul 09 22:45:26.806393 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.806294    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjqqb\" (UniqueName: \"kubernetes.io/projected/86f2f709-0350-44d3-9259-0a5d68c9f0f4-kube-api-access-qjqqb\") pod \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\" (UID: \"86f2f709-0350-44d3-9259-0a5d68c9f0f4\") "
Jul 09 22:45:26.806621 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.806598    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f2f709-0350-44d3-9259-0a5d68c9f0f4-config-file" (OuterVolumeSpecName: "config-file") pod "86f2f709-0350-44d3-9259-0a5d68c9f0f4" (UID: "86f2f709-0350-44d3-9259-0a5d68c9f0f4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:45:26.808373 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.808350    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f2f709-0350-44d3-9259-0a5d68c9f0f4-kube-api-access-qjqqb" (OuterVolumeSpecName: "kube-api-access-qjqqb") pod "86f2f709-0350-44d3-9259-0a5d68c9f0f4" (UID: "86f2f709-0350-44d3-9259-0a5d68c9f0f4"). InnerVolumeSpecName "kube-api-access-qjqqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:26.899215 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.899182    2576 generic.go:356] "Generic (PLEG): container finished" podID="86f2f709-0350-44d3-9259-0a5d68c9f0f4" containerID="24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210" exitCode=0
Jul 09 22:45:26.899344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.899222    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"
Jul 09 22:45:26.899344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.899232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm" event={"ID":"86f2f709-0350-44d3-9259-0a5d68c9f0f4","Type":"ContainerDied","Data":"24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210"}
Jul 09 22:45:26.899344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.899281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9qrfm" event={"ID":"86f2f709-0350-44d3-9259-0a5d68c9f0f4","Type":"ContainerDied","Data":"79fd7ddd787cad041c335a46cdee7cf9961725a65e475fd426296f6f8b79870b"}
Jul 09 22:45:26.899344 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.899309    2576 scope.go:117] "RemoveContainer" containerID="24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210"
Jul 09 22:45:26.906802 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.906764    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/86f2f709-0350-44d3-9259-0a5d68c9f0f4-config-file\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:45:26.906911 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.906804    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjqqb\" (UniqueName: \"kubernetes.io/projected/86f2f709-0350-44d3-9259-0a5d68c9f0f4-kube-api-access-qjqqb\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:45:26.907541 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.907525    2576 scope.go:117] "RemoveContainer" containerID="24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210"
Jul 09 22:45:26.907800 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:45:26.907754    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210\": container with ID starting with 24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210 not found: ID does not exist" containerID="24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210"
Jul 09 22:45:26.907867 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.907798    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210"} err="failed to get container status \"24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210\": rpc error: code = NotFound desc = could not find container \"24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210\": container with ID starting with 24ee4bd78feb289b6d27d0817b008b451dcd5181608022b9e0c586ac86962210 not found: ID does not exist"
Jul 09 22:45:26.923055 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.923032    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"]
Jul 09 22:45:26.927849 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:26.927826    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9qrfm"]
Jul 09 22:45:27.042759 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:27.042734    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86f2f709-0350-44d3-9259-0a5d68c9f0f4" path="/var/lib/kubelet/pods/86f2f709-0350-44d3-9259-0a5d68c9f0f4/volumes"
Jul 09 22:45:32.874039 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.874005    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"]
Jul 09 22:45:32.874424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.874368    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f2f709-0350-44d3-9259-0a5d68c9f0f4" containerName="limitador"
Jul 09 22:45:32.874424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.874381    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f2f709-0350-44d3-9259-0a5d68c9f0f4" containerName="limitador"
Jul 09 22:45:32.874424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.874390    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57027efe-ab69-422b-af39-123810928b37" containerName="authorino"
Jul 09 22:45:32.874424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.874396    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57027efe-ab69-422b-af39-123810928b37" containerName="authorino"
Jul 09 22:45:32.874563 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.874445    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f2f709-0350-44d3-9259-0a5d68c9f0f4" containerName="limitador"
Jul 09 22:45:32.874563 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.874456    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="57027efe-ab69-422b-af39-123810928b37" containerName="authorino"
Jul 09 22:45:32.878763 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.878740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:32.894431 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.894409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4gghk\""
Jul 09 22:45:32.894574 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.894452    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 22:45:32.894685 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.894670    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 22:45:32.895247 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.895222    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"]
Jul 09 22:45:32.895532 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.895519    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 22:45:32.953149 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.953119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/06e52312-6e59-4ecf-bb5f-ba792525d355-data\") pod \"postgres-69fb4594cf-g76s2\" (UID: \"06e52312-6e59-4ecf-bb5f-ba792525d355\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:32.953149 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:32.953151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrjdz\" (UniqueName: \"kubernetes.io/projected/06e52312-6e59-4ecf-bb5f-ba792525d355-kube-api-access-lrjdz\") pod \"postgres-69fb4594cf-g76s2\" (UID: \"06e52312-6e59-4ecf-bb5f-ba792525d355\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:33.053849 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:33.053824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/06e52312-6e59-4ecf-bb5f-ba792525d355-data\") pod \"postgres-69fb4594cf-g76s2\" (UID: \"06e52312-6e59-4ecf-bb5f-ba792525d355\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:33.054026 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:33.053862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrjdz\" (UniqueName: \"kubernetes.io/projected/06e52312-6e59-4ecf-bb5f-ba792525d355-kube-api-access-lrjdz\") pod \"postgres-69fb4594cf-g76s2\" (UID: \"06e52312-6e59-4ecf-bb5f-ba792525d355\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:33.054165 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:33.054146    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/06e52312-6e59-4ecf-bb5f-ba792525d355-data\") pod \"postgres-69fb4594cf-g76s2\" (UID: \"06e52312-6e59-4ecf-bb5f-ba792525d355\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:33.062977 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:33.062952    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrjdz\" (UniqueName: \"kubernetes.io/projected/06e52312-6e59-4ecf-bb5f-ba792525d355-kube-api-access-lrjdz\") pod \"postgres-69fb4594cf-g76s2\" (UID: \"06e52312-6e59-4ecf-bb5f-ba792525d355\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:33.196495 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:33.196434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:33.326174 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:33.326150    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"]
Jul 09 22:45:33.327632 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:33.327606    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e52312_6e59_4ecf_bb5f_ba792525d355.slice/crio-67882c6ec802df1ceedbd61e9f664b88741900fd57ee7268520c94a5b147153b WatchSource:0}: Error finding container 67882c6ec802df1ceedbd61e9f664b88741900fd57ee7268520c94a5b147153b: Status 404 returned error can't find the container with id 67882c6ec802df1ceedbd61e9f664b88741900fd57ee7268520c94a5b147153b
Jul 09 22:45:33.935802 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:33.935752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2" event={"ID":"06e52312-6e59-4ecf-bb5f-ba792525d355","Type":"ContainerStarted","Data":"67882c6ec802df1ceedbd61e9f664b88741900fd57ee7268520c94a5b147153b"}
Jul 09 22:45:38.963499 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:38.963462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2" event={"ID":"06e52312-6e59-4ecf-bb5f-ba792525d355","Type":"ContainerStarted","Data":"917f9fe58878ed81f1157d06b56f0a57c8018688163e92b53a7430b7775a71aa"}
Jul 09 22:45:38.963999 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:38.963621    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:38.982943 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:38.982905    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2" podStartSLOduration=2.191450834 podStartE2EDuration="6.982891077s" totalImagesPullingTime="4.791440243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:38.981264513 +0000 UTC m=+780.463087898" watchObservedRunningTime="2026-07-09 22:45:38.982891077 +0000 UTC m=+780.464714467"
Jul 09 22:45:44.999827 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:44.999801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g76s2"
Jul 09 22:45:45.625446 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.625416    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6n94"]
Jul 09 22:45:45.634200 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.634174    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6n94"
Jul 09 22:45:45.645998 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.645970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6n94"]
Jul 09 22:45:45.770673 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.770639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctp99\" (UniqueName: \"kubernetes.io/projected/a9348847-851f-4a8c-a79e-09242538a8b2-kube-api-access-ctp99\") pod \"authorino-5d4b67c446-k6n94\" (UID: \"a9348847-851f-4a8c-a79e-09242538a8b2\") " pod="kuadrant-system/authorino-5d4b67c446-k6n94"
Jul 09 22:45:45.871376 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.871342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctp99\" (UniqueName: \"kubernetes.io/projected/a9348847-851f-4a8c-a79e-09242538a8b2-kube-api-access-ctp99\") pod \"authorino-5d4b67c446-k6n94\" (UID: \"a9348847-851f-4a8c-a79e-09242538a8b2\") " pod="kuadrant-system/authorino-5d4b67c446-k6n94"
Jul 09 22:45:45.882464 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.882393    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctp99\" (UniqueName: \"kubernetes.io/projected/a9348847-851f-4a8c-a79e-09242538a8b2-kube-api-access-ctp99\") pod \"authorino-5d4b67c446-k6n94\" (UID: \"a9348847-851f-4a8c-a79e-09242538a8b2\") " pod="kuadrant-system/authorino-5d4b67c446-k6n94"
Jul 09 22:45:45.914569 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.914530    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6n94"]
Jul 09 22:45:45.914857 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.914842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6n94"
Jul 09 22:45:45.946813 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.946788    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b485594c-ttf6c"]
Jul 09 22:45:45.956512 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.956490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:45.960135 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.960117    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 22:45:45.963160 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:45.963139    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b485594c-ttf6c"]
Jul 09 22:45:46.073592 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.073563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-tls-cert\") pod \"authorino-6b485594c-ttf6c\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") " pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:46.073967 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.073723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gfwx\" (UniqueName: \"kubernetes.io/projected/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-kube-api-access-7gfwx\") pod \"authorino-6b485594c-ttf6c\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") " pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:46.076965 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.076944    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6n94"]
Jul 09 22:45:46.078878 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:46.078855    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9348847_851f_4a8c_a79e_09242538a8b2.slice/crio-32f36fba0ad2b07ab4c9d1ec061c64b665111c9b6f97c57337e34ff427f7c8c6 WatchSource:0}: Error finding container 32f36fba0ad2b07ab4c9d1ec061c64b665111c9b6f97c57337e34ff427f7c8c6: Status 404 returned error can't find the container with id 32f36fba0ad2b07ab4c9d1ec061c64b665111c9b6f97c57337e34ff427f7c8c6
Jul 09 22:45:46.174547 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.174459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gfwx\" (UniqueName: \"kubernetes.io/projected/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-kube-api-access-7gfwx\") pod \"authorino-6b485594c-ttf6c\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") " pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:46.174547 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.174504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-tls-cert\") pod \"authorino-6b485594c-ttf6c\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") " pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:46.176844 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.176823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-tls-cert\") pod \"authorino-6b485594c-ttf6c\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") " pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:46.183673 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.183645    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gfwx\" (UniqueName: \"kubernetes.io/projected/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-kube-api-access-7gfwx\") pod \"authorino-6b485594c-ttf6c\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") " pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:46.273297 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.273268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:45:46.437849 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:46.437826    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b485594c-ttf6c"]
Jul 09 22:45:46.440011 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:46.439966    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16ef9808_1eb3_4c8e_b005_0f1251e7fe9a.slice/crio-06ce92e3c7855d3e48d2bd61924ce83bd4e7b46dc8664cdbff1a5ee583e9e3c5 WatchSource:0}: Error finding container 06ce92e3c7855d3e48d2bd61924ce83bd4e7b46dc8664cdbff1a5ee583e9e3c5: Status 404 returned error can't find the container with id 06ce92e3c7855d3e48d2bd61924ce83bd4e7b46dc8664cdbff1a5ee583e9e3c5
Jul 09 22:45:47.003628 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.003595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b485594c-ttf6c" event={"ID":"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a","Type":"ContainerStarted","Data":"06ce92e3c7855d3e48d2bd61924ce83bd4e7b46dc8664cdbff1a5ee583e9e3c5"}
Jul 09 22:45:47.005111 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.005088    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6n94" event={"ID":"a9348847-851f-4a8c-a79e-09242538a8b2","Type":"ContainerStarted","Data":"6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75"}
Jul 09 22:45:47.005323 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.005117    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6n94" event={"ID":"a9348847-851f-4a8c-a79e-09242538a8b2","Type":"ContainerStarted","Data":"32f36fba0ad2b07ab4c9d1ec061c64b665111c9b6f97c57337e34ff427f7c8c6"}
Jul 09 22:45:47.005323 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.005165    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-k6n94" podUID="a9348847-851f-4a8c-a79e-09242538a8b2" containerName="authorino" containerID="cri-o://6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75" gracePeriod=30
Jul 09 22:45:47.034705 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.034663    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-k6n94" podStartSLOduration=1.353670644 podStartE2EDuration="2.034647653s" totalImagesPullingTime="680.977009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:47.03413056 +0000 UTC m=+788.515953950" watchObservedRunningTime="2026-07-09 22:45:47.034647653 +0000 UTC m=+788.516471038"
Jul 09 22:45:47.291476 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.291412    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6n94"
Jul 09 22:45:47.386125 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.386098    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctp99\" (UniqueName: \"kubernetes.io/projected/a9348847-851f-4a8c-a79e-09242538a8b2-kube-api-access-ctp99\") pod \"a9348847-851f-4a8c-a79e-09242538a8b2\" (UID: \"a9348847-851f-4a8c-a79e-09242538a8b2\") "
Jul 09 22:45:47.387993 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.387971    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9348847-851f-4a8c-a79e-09242538a8b2-kube-api-access-ctp99" (OuterVolumeSpecName: "kube-api-access-ctp99") pod "a9348847-851f-4a8c-a79e-09242538a8b2" (UID: "a9348847-851f-4a8c-a79e-09242538a8b2"). InnerVolumeSpecName "kube-api-access-ctp99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:47.487306 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:47.487277    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctp99\" (UniqueName: \"kubernetes.io/projected/a9348847-851f-4a8c-a79e-09242538a8b2-kube-api-access-ctp99\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:45:48.010578 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.010545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b485594c-ttf6c" event={"ID":"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a","Type":"ContainerStarted","Data":"60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614"}
Jul 09 22:45:48.011801 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.011762    2576 generic.go:356] "Generic (PLEG): container finished" podID="a9348847-851f-4a8c-a79e-09242538a8b2" containerID="6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75" exitCode=0
Jul 09 22:45:48.011924 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.011815    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k6n94"
Jul 09 22:45:48.011924 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.011822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6n94" event={"ID":"a9348847-851f-4a8c-a79e-09242538a8b2","Type":"ContainerDied","Data":"6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75"}
Jul 09 22:45:48.011924 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.011854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k6n94" event={"ID":"a9348847-851f-4a8c-a79e-09242538a8b2","Type":"ContainerDied","Data":"32f36fba0ad2b07ab4c9d1ec061c64b665111c9b6f97c57337e34ff427f7c8c6"}
Jul 09 22:45:48.011924 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.011876    2576 scope.go:117] "RemoveContainer" containerID="6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75"
Jul 09 22:45:48.020311 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.020291    2576 scope.go:117] "RemoveContainer" containerID="6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75"
Jul 09 22:45:48.020577 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:45:48.020560    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75\": container with ID starting with 6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75 not found: ID does not exist" containerID="6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75"
Jul 09 22:45:48.020623 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.020585    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75"} err="failed to get container status \"6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75\": rpc error: code = NotFound desc = could not find container \"6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75\": container with ID starting with 6bcc33ab4d17846f1b61be027d8ccf9e72f4ce96f888b86ef6367a126e933e75 not found: ID does not exist"
Jul 09 22:45:48.029658 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.029622    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b485594c-ttf6c" podStartSLOduration=2.456454291 podStartE2EDuration="3.029608083s" totalImagesPullingTime="573.153792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:48.027007566 +0000 UTC m=+789.508830949" watchObservedRunningTime="2026-07-09 22:45:48.029608083 +0000 UTC m=+789.511431459"
Jul 09 22:45:48.043516 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.043492    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6n94"]
Jul 09 22:45:48.050051 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.050027    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k6n94"]
Jul 09 22:45:48.059366 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.059338    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4mhzj"]
Jul 09 22:45:48.059566 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.059521    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4mhzj" podUID="4c8f5701-fe47-490b-a150-459a7aa35911" containerName="authorino" containerID="cri-o://64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1" gracePeriod=30
Jul 09 22:45:48.310665 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.310638    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4mhzj"
Jul 09 22:45:48.396118 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.396090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/4c8f5701-fe47-490b-a150-459a7aa35911-kube-api-access-tgbdx\") pod \"4c8f5701-fe47-490b-a150-459a7aa35911\" (UID: \"4c8f5701-fe47-490b-a150-459a7aa35911\") "
Jul 09 22:45:48.398053 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.398023    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c8f5701-fe47-490b-a150-459a7aa35911-kube-api-access-tgbdx" (OuterVolumeSpecName: "kube-api-access-tgbdx") pod "4c8f5701-fe47-490b-a150-459a7aa35911" (UID: "4c8f5701-fe47-490b-a150-459a7aa35911"). InnerVolumeSpecName "kube-api-access-tgbdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:45:48.497030 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:48.496963    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/4c8f5701-fe47-490b-a150-459a7aa35911-kube-api-access-tgbdx\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:45:49.018505 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.018470    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c8f5701-fe47-490b-a150-459a7aa35911" containerID="64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1" exitCode=0
Jul 09 22:45:49.018678 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.018514    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4mhzj"
Jul 09 22:45:49.018678 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.018558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4mhzj" event={"ID":"4c8f5701-fe47-490b-a150-459a7aa35911","Type":"ContainerDied","Data":"64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1"}
Jul 09 22:45:49.018678 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.018602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4mhzj" event={"ID":"4c8f5701-fe47-490b-a150-459a7aa35911","Type":"ContainerDied","Data":"5cccf1e928c41d1ab50a0991f7e9324d11888553f72d511c28795baaf7605264"}
Jul 09 22:45:49.018678 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.018624    2576 scope.go:117] "RemoveContainer" containerID="64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1"
Jul 09 22:45:49.027724 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.027708    2576 scope.go:117] "RemoveContainer" containerID="64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1"
Jul 09 22:45:49.028009 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:45:49.027992    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1\": container with ID starting with 64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1 not found: ID does not exist" containerID="64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1"
Jul 09 22:45:49.028066 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.028017    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1"} err="failed to get container status \"64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1\": rpc error: code = NotFound desc = could not find container \"64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1\": container with ID starting with 64e179d3cb479a42a38d232037794bc0b5bc8db263ce1abf148c5042de2bd9c1 not found: ID does not exist"
Jul 09 22:45:49.045296 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.045275    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9348847-851f-4a8c-a79e-09242538a8b2" path="/var/lib/kubelet/pods/a9348847-851f-4a8c-a79e-09242538a8b2/volumes"
Jul 09 22:45:49.045515 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.045502    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4mhzj"]
Jul 09 22:45:49.045554 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:49.045525    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4mhzj"]
Jul 09 22:45:51.043191 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:51.043160    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c8f5701-fe47-490b-a150-459a7aa35911" path="/var/lib/kubelet/pods/4c8f5701-fe47-490b-a150-459a7aa35911/volumes"
Jul 09 22:45:53.686573 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.686541    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f9f7f5566-9vtfv"]
Jul 09 22:45:53.687006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.686875    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8f5701-fe47-490b-a150-459a7aa35911" containerName="authorino"
Jul 09 22:45:53.687006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.686886    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8f5701-fe47-490b-a150-459a7aa35911" containerName="authorino"
Jul 09 22:45:53.687006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.686901    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9348847-851f-4a8c-a79e-09242538a8b2" containerName="authorino"
Jul 09 22:45:53.687006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.686907    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9348847-851f-4a8c-a79e-09242538a8b2" containerName="authorino"
Jul 09 22:45:53.687006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.686981    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9348847-851f-4a8c-a79e-09242538a8b2" containerName="authorino"
Jul 09 22:45:53.687006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.686996    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c8f5701-fe47-490b-a150-459a7aa35911" containerName="authorino"
Jul 09 22:45:53.690470 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.690450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:53.693388 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.693365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wdzbn\""
Jul 09 22:45:53.693641 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.693622    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 22:45:53.695118 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.695104    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 22:45:53.703133 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.703111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f9f7f5566-9vtfv"]
Jul 09 22:45:53.746521 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.746478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3696f8f0-c692-4b1e-8f20-a22a24361f83-webhook-cert\") pod \"maas-controller-7f9f7f5566-9vtfv\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") " pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:53.746681 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.746537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg29\" (UniqueName: \"kubernetes.io/projected/3696f8f0-c692-4b1e-8f20-a22a24361f83-kube-api-access-6pg29\") pod \"maas-controller-7f9f7f5566-9vtfv\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") " pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:53.847729 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.847696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3696f8f0-c692-4b1e-8f20-a22a24361f83-webhook-cert\") pod \"maas-controller-7f9f7f5566-9vtfv\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") " pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:53.847729 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.847733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg29\" (UniqueName: \"kubernetes.io/projected/3696f8f0-c692-4b1e-8f20-a22a24361f83-kube-api-access-6pg29\") pod \"maas-controller-7f9f7f5566-9vtfv\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") " pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:53.850179 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.850158    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3696f8f0-c692-4b1e-8f20-a22a24361f83-webhook-cert\") pod \"maas-controller-7f9f7f5566-9vtfv\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") " pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:53.858811 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.858789    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg29\" (UniqueName: \"kubernetes.io/projected/3696f8f0-c692-4b1e-8f20-a22a24361f83-kube-api-access-6pg29\") pod \"maas-controller-7f9f7f5566-9vtfv\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") " pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:53.999979 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:53.999892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:54.126908 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:54.126886    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f9f7f5566-9vtfv"]
Jul 09 22:45:54.128319 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:45:54.128294    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3696f8f0_c692_4b1e_8f20_a22a24361f83.slice/crio-1e31f73f7fd70bddd3d71b9f2f36056eef90f09a47b20d8ca23ce5f9266b9e6b WatchSource:0}: Error finding container 1e31f73f7fd70bddd3d71b9f2f36056eef90f09a47b20d8ca23ce5f9266b9e6b: Status 404 returned error can't find the container with id 1e31f73f7fd70bddd3d71b9f2f36056eef90f09a47b20d8ca23ce5f9266b9e6b
Jul 09 22:45:55.048734 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:55.048699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv" event={"ID":"3696f8f0-c692-4b1e-8f20-a22a24361f83","Type":"ContainerStarted","Data":"1e31f73f7fd70bddd3d71b9f2f36056eef90f09a47b20d8ca23ce5f9266b9e6b"}
Jul 09 22:45:56.058031 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:56.057984    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv" event={"ID":"3696f8f0-c692-4b1e-8f20-a22a24361f83","Type":"ContainerStarted","Data":"dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0"}
Jul 09 22:45:56.058439 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:56.058074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:45:56.077496 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:45:56.077458    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv" podStartSLOduration=1.236283724 podStartE2EDuration="3.077444622s" totalImagesPullingTime="1.841160898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:45:56.077200868 +0000 UTC m=+797.559024278" watchObservedRunningTime="2026-07-09 22:45:56.077444622 +0000 UTC m=+797.559268009"
Jul 09 22:46:07.068460 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:07.068390    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:46:29.079923 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.079894    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rqd9d"]
Jul 09 22:46:29.105096 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.105071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rqd9d"]
Jul 09 22:46:29.105238 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.105170    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.108220 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.108198    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 22:46:29.108613 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.108598    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-68dfr\""
Jul 09 22:46:29.109489 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.109470    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ghxxh"]
Jul 09 22:46:29.112838 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.112815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.124945 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.124920    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ghxxh"]
Jul 09 22:46:29.164952 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.164921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6jwf\" (UniqueName: \"kubernetes.io/projected/e662ddce-015f-4fee-8b69-ac6dd2066c3b-kube-api-access-b6jwf\") pod \"payload-processing-58f86c7798-ghxxh\" (UID: \"e662ddce-015f-4fee-8b69-ac6dd2066c3b\") " pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.165129 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.164970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e662ddce-015f-4fee-8b69-ac6dd2066c3b-plugins-config-volume\") pod \"payload-processing-58f86c7798-ghxxh\" (UID: \"e662ddce-015f-4fee-8b69-ac6dd2066c3b\") " pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.165129 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.165115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnh2\" (UniqueName: \"kubernetes.io/projected/6d748cd9-c43f-4de4-a8e5-c4e946f50017-kube-api-access-7qnh2\") pod \"payload-pre-processing-7964457696-rqd9d\" (UID: \"6d748cd9-c43f-4de4-a8e5-c4e946f50017\") " pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.165323 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.165297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d748cd9-c43f-4de4-a8e5-c4e946f50017-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rqd9d\" (UID: \"6d748cd9-c43f-4de4-a8e5-c4e946f50017\") " pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.266202 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.266165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d748cd9-c43f-4de4-a8e5-c4e946f50017-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rqd9d\" (UID: \"6d748cd9-c43f-4de4-a8e5-c4e946f50017\") " pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.266380 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.266227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6jwf\" (UniqueName: \"kubernetes.io/projected/e662ddce-015f-4fee-8b69-ac6dd2066c3b-kube-api-access-b6jwf\") pod \"payload-processing-58f86c7798-ghxxh\" (UID: \"e662ddce-015f-4fee-8b69-ac6dd2066c3b\") " pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.266380 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.266278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e662ddce-015f-4fee-8b69-ac6dd2066c3b-plugins-config-volume\") pod \"payload-processing-58f86c7798-ghxxh\" (UID: \"e662ddce-015f-4fee-8b69-ac6dd2066c3b\") " pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.266380 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.266317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnh2\" (UniqueName: \"kubernetes.io/projected/6d748cd9-c43f-4de4-a8e5-c4e946f50017-kube-api-access-7qnh2\") pod \"payload-pre-processing-7964457696-rqd9d\" (UID: \"6d748cd9-c43f-4de4-a8e5-c4e946f50017\") " pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.266984 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.266961    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d748cd9-c43f-4de4-a8e5-c4e946f50017-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rqd9d\" (UID: \"6d748cd9-c43f-4de4-a8e5-c4e946f50017\") " pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.267102 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.267057    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e662ddce-015f-4fee-8b69-ac6dd2066c3b-plugins-config-volume\") pod \"payload-processing-58f86c7798-ghxxh\" (UID: \"e662ddce-015f-4fee-8b69-ac6dd2066c3b\") " pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.276484 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.276459    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6jwf\" (UniqueName: \"kubernetes.io/projected/e662ddce-015f-4fee-8b69-ac6dd2066c3b-kube-api-access-b6jwf\") pod \"payload-processing-58f86c7798-ghxxh\" (UID: \"e662ddce-015f-4fee-8b69-ac6dd2066c3b\") " pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.277188 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.277158    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnh2\" (UniqueName: \"kubernetes.io/projected/6d748cd9-c43f-4de4-a8e5-c4e946f50017-kube-api-access-7qnh2\") pod \"payload-pre-processing-7964457696-rqd9d\" (UID: \"6d748cd9-c43f-4de4-a8e5-c4e946f50017\") " pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.417532 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.417446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:29.426724 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.426706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:29.580072 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.580041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rqd9d"]
Jul 09 22:46:29.581433 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:46:29.581406    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d748cd9_c43f_4de4_a8e5_c4e946f50017.slice/crio-3e8b7215d8218d7dd96fc167f14f9cebba925a2da98e7be5f233d018032c4c6d WatchSource:0}: Error finding container 3e8b7215d8218d7dd96fc167f14f9cebba925a2da98e7be5f233d018032c4c6d: Status 404 returned error can't find the container with id 3e8b7215d8218d7dd96fc167f14f9cebba925a2da98e7be5f233d018032c4c6d
Jul 09 22:46:29.611821 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:29.611799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ghxxh"]
Jul 09 22:46:29.613980 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:46:29.613956    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode662ddce_015f_4fee_8b69_ac6dd2066c3b.slice/crio-1fe92e9f331deb460c0ceb55887fa833d14e51f6b02052f1996b7bf1fbdba13c WatchSource:0}: Error finding container 1fe92e9f331deb460c0ceb55887fa833d14e51f6b02052f1996b7bf1fbdba13c: Status 404 returned error can't find the container with id 1fe92e9f331deb460c0ceb55887fa833d14e51f6b02052f1996b7bf1fbdba13c
Jul 09 22:46:30.244493 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:30.244446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d" event={"ID":"6d748cd9-c43f-4de4-a8e5-c4e946f50017","Type":"ContainerStarted","Data":"3e8b7215d8218d7dd96fc167f14f9cebba925a2da98e7be5f233d018032c4c6d"}
Jul 09 22:46:30.246692 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:30.246636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ghxxh" event={"ID":"e662ddce-015f-4fee-8b69-ac6dd2066c3b","Type":"ContainerStarted","Data":"1fe92e9f331deb460c0ceb55887fa833d14e51f6b02052f1996b7bf1fbdba13c"}
Jul 09 22:46:32.262199 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:32.262154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ghxxh" event={"ID":"e662ddce-015f-4fee-8b69-ac6dd2066c3b","Type":"ContainerStarted","Data":"11591788d775fbdf260868367081a41d32c253139bd57257bf12987268ebd275"}
Jul 09 22:46:32.262679 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:32.262294    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:32.263845 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:32.263816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d" event={"ID":"6d748cd9-c43f-4de4-a8e5-c4e946f50017","Type":"ContainerStarted","Data":"9da0d22ac61a8c2112db5ca154608d390be391628523fedca2a94c761f39de21"}
Jul 09 22:46:32.263979 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:32.263867    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:32.282269 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:32.282231    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-ghxxh" podStartSLOduration=1.728861304 podStartE2EDuration="3.282217681s" totalImagesPullingTime="1.553356377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:46:32.280642565 +0000 UTC m=+833.762465966" watchObservedRunningTime="2026-07-09 22:46:32.282217681 +0000 UTC m=+833.764041067"
Jul 09 22:46:32.300611 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:32.300566    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d" podStartSLOduration=1.712957689 podStartE2EDuration="3.300553894s" totalImagesPullingTime="1.587596205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:46:32.297751838 +0000 UTC m=+833.779575224" watchObservedRunningTime="2026-07-09 22:46:32.300553894 +0000 UTC m=+833.782377279"
Jul 09 22:46:37.290976 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:37.290946    2576 generic.go:356] "Generic (PLEG): container finished" podID="3741202c-f808-4479-8181-2f4162f3262e" containerID="b3434adbd191ea8093b0fb814373763ece682ce27c94b3144445826c749b6227" exitCode=0
Jul 09 22:46:37.291416 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:37.291003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" event={"ID":"3741202c-f808-4479-8181-2f4162f3262e","Type":"ContainerDied","Data":"b3434adbd191ea8093b0fb814373763ece682ce27c94b3144445826c749b6227"}
Jul 09 22:46:37.291416 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:37.291386    2576 scope.go:117] "RemoveContainer" containerID="b3434adbd191ea8093b0fb814373763ece682ce27c94b3144445826c749b6227"
Jul 09 22:46:37.292359 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:37.292333    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:46:37.292416 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:37.292403    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:46:37.292453 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:37.292439    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:46:38.297762 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:38.297727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" event={"ID":"3741202c-f808-4479-8181-2f4162f3262e","Type":"ContainerStarted","Data":"9645cb1c9d84a5cc208a2d41c150cd382957ac9fbe9431cfa56003258305616a"}
Jul 09 22:46:38.972856 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:38.972819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:46:38.973840 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:38.973818    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qnxtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 09 22:46:38.973950 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:38.973866    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" podUID="3741202c-f808-4479-8181-2f4162f3262e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 09 22:46:39.973258 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:39.973212    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qnxtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 09 22:46:39.973671 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:39.973285    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" podUID="3741202c-f808-4479-8181-2f4162f3262e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 09 22:46:40.972921 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:40.972885    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qnxtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 09 22:46:40.973103 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:40.972949    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" podUID="3741202c-f808-4479-8181-2f4162f3262e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 09 22:46:41.814144 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:41.814104    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:46:41.972396 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:41.972363    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qnxtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 09 22:46:41.972564 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:41.972414    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw" podUID="3741202c-f808-4479-8181-2f4162f3262e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 09 22:46:42.975946 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:42.975913    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:46:42.976877 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:42.976859    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qnxtw"
Jul 09 22:46:43.271833 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:43.271724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-ghxxh"
Jul 09 22:46:43.272117 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:43.272100    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-rqd9d"
Jul 09 22:46:47.286841 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.286811    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"]
Jul 09 22:46:47.291677 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.291654    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.300125 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.297383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-52nhr\""
Jul 09 22:46:47.300125 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.298491    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 22:46:47.300125 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.299173    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 22:46:47.300125 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.299416    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 22:46:47.309322 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.309289    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"]
Jul 09 22:46:47.434902 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.434866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgt78\" (UniqueName: \"kubernetes.io/projected/dbfc0eea-8f5f-43e3-8271-31c6be15c934-kube-api-access-qgt78\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.435210 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.434921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.435210 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.434956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.435210 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.434991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.435210 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.435009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.435210 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.435122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc0eea-8f5f-43e3-8271-31c6be15c934-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536310 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536460 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536460 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536535 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536578 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc0eea-8f5f-43e3-8271-31c6be15c934-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536578 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgt78\" (UniqueName: \"kubernetes.io/projected/dbfc0eea-8f5f-43e3-8271-31c6be15c934-kube-api-access-qgt78\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536720 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536702    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536769 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536738    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.536963 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.536908    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.538648 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.538627    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfc0eea-8f5f-43e3-8271-31c6be15c934-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.538844 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.538825    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfc0eea-8f5f-43e3-8271-31c6be15c934-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.544711 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.544688    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgt78\" (UniqueName: \"kubernetes.io/projected/dbfc0eea-8f5f-43e3-8271-31c6be15c934-kube-api-access-qgt78\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6\" (UID: \"dbfc0eea-8f5f-43e3-8271-31c6be15c934\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.610289 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.610251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:47.754431 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:47.754390    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"]
Jul 09 22:46:47.755886 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:46:47.755855    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfc0eea_8f5f_43e3_8271_31c6be15c934.slice/crio-efaba4f7702a3c8b6983bd03ee8711b6f302ce9f97ef5a7bd47ec00ecd55a86d WatchSource:0}: Error finding container efaba4f7702a3c8b6983bd03ee8711b6f302ce9f97ef5a7bd47ec00ecd55a86d: Status 404 returned error can't find the container with id efaba4f7702a3c8b6983bd03ee8711b6f302ce9f97ef5a7bd47ec00ecd55a86d
Jul 09 22:46:48.351089 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:48.351039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6" event={"ID":"dbfc0eea-8f5f-43e3-8271-31c6be15c934","Type":"ContainerStarted","Data":"efaba4f7702a3c8b6983bd03ee8711b6f302ce9f97ef5a7bd47ec00ecd55a86d"}
Jul 09 22:46:49.357164 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:49.357129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6" event={"ID":"dbfc0eea-8f5f-43e3-8271-31c6be15c934","Type":"ContainerStarted","Data":"81096922d63d35429b9d9ff1117fb7c8b5db1cb7001a07bb52cb42c724217a73"}
Jul 09 22:46:49.377335 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:49.377293    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6" podStartSLOduration=1.186373556 podStartE2EDuration="2.377278991s" totalImagesPullingTime="1.190905435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:46:49.376998136 +0000 UTC m=+850.858821524" watchObservedRunningTime="2026-07-09 22:46:49.377278991 +0000 UTC m=+850.859102376"
Jul 09 22:46:57.610406 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:57.610367    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:57.610826 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:57.610428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:57.625541 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:57.625514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:46:58.411884 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:46:58.411860    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6"
Jul 09 22:47:10.589761 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.589731    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"]
Jul 09 22:47:10.592166 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.592146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.596927 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.596908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 22:47:10.613605 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.613579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"]
Jul 09 22:47:10.633868 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.633847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.633967 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.633894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x46fq\" (UniqueName: \"kubernetes.io/projected/0179119e-304b-4b8c-9792-6f17c6a94bff-kube-api-access-x46fq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.634014 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.633978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.634049 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.634016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.634049 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.634042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.634114 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.634096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0179119e-304b-4b8c-9792-6f17c6a94bff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.734494 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.734466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x46fq\" (UniqueName: \"kubernetes.io/projected/0179119e-304b-4b8c-9792-6f17c6a94bff-kube-api-access-x46fq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.734617 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.734522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.734617 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.734550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.734617 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.734572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.734751 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.734623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0179119e-304b-4b8c-9792-6f17c6a94bff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.734751 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.734662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.734991 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.734972    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.735059 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.735003    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.735097 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.735081    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.736865 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.736835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0179119e-304b-4b8c-9792-6f17c6a94bff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.737012 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.736998    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0179119e-304b-4b8c-9792-6f17c6a94bff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.743330 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.743312    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x46fq\" (UniqueName: \"kubernetes.io/projected/0179119e-304b-4b8c-9792-6f17c6a94bff-kube-api-access-x46fq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-25tts\" (UID: \"0179119e-304b-4b8c-9792-6f17c6a94bff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:10.905051 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:10.904970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:11.043941 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:11.043920    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"]
Jul 09 22:47:11.045632 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:47:11.045599    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0179119e_304b_4b8c_9792_6f17c6a94bff.slice/crio-6bee648efcbedbf7b57f551730a26177bdd20bd1cad621086efaa6cb1672d60c WatchSource:0}: Error finding container 6bee648efcbedbf7b57f551730a26177bdd20bd1cad621086efaa6cb1672d60c: Status 404 returned error can't find the container with id 6bee648efcbedbf7b57f551730a26177bdd20bd1cad621086efaa6cb1672d60c
Jul 09 22:47:11.465463 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:11.465429    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts" event={"ID":"0179119e-304b-4b8c-9792-6f17c6a94bff","Type":"ContainerStarted","Data":"f11bbbb700e70646a63d2cb7be70a866bfe726c12ec56321ad91c5c4bd1bee15"}
Jul 09 22:47:11.465641 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:11.465483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts" event={"ID":"0179119e-304b-4b8c-9792-6f17c6a94bff","Type":"ContainerStarted","Data":"6bee648efcbedbf7b57f551730a26177bdd20bd1cad621086efaa6cb1672d60c"}
Jul 09 22:47:11.489851 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:11.487837    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts" podStartSLOduration=1.307071027 podStartE2EDuration="1.48781723s" totalImagesPullingTime="180.746203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:47:11.484200467 +0000 UTC m=+872.966023853" watchObservedRunningTime="2026-07-09 22:47:11.48781723 +0000 UTC m=+872.969640622"
Jul 09 22:47:20.905690 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:20.905659    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:20.906175 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:20.905744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:20.918727 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:20.918703    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:21.527651 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:21.527625    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-25tts"
Jul 09 22:47:33.075689 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.075609    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"]
Jul 09 22:47:33.081368 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.081349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.084474 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.084452    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 22:47:33.089325 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.089302    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"]
Jul 09 22:47:33.240173 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.240142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/073bf167-9b58-41e9-bee2-a3f8809da793-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.240173 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.240175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.240355 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.240190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.240355 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.240209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjdf\" (UniqueName: \"kubernetes.io/projected/073bf167-9b58-41e9-bee2-a3f8809da793-kube-api-access-lfjdf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.240355 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.240265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.240355 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.240331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.341744 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.341660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.341900 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.341765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.341943 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.341904    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/073bf167-9b58-41e9-bee2-a3f8809da793-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.341943 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.341931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.342025 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.341955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.342099 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.342072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjdf\" (UniqueName: \"kubernetes.io/projected/073bf167-9b58-41e9-bee2-a3f8809da793-kube-api-access-lfjdf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.342218 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.342198    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.342290 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.342263    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.342347 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.342303    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.344006 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.343984    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/073bf167-9b58-41e9-bee2-a3f8809da793-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.344420 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.344391    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/073bf167-9b58-41e9-bee2-a3f8809da793-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.351505 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.351485    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjdf\" (UniqueName: \"kubernetes.io/projected/073bf167-9b58-41e9-bee2-a3f8809da793-kube-api-access-lfjdf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw\" (UID: \"073bf167-9b58-41e9-bee2-a3f8809da793\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.404185 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.404157    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:33.539815 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.539764    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"]
Jul 09 22:47:33.542106 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:47:33.542081    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod073bf167_9b58_41e9_bee2_a3f8809da793.slice/crio-d7770738a84881081d5727d9dea53df09d004ff21c505123b09fa1d66da71bf2 WatchSource:0}: Error finding container d7770738a84881081d5727d9dea53df09d004ff21c505123b09fa1d66da71bf2: Status 404 returned error can't find the container with id d7770738a84881081d5727d9dea53df09d004ff21c505123b09fa1d66da71bf2
Jul 09 22:47:33.577677 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:33.577644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw" event={"ID":"073bf167-9b58-41e9-bee2-a3f8809da793","Type":"ContainerStarted","Data":"d7770738a84881081d5727d9dea53df09d004ff21c505123b09fa1d66da71bf2"}
Jul 09 22:47:34.585371 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:34.585330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw" event={"ID":"073bf167-9b58-41e9-bee2-a3f8809da793","Type":"ContainerStarted","Data":"fc20b0d634dc2b0cb0236f1f3fcc13cce0bbe6282b41080ba6128e54ac708ac4"}
Jul 09 22:47:34.607831 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:34.607764    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw" podStartSLOduration=1.432470584 podStartE2EDuration="1.607749431s" totalImagesPullingTime="175.278847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:47:34.605700861 +0000 UTC m=+896.087524251" watchObservedRunningTime="2026-07-09 22:47:34.607749431 +0000 UTC m=+896.089572816"
Jul 09 22:47:40.009655 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:40.009629    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:47:40.011857 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:40.011834    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:47:43.405105 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:43.405074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:43.405499 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:43.405354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:43.417363 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:43.417341    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:47:43.644699 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:47:43.644672    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw"
Jul 09 22:48:15.918198 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:15.918166    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b8988d898-vn5r6"]
Jul 09 22:48:15.921858 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:15.921838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:15.933942 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:15.933916    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b8988d898-vn5r6"]
Jul 09 22:48:16.000612 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.000580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6692ec74-4c40-4dd5-9267-97982af92f8a-tls-cert\") pod \"authorino-b8988d898-vn5r6\" (UID: \"6692ec74-4c40-4dd5-9267-97982af92f8a\") " pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:16.000739 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.000622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89xd\" (UniqueName: \"kubernetes.io/projected/6692ec74-4c40-4dd5-9267-97982af92f8a-kube-api-access-l89xd\") pod \"authorino-b8988d898-vn5r6\" (UID: \"6692ec74-4c40-4dd5-9267-97982af92f8a\") " pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:16.101380 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.101353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6692ec74-4c40-4dd5-9267-97982af92f8a-tls-cert\") pod \"authorino-b8988d898-vn5r6\" (UID: \"6692ec74-4c40-4dd5-9267-97982af92f8a\") " pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:16.101495 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.101395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l89xd\" (UniqueName: \"kubernetes.io/projected/6692ec74-4c40-4dd5-9267-97982af92f8a-kube-api-access-l89xd\") pod \"authorino-b8988d898-vn5r6\" (UID: \"6692ec74-4c40-4dd5-9267-97982af92f8a\") " pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:16.104302 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.104279    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6692ec74-4c40-4dd5-9267-97982af92f8a-tls-cert\") pod \"authorino-b8988d898-vn5r6\" (UID: \"6692ec74-4c40-4dd5-9267-97982af92f8a\") " pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:16.119543 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.119519    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89xd\" (UniqueName: \"kubernetes.io/projected/6692ec74-4c40-4dd5-9267-97982af92f8a-kube-api-access-l89xd\") pod \"authorino-b8988d898-vn5r6\" (UID: \"6692ec74-4c40-4dd5-9267-97982af92f8a\") " pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:16.231701 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.231636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8988d898-vn5r6"
Jul 09 22:48:16.372278 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.372251    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b8988d898-vn5r6"]
Jul 09 22:48:16.374400 ip-10-0-132-100 kubenswrapper[2576]: W0709 22:48:16.374366    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6692ec74_4c40_4dd5_9267_97982af92f8a.slice/crio-bafda6a0d9864333099c587ef305151d9776db9fa22aaf005ae57f3082ca6690 WatchSource:0}: Error finding container bafda6a0d9864333099c587ef305151d9776db9fa22aaf005ae57f3082ca6690: Status 404 returned error can't find the container with id bafda6a0d9864333099c587ef305151d9776db9fa22aaf005ae57f3082ca6690
Jul 09 22:48:16.375681 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.375663    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:48:16.789976 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:16.789952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b8988d898-vn5r6" event={"ID":"6692ec74-4c40-4dd5-9267-97982af92f8a","Type":"ContainerStarted","Data":"bafda6a0d9864333099c587ef305151d9776db9fa22aaf005ae57f3082ca6690"}
Jul 09 22:48:17.797099 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:17.797065    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b8988d898-vn5r6" event={"ID":"6692ec74-4c40-4dd5-9267-97982af92f8a","Type":"ContainerStarted","Data":"d4662aa306289faf889f9f944acf8aa9bc2e4fc51a61835a917a648a6aff02db"}
Jul 09 22:48:17.825326 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:17.825266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b8988d898-vn5r6" podStartSLOduration=2.413833944 podStartE2EDuration="2.825243345s" totalImagesPullingTime="411.409401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:48:17.82369324 +0000 UTC m=+939.305516637" watchObservedRunningTime="2026-07-09 22:48:17.825243345 +0000 UTC m=+939.307066730"
Jul 09 22:48:17.877618 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:17.877585    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b485594c-ttf6c"]
Jul 09 22:48:17.877798 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:17.877760    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6b485594c-ttf6c" podUID="16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" containerName="authorino" containerID="cri-o://60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614" gracePeriod=30
Jul 09 22:48:18.147548 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.147524    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:48:18.223113 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.223082    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gfwx\" (UniqueName: \"kubernetes.io/projected/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-kube-api-access-7gfwx\") pod \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") "
Jul 09 22:48:18.223264 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.223161    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-tls-cert\") pod \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\" (UID: \"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a\") "
Jul 09 22:48:18.225238 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.225211    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-kube-api-access-7gfwx" (OuterVolumeSpecName: "kube-api-access-7gfwx") pod "16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" (UID: "16ef9808-1eb3-4c8e-b005-0f1251e7fe9a"). InnerVolumeSpecName "kube-api-access-7gfwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:48:18.233434 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.233407    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" (UID: "16ef9808-1eb3-4c8e-b005-0f1251e7fe9a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:48:18.323987 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.323956    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-tls-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:48:18.323987 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.323982    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gfwx\" (UniqueName: \"kubernetes.io/projected/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a-kube-api-access-7gfwx\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:48:18.803508 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.803424    2576 generic.go:356] "Generic (PLEG): container finished" podID="16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" containerID="60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614" exitCode=0
Jul 09 22:48:18.803508 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.803470    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b485594c-ttf6c"
Jul 09 22:48:18.804062 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.803507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b485594c-ttf6c" event={"ID":"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a","Type":"ContainerDied","Data":"60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614"}
Jul 09 22:48:18.804062 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.803551    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b485594c-ttf6c" event={"ID":"16ef9808-1eb3-4c8e-b005-0f1251e7fe9a","Type":"ContainerDied","Data":"06ce92e3c7855d3e48d2bd61924ce83bd4e7b46dc8664cdbff1a5ee583e9e3c5"}
Jul 09 22:48:18.804062 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.803573    2576 scope.go:117] "RemoveContainer" containerID="60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614"
Jul 09 22:48:18.812550 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.812536    2576 scope.go:117] "RemoveContainer" containerID="60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614"
Jul 09 22:48:18.812818 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:48:18.812801    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614\": container with ID starting with 60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614 not found: ID does not exist" containerID="60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614"
Jul 09 22:48:18.812862 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.812827    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614"} err="failed to get container status \"60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614\": rpc error: code = NotFound desc = could not find container \"60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614\": container with ID starting with 60a597383f0d7d7cecf6d59125e075ed38f1cb6ebde7576f26a3859245e28614 not found: ID does not exist"
Jul 09 22:48:18.825465 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.825426    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b485594c-ttf6c"]
Jul 09 22:48:18.829030 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:18.829006    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b485594c-ttf6c"]
Jul 09 22:48:19.043553 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:48:19.043527    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" path="/var/lib/kubelet/pods/16ef9808-1eb3-4c8e-b005-0f1251e7fe9a/volumes"
Jul 09 22:49:28.227880 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.227842    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f9f7f5566-9vtfv"]
Jul 09 22:49:28.228424 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.228080    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv" podUID="3696f8f0-c692-4b1e-8f20-a22a24361f83" containerName="manager" containerID="cri-o://dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0" gracePeriod=30
Jul 09 22:49:28.478133 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.478074    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:49:28.651827 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.651802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3696f8f0-c692-4b1e-8f20-a22a24361f83-webhook-cert\") pod \"3696f8f0-c692-4b1e-8f20-a22a24361f83\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") "
Jul 09 22:49:28.651979 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.651836    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pg29\" (UniqueName: \"kubernetes.io/projected/3696f8f0-c692-4b1e-8f20-a22a24361f83-kube-api-access-6pg29\") pod \"3696f8f0-c692-4b1e-8f20-a22a24361f83\" (UID: \"3696f8f0-c692-4b1e-8f20-a22a24361f83\") "
Jul 09 22:49:28.653826 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.653766    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3696f8f0-c692-4b1e-8f20-a22a24361f83-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3696f8f0-c692-4b1e-8f20-a22a24361f83" (UID: "3696f8f0-c692-4b1e-8f20-a22a24361f83"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:49:28.653826 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.653817    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3696f8f0-c692-4b1e-8f20-a22a24361f83-kube-api-access-6pg29" (OuterVolumeSpecName: "kube-api-access-6pg29") pod "3696f8f0-c692-4b1e-8f20-a22a24361f83" (UID: "3696f8f0-c692-4b1e-8f20-a22a24361f83"). InnerVolumeSpecName "kube-api-access-6pg29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:49:28.753184 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.753118    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3696f8f0-c692-4b1e-8f20-a22a24361f83-webhook-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:49:28.753184 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:28.753142    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pg29\" (UniqueName: \"kubernetes.io/projected/3696f8f0-c692-4b1e-8f20-a22a24361f83-kube-api-access-6pg29\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 22:49:29.153839 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.153809    2576 generic.go:356] "Generic (PLEG): container finished" podID="3696f8f0-c692-4b1e-8f20-a22a24361f83" containerID="dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0" exitCode=0
Jul 09 22:49:29.154018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.153878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv" event={"ID":"3696f8f0-c692-4b1e-8f20-a22a24361f83","Type":"ContainerDied","Data":"dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0"}
Jul 09 22:49:29.154018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.153916    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv"
Jul 09 22:49:29.154018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.153929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f9f7f5566-9vtfv" event={"ID":"3696f8f0-c692-4b1e-8f20-a22a24361f83","Type":"ContainerDied","Data":"1e31f73f7fd70bddd3d71b9f2f36056eef90f09a47b20d8ca23ce5f9266b9e6b"}
Jul 09 22:49:29.154018 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.153958    2576 scope.go:117] "RemoveContainer" containerID="dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0"
Jul 09 22:49:29.162821 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.162757    2576 scope.go:117] "RemoveContainer" containerID="dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0"
Jul 09 22:49:29.163069 ip-10-0-132-100 kubenswrapper[2576]: E0709 22:49:29.163050    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0\": container with ID starting with dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0 not found: ID does not exist" containerID="dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0"
Jul 09 22:49:29.163138 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.163075    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0"} err="failed to get container status \"dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0\": rpc error: code = NotFound desc = could not find container \"dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0\": container with ID starting with dd03f55a08786460332a6c1ad609271b949d2979364e48e772d91bb4f7e6a8c0 not found: ID does not exist"
Jul 09 22:49:29.173978 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.173951    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f9f7f5566-9vtfv"]
Jul 09 22:49:29.177987 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:29.177968    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f9f7f5566-9vtfv"]
Jul 09 22:49:31.043529 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:49:31.043493    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3696f8f0-c692-4b1e-8f20-a22a24361f83" path="/var/lib/kubelet/pods/3696f8f0-c692-4b1e-8f20-a22a24361f83/volumes"
Jul 09 22:52:40.042620 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:52:40.042589    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:52:40.044732 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:52:40.044709    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:57:40.070933 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:57:40.070909    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 22:57:40.075580 ip-10-0-132-100 kubenswrapper[2576]: I0709 22:57:40.075555    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 23:01:37.587603 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.587568    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"]
Jul 09 23:01:37.588252 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.588075    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" containerName="authorino"
Jul 09 23:01:37.588252 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.588093    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" containerName="authorino"
Jul 09 23:01:37.588252 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.588122    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3696f8f0-c692-4b1e-8f20-a22a24361f83" containerName="manager"
Jul 09 23:01:37.588252 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.588130    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3696f8f0-c692-4b1e-8f20-a22a24361f83" containerName="manager"
Jul 09 23:01:37.588252 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.588218    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3696f8f0-c692-4b1e-8f20-a22a24361f83" containerName="manager"
Jul 09 23:01:37.588252 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.588230    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ef9808-1eb3-4c8e-b005-0f1251e7fe9a" containerName="authorino"
Jul 09 23:01:37.591477 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.591458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.594401 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.594378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a1d7899b-openshift-default-dockercfg-fgmv6\""
Jul 09 23:01:37.603710 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.603689    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"]
Jul 09 23:01:37.760090 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de65549d-4d8a-4db2-85be-84589c127d9d-istiod-ca-cert\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760260 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-certs\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760260 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-credential-socket\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760260 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-envoy\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760378 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de65549d-4d8a-4db2-85be-84589c127d9d-istio-podinfo\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760378 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4krb\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-kube-api-access-h4krb\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760378 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-data\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760477 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-socket\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.760477 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.760468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-istio-token\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861438 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4krb\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-kube-api-access-h4krb\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861438 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-data\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861438 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-socket\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861731 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-istio-token\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861731 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de65549d-4d8a-4db2-85be-84589c127d9d-istiod-ca-cert\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861731 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-certs\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861731 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-credential-socket\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861994 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-envoy\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861994 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de65549d-4d8a-4db2-85be-84589c127d9d-istio-podinfo\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861994 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861869    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-data\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.861994 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.861924    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-socket\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.862210 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.862176    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-credential-socket\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.862362 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.862340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de65549d-4d8a-4db2-85be-84589c127d9d-istiod-ca-cert\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.862443 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.862421    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-certs\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.863984 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.863959    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-envoy\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.864191 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.864175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de65549d-4d8a-4db2-85be-84589c127d9d-istio-podinfo\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.879341 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.879317    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-istio-token\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.879643 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.879618    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4krb\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-kube-api-access-h4krb\") pod \"e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") " pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:37.903536 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:37.903513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:38.047603 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.047579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"]
Jul 09 23:01:38.048910 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:01:38.048885    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde65549d_4d8a_4db2_85be_84589c127d9d.slice/crio-4f0702fbc9d125224c09019abbca965af39f92953c461e62fc5863369c2e9a5f WatchSource:0}: Error finding container 4f0702fbc9d125224c09019abbca965af39f92953c461e62fc5863369c2e9a5f: Status 404 returned error can't find the container with id 4f0702fbc9d125224c09019abbca965af39f92953c461e62fc5863369c2e9a5f
Jul 09 23:01:38.050991 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.050963    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:01:38.051053 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.051025    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:01:38.051100 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.051052    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:01:38.662197 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.662160    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh" event={"ID":"de65549d-4d8a-4db2-85be-84589c127d9d","Type":"ContainerStarted","Data":"7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87"}
Jul 09 23:01:38.662627 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.662224    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh" event={"ID":"de65549d-4d8a-4db2-85be-84589c127d9d","Type":"ContainerStarted","Data":"4f0702fbc9d125224c09019abbca965af39f92953c461e62fc5863369c2e9a5f"}
Jul 09 23:01:38.690043 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.689972    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh" podStartSLOduration=1.689954883 podStartE2EDuration="1.689954883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:01:38.688087543 +0000 UTC m=+1740.169910929" watchObservedRunningTime="2026-07-09 23:01:38.689954883 +0000 UTC m=+1740.171778270"
Jul 09 23:01:38.904189 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:38.904159    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:39.908671 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:39.908636    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:40.674821 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:40.674768    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:40.675672 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:40.675655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:44.055056 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:44.055007    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"]
Jul 09 23:01:44.055435 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:44.055219    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh" podUID="de65549d-4d8a-4db2-85be-84589c127d9d" containerName="istio-proxy" containerID="cri-o://7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87" gracePeriod=30
Jul 09 23:01:50.014919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.014895    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:50.073044 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.073009    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"]
Jul 09 23:01:50.073448 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.073427    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de65549d-4d8a-4db2-85be-84589c127d9d" containerName="istio-proxy"
Jul 09 23:01:50.073448 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.073446    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de65549d-4d8a-4db2-85be-84589c127d9d" containerName="istio-proxy"
Jul 09 23:01:50.073593 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.073532    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de65549d-4d8a-4db2-85be-84589c127d9d" containerName="istio-proxy"
Jul 09 23:01:50.075717 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.075692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.078420 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.078397    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-201d22c6-openshift-default-dockercfg-zbclt\""
Jul 09 23:01:50.085927 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.085902    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-certs\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086038 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.085989    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4krb\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-kube-api-access-h4krb\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086038 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.086020    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-envoy\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.086081    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-data\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.086119    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de65549d-4d8a-4db2-85be-84589c127d9d-istio-podinfo\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.086150    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de65549d-4d8a-4db2-85be-84589c127d9d-istiod-ca-cert\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086281 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.086173    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-socket\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086281 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.086197    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-istio-token\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.086281 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.086239    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-credential-socket\") pod \"de65549d-4d8a-4db2-85be-84589c127d9d\" (UID: \"de65549d-4d8a-4db2-85be-84589c127d9d\") "
Jul 09 23:01:50.087827 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.087788    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:50.088653 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.088541    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:50.088809 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.088790    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:50.089981 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.089948    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de65549d-4d8a-4db2-85be-84589c127d9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:01:50.090282 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.090242    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:50.091598 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.091561    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:50.091687 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.091643    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"]
Jul 09 23:01:50.091929 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.091891    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-kube-api-access-h4krb" (OuterVolumeSpecName: "kube-api-access-h4krb") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "kube-api-access-h4krb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:01:50.092204 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.092164    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de65549d-4d8a-4db2-85be-84589c127d9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 23:01:50.093555 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.093535    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "de65549d-4d8a-4db2-85be-84589c127d9d" (UID: "de65549d-4d8a-4db2-85be-84589c127d9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:01:50.187532 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-data\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.187723 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-credential-socket\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.187723 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-envoy\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.187723 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-podinfo\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.187723 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-socket\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.187723 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-token\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.187723 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istiod-ca-cert\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxs2s\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-kube-api-access-fxs2s\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-certs\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187898    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-credential-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187911    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187941    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4krb\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-kube-api-access-h4krb\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187965    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-envoy\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.187988    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-istio-data\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.188002    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de65549d-4d8a-4db2-85be-84589c127d9d-istio-podinfo\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.188015    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de65549d-4d8a-4db2-85be-84589c127d9d-istiod-ca-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.188028    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de65549d-4d8a-4db2-85be-84589c127d9d-workload-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.188159 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.188040    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de65549d-4d8a-4db2-85be-84589c127d9d-istio-token\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:01:50.288457 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-data\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288457 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-credential-socket\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288705 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-envoy\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288705 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-podinfo\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288705 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-socket\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288705 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-token\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288705 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istiod-ca-cert\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288705 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxs2s\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-kube-api-access-fxs2s\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.288705 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-certs\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.289142 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288929    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-data\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.289142 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.288991    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-credential-socket\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.289301 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.289277    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-certs\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.289301 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.289287    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-socket\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.289443 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.289420    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istiod-ca-cert\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.290866 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.290846    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-envoy\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.290985 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.290970    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-podinfo\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.296292 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.296270    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-token\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.296392 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.296309    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxs2s\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-kube-api-access-fxs2s\") pod \"e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") " pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.390415 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.390346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:50.524104 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.524069    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"]
Jul 09 23:01:50.527323 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:01:50.527294    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45f7d73_17a6_49ec_ae49_f63fcca7f976.slice/crio-18e53bfab66f1b8db0a6868aed0562b5fdf939f6d83ebd945f40824e950b4e15 WatchSource:0}: Error finding container 18e53bfab66f1b8db0a6868aed0562b5fdf939f6d83ebd945f40824e950b4e15: Status 404 returned error can't find the container with id 18e53bfab66f1b8db0a6868aed0562b5fdf939f6d83ebd945f40824e950b4e15
Jul 09 23:01:50.529521 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.529490    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:01:50.529590 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.529563    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:01:50.529632 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.529593    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:01:50.729087 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.728986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts" event={"ID":"e45f7d73-17a6-49ec-ae49-f63fcca7f976","Type":"ContainerStarted","Data":"3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797"}
Jul 09 23:01:50.729087 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.729059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts" event={"ID":"e45f7d73-17a6-49ec-ae49-f63fcca7f976","Type":"ContainerStarted","Data":"18e53bfab66f1b8db0a6868aed0562b5fdf939f6d83ebd945f40824e950b4e15"}
Jul 09 23:01:50.730419 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.730393    2576 generic.go:356] "Generic (PLEG): container finished" podID="de65549d-4d8a-4db2-85be-84589c127d9d" containerID="7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87" exitCode=0
Jul 09 23:01:50.730552 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.730430    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"
Jul 09 23:01:50.730552 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.730476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh" event={"ID":"de65549d-4d8a-4db2-85be-84589c127d9d","Type":"ContainerDied","Data":"7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87"}
Jul 09 23:01:50.730552 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.730531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh" event={"ID":"de65549d-4d8a-4db2-85be-84589c127d9d","Type":"ContainerDied","Data":"4f0702fbc9d125224c09019abbca965af39f92953c461e62fc5863369c2e9a5f"}
Jul 09 23:01:50.730674 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.730561    2576 scope.go:117] "RemoveContainer" containerID="7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87"
Jul 09 23:01:50.741987 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.741910    2576 scope.go:117] "RemoveContainer" containerID="7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87"
Jul 09 23:01:50.742201 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:01:50.742183    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87\": container with ID starting with 7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87 not found: ID does not exist" containerID="7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87"
Jul 09 23:01:50.742253 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.742210    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87"} err="failed to get container status \"7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87\": rpc error: code = NotFound desc = could not find container \"7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87\": container with ID starting with 7685a4e07c92d21e087e6143ff6330bf64ffbea8c72263f098307d36793efd87 not found: ID does not exist"
Jul 09 23:01:50.748262 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.748217    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts" podStartSLOduration=0.748198935 podStartE2EDuration="748.198935ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:01:50.746666292 +0000 UTC m=+1752.228489701" watchObservedRunningTime="2026-07-09 23:01:50.748198935 +0000 UTC m=+1752.230022322"
Jul 09 23:01:50.761131 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.761103    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"]
Jul 09 23:01:50.766457 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:50.766432    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a1d7899b-openshift-default-5c47f4789c-4v9nh"]
Jul 09 23:01:51.043713 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:51.043640    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de65549d-4d8a-4db2-85be-84589c127d9d" path="/var/lib/kubelet/pods/de65549d-4d8a-4db2-85be-84589c127d9d/volumes"
Jul 09 23:01:51.390936 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:51.390903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:51.399577 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:51.399555    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:51.736410 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:51.736332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:01:51.737336 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:01:51.737319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:02:02.483662 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:02.483625    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"]
Jul 09 23:02:02.484214 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:02.483872    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts" podUID="e45f7d73-17a6-49ec-ae49-f63fcca7f976" containerName="istio-proxy" containerID="cri-o://3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797" gracePeriod=30
Jul 09 23:02:03.241155 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.241132    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:02:03.310725 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.310696    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-certs\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.310908 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.310732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-token\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.310908 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.310756    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-credential-socket\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.310908 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.310809    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-data\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.310908 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.310904    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-envoy\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.311140 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.310947    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxs2s\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-kube-api-access-fxs2s\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.311140 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.310976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-podinfo\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.311140 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311030    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:02:03.311140 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311039    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-socket\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.311140 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311113    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istiod-ca-cert\") pod \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\" (UID: \"e45f7d73-17a6-49ec-ae49-f63fcca7f976\") "
Jul 09 23:02:03.311389 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311247    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:02:03.311389 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311290    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:02:03.311519 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311501    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.311577 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311534    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:02:03.311577 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311525    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-workload-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.311696 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.311579    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-credential-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.312050 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.312022    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-data" (OuterVolumeSpecName: "istio-data") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:02:03.313283 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.313252    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-kube-api-access-fxs2s" (OuterVolumeSpecName: "kube-api-access-fxs2s") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "kube-api-access-fxs2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:02:03.313385 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.313363    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:02:03.313528 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.313504    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 23:02:03.313600 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.313521    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-token" (OuterVolumeSpecName: "istio-token") pod "e45f7d73-17a6-49ec-ae49-f63fcca7f976" (UID: "e45f7d73-17a6-49ec-ae49-f63fcca7f976"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:02:03.412334 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.412294    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-envoy\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.412334 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.412334    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxs2s\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-kube-api-access-fxs2s\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.412539 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.412350    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-podinfo\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.412539 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.412366    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istiod-ca-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.412539 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.412380    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-token\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.412539 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.412393    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e45f7d73-17a6-49ec-ae49-f63fcca7f976-istio-data\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:02:03.794625 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.794593    2576 generic.go:356] "Generic (PLEG): container finished" podID="e45f7d73-17a6-49ec-ae49-f63fcca7f976" containerID="3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797" exitCode=0
Jul 09 23:02:03.795048 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.794643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts" event={"ID":"e45f7d73-17a6-49ec-ae49-f63fcca7f976","Type":"ContainerDied","Data":"3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797"}
Jul 09 23:02:03.795048 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.794651    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"
Jul 09 23:02:03.795048 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.794712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts" event={"ID":"e45f7d73-17a6-49ec-ae49-f63fcca7f976","Type":"ContainerDied","Data":"18e53bfab66f1b8db0a6868aed0562b5fdf939f6d83ebd945f40824e950b4e15"}
Jul 09 23:02:03.795048 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.794735    2576 scope.go:117] "RemoveContainer" containerID="3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797"
Jul 09 23:02:03.803803 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.803767    2576 scope.go:117] "RemoveContainer" containerID="3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797"
Jul 09 23:02:03.804031 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:02:03.804015    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797\": container with ID starting with 3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797 not found: ID does not exist" containerID="3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797"
Jul 09 23:02:03.804096 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.804038    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797"} err="failed to get container status \"3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797\": rpc error: code = NotFound desc = could not find container \"3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797\": container with ID starting with 3984cab43eda3f842a6bc9dd2f764e42156d8b23b17a052133de4a58f9234797 not found: ID does not exist"
Jul 09 23:02:03.816087 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.816058    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"]
Jul 09 23:02:03.822092 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:03.822072    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-201d22c6-openshift-default-776f8bb859-fbxts"]
Jul 09 23:02:05.042862 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:05.042827    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e45f7d73-17a6-49ec-ae49-f63fcca7f976" path="/var/lib/kubelet/pods/e45f7d73-17a6-49ec-ae49-f63fcca7f976/volumes"
Jul 09 23:02:40.099535 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:40.099507    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 23:02:40.104758 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:02:40.104736    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 23:04:35.803306 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.803267    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"]
Jul 09 23:04:35.804037 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.803650    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e45f7d73-17a6-49ec-ae49-f63fcca7f976" containerName="istio-proxy"
Jul 09 23:04:35.804037 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.803661    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e45f7d73-17a6-49ec-ae49-f63fcca7f976" containerName="istio-proxy"
Jul 09 23:04:35.804037 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.803723    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e45f7d73-17a6-49ec-ae49-f63fcca7f976" containerName="istio-proxy"
Jul 09 23:04:35.806211 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.806189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.809196 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.809172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4e2b27a4-openshift-default-dockercfg-mqd8q\""
Jul 09 23:04:35.821854 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.821829    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"]
Jul 09 23:04:35.881657 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-envoy\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881657 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-data\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-credential-socket\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-token\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-podinfo\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istiod-ca-cert\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-socket\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-certs\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.881919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.881895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4lf\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-kube-api-access-mh4lf\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.982745 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-envoy\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.982745 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-data\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983083 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-credential-socket\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983083 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-token\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983083 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-podinfo\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983083 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istiod-ca-cert\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983083 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-socket\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983083 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-certs\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983083 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.982972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4lf\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-kube-api-access-mh4lf\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983476 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.983303    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-data\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983875 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.983584    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-credential-socket\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983875 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.983620    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-certs\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.983875 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.983651    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-socket\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.984134 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.983932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istiod-ca-cert\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.986223 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.986191    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-envoy\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.986682 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.986662    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-podinfo\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.990570 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.990542    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4lf\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-kube-api-access-mh4lf\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:35.990818 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:35.990797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-token\") pod \"e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") " pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:36.117114 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.117073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:36.258717 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.258680    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"]
Jul 09 23:04:36.262564 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:04:36.262524    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce10d6a_2e3b_4b14_bd65_02c4e73752ef.slice/crio-1abd80c5560b4640af6133874a9ffcd284bc58dd5af038601c4a8531f7c48d60 WatchSource:0}: Error finding container 1abd80c5560b4640af6133874a9ffcd284bc58dd5af038601c4a8531f7c48d60: Status 404 returned error can't find the container with id 1abd80c5560b4640af6133874a9ffcd284bc58dd5af038601c4a8531f7c48d60
Jul 09 23:04:36.264892 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.264859    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:04:36.264989 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.264929    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:04:36.264989 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.264958    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:04:36.523876 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.523734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" event={"ID":"cce10d6a-2e3b-4b14-bd65-02c4e73752ef","Type":"ContainerStarted","Data":"101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c"}
Jul 09 23:04:36.523876 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.523833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" event={"ID":"cce10d6a-2e3b-4b14-bd65-02c4e73752ef","Type":"ContainerStarted","Data":"1abd80c5560b4640af6133874a9ffcd284bc58dd5af038601c4a8531f7c48d60"}
Jul 09 23:04:36.544153 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:36.544084    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" podStartSLOduration=1.5440627409999998 podStartE2EDuration="1.544062741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:04:36.542250496 +0000 UTC m=+1918.024073887" watchObservedRunningTime="2026-07-09 23:04:36.544062741 +0000 UTC m=+1918.025886128"
Jul 09 23:04:37.118109 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:37.118065    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:37.125426 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:37.125393    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:37.528892 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:37.528807    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:37.529833 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:37.529814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:53.350098 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.350059    2576 patch_prober.go:28] interesting pod/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:34980->10.133.0.52:15021: read: connection reset by peer" start-of-body=
Jul 09 23:04:53.350479 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.350153    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:34980->10.133.0.52:15021: read: connection reset by peer"
Jul 09 23:04:53.610062 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.609980    2576 generic.go:356] "Generic (PLEG): container finished" podID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerID="101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c" exitCode=0
Jul 09 23:04:53.610203 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.610052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" event={"ID":"cce10d6a-2e3b-4b14-bd65-02c4e73752ef","Type":"ContainerDied","Data":"101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c"}
Jul 09 23:04:53.610513 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.610497    2576 scope.go:117] "RemoveContainer" containerID="101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c"
Jul 09 23:04:53.611475 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.611446    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:04:53.611570 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.611518    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:04:53.611570 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:53.611552    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:04:54.617226 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:54.617187    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" event={"ID":"cce10d6a-2e3b-4b14-bd65-02c4e73752ef","Type":"ContainerStarted","Data":"115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05"}
Jul 09 23:04:55.117572 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:55.117537    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:55.117763 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:55.117718    2576 patch_prober.go:28] interesting pod/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 09 23:04:55.117870 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:55.117763    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 09 23:04:56.118245 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:56.118198    2576 patch_prober.go:28] interesting pod/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 09 23:04:56.118753 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:56.118280    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 09 23:04:57.117903 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:57.117859    2576 patch_prober.go:28] interesting pod/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 09 23:04:57.118214 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:57.118180    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 09 23:04:58.118376 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:58.118333    2576 patch_prober.go:28] interesting pod/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 09 23:04:58.118954 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:58.118404    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 09 23:04:59.121425 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:59.121394    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:59.121812 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:59.121671    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:04:59.122357 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:04:59.122339    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:06:04.011697 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:04.011667    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"]
Jul 09 23:06:04.012186 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:04.011903    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy" containerID="cri-o://115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05" gracePeriod=30
Jul 09 23:06:09.268559 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.268537    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:06:09.349381 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349355    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-credential-socket\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349521 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349384    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-data\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349521 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-socket\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349521 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349450    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-token\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349521 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349477    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istiod-ca-cert\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349744 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349528    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh4lf\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-kube-api-access-mh4lf\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349744 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349594    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-podinfo\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349744 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349640    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:06:09.349744 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349670    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-envoy\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.349744 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349703    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-certs\") pod \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\" (UID: \"cce10d6a-2e3b-4b14-bd65-02c4e73752ef\") "
Jul 09 23:06:09.350042 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.349798    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:06:09.350095 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.350042    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-credential-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.350095 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.350061    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.350095 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.350070    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:06:09.350255 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.350230    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:06:09.350255 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.350244    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:06:09.351741 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.351707    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:06:09.351741 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.351713    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 23:06:09.351897 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.351761    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:06:09.352061 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.352042    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-kube-api-access-mh4lf" (OuterVolumeSpecName: "kube-api-access-mh4lf") pod "cce10d6a-2e3b-4b14-bd65-02c4e73752ef" (UID: "cce10d6a-2e3b-4b14-bd65-02c4e73752ef"). InnerVolumeSpecName "kube-api-access-mh4lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:06:09.450485 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.450458    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-podinfo\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.450485 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.450482    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-envoy\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.450485 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.450492    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-workload-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.450706 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.450501    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-data\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.450706 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.450510    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istio-token\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.450706 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.450519    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-istiod-ca-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.450706 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.450528    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh4lf\" (UniqueName: \"kubernetes.io/projected/cce10d6a-2e3b-4b14-bd65-02c4e73752ef-kube-api-access-mh4lf\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:06:09.998580 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.998550    2576 generic.go:356] "Generic (PLEG): container finished" podID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerID="115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05" exitCode=0
Jul 09 23:06:09.998753 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.998602    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"
Jul 09 23:06:09.998753 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.998631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" event={"ID":"cce10d6a-2e3b-4b14-bd65-02c4e73752ef","Type":"ContainerDied","Data":"115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05"}
Jul 09 23:06:09.998753 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.998687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6" event={"ID":"cce10d6a-2e3b-4b14-bd65-02c4e73752ef","Type":"ContainerDied","Data":"1abd80c5560b4640af6133874a9ffcd284bc58dd5af038601c4a8531f7c48d60"}
Jul 09 23:06:09.998753 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:09.998709    2576 scope.go:117] "RemoveContainer" containerID="115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05"
Jul 09 23:06:10.007490 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:10.007475    2576 scope.go:117] "RemoveContainer" containerID="101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c"
Jul 09 23:06:10.015014 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:10.014997    2576 scope.go:117] "RemoveContainer" containerID="115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05"
Jul 09 23:06:10.015286 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:06:10.015268    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05\": container with ID starting with 115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05 not found: ID does not exist" containerID="115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05"
Jul 09 23:06:10.015335 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:10.015295    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05"} err="failed to get container status \"115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05\": rpc error: code = NotFound desc = could not find container \"115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05\": container with ID starting with 115d2f45c7f9bc0102284d512e9da1ecc8abfd54859a5f1977831de7e18d3a05 not found: ID does not exist"
Jul 09 23:06:10.015335 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:10.015311    2576 scope.go:117] "RemoveContainer" containerID="101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c"
Jul 09 23:06:10.015545 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:06:10.015526    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c\": container with ID starting with 101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c not found: ID does not exist" containerID="101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c"
Jul 09 23:06:10.015586 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:10.015550    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c"} err="failed to get container status \"101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c\": rpc error: code = NotFound desc = could not find container \"101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c\": container with ID starting with 101a40bf1e4535ba9a586388b71cef83baaf8973372240f9e5516ffb5783954c not found: ID does not exist"
Jul 09 23:06:10.020178 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:10.020158    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"]
Jul 09 23:06:10.025866 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:10.025843    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4e2b27a4-openshift-default-7fb9856bbc-hfdf6"]
Jul 09 23:06:11.043167 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:06:11.043135    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" path="/var/lib/kubelet/pods/cce10d6a-2e3b-4b14-bd65-02c4e73752ef/volumes"
Jul 09 23:07:07.012225 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.012135    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"]
Jul 09 23:07:07.012656 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.012522    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy"
Jul 09 23:07:07.012656 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.012535    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy"
Jul 09 23:07:07.012656 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.012545    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy"
Jul 09 23:07:07.012656 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.012552    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy"
Jul 09 23:07:07.012656 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.012623    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy"
Jul 09 23:07:07.012656 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.012634    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce10d6a-2e3b-4b14-bd65-02c4e73752ef" containerName="istio-proxy"
Jul 09 23:07:07.014972 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.014952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.017892 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.017867    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ceba72-openshift-default-dockercfg-5h4x6\""
Jul 09 23:07:07.027790 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.027758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"]
Jul 09 23:07:07.164119 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5b2r\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-kube-api-access-j5b2r\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164119 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-certs\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164328 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-data\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164328 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17cf0c39-815f-4e17-8ef8-847a033c3413-istiod-ca-cert\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164328 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-socket\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164328 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-token\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164328 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-podinfo\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164484 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-credential-socket\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.164484 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.164416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-envoy\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.265925 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.265839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5b2r\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-kube-api-access-j5b2r\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.265925 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.265876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-certs\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.265925 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.265903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-data\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.265925 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.265922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17cf0c39-815f-4e17-8ef8-847a033c3413-istiod-ca-cert\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266248 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.265954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-socket\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266248 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.265974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-token\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266248 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-podinfo\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266248 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-credential-socket\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266248 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-envoy\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266561 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266304    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-certs\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266561 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-data\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266561 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266418    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-socket\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266733 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266577    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-credential-socket\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.266885 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.266864    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17cf0c39-815f-4e17-8ef8-847a033c3413-istiod-ca-cert\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.268236 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.268218    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-envoy\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.268465 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.268446    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-podinfo\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.273554 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.273523    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-token\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.273652 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.273588    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5b2r\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-kube-api-access-j5b2r\") pod \"e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") " pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.327012 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.326985    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:07.460750 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.460728    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"]
Jul 09 23:07:07.463263 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:07:07.463231    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17cf0c39_815f_4e17_8ef8_847a033c3413.slice/crio-4c31119eb31caf84f6c2495f238b5a8e624f2311d60af8ff16dd2327b5678fce WatchSource:0}: Error finding container 4c31119eb31caf84f6c2495f238b5a8e624f2311d60af8ff16dd2327b5678fce: Status 404 returned error can't find the container with id 4c31119eb31caf84f6c2495f238b5a8e624f2311d60af8ff16dd2327b5678fce
Jul 09 23:07:07.465921 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.465889    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:07:07.465989 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.465961    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:07:07.466036 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:07.465989    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:07:08.284469 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:08.284441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" event={"ID":"17cf0c39-815f-4e17-8ef8-847a033c3413","Type":"ContainerStarted","Data":"475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb"}
Jul 09 23:07:08.284848 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:08.284494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" event={"ID":"17cf0c39-815f-4e17-8ef8-847a033c3413","Type":"ContainerStarted","Data":"4c31119eb31caf84f6c2495f238b5a8e624f2311d60af8ff16dd2327b5678fce"}
Jul 09 23:07:08.308939 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:08.308882    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" podStartSLOduration=2.308863451 podStartE2EDuration="2.308863451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:07:08.307167236 +0000 UTC m=+2069.788990634" watchObservedRunningTime="2026-07-09 23:07:08.308863451 +0000 UTC m=+2069.790686836"
Jul 09 23:07:08.327271 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:08.327243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:08.332324 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:08.332300    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:09.289938 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:09.289909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:09.290761 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:09.290744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:24.291479 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.291445    2576 patch_prober.go:28] interesting pod/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 23:07:24.291919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.291499    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 23:07:24.371784 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.371754    2576 generic.go:356] "Generic (PLEG): container finished" podID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerID="475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb" exitCode=0
Jul 09 23:07:24.371950 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.371833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" event={"ID":"17cf0c39-815f-4e17-8ef8-847a033c3413","Type":"ContainerDied","Data":"475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb"}
Jul 09 23:07:24.372239 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.372224    2576 scope.go:117] "RemoveContainer" containerID="475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb"
Jul 09 23:07:24.373338 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.373308    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:07:24.373456 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.373390    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:07:24.373456 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:24.373437    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:07:25.378853 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:25.378817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" event={"ID":"17cf0c39-815f-4e17-8ef8-847a033c3413","Type":"ContainerStarted","Data":"5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0"}
Jul 09 23:07:26.328141 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:26.328103    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:26.328460 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:26.328263    2576 patch_prober.go:28] interesting pod/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 23:07:26.328460 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:26.328310    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 23:07:27.327743 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:27.327702    2576 patch_prober.go:28] interesting pod/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 23:07:27.328237 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:27.327804    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 23:07:28.328543 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:28.328124    2576 patch_prober.go:28] interesting pod/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 23:07:28.328543 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:28.328185    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 23:07:29.331764 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:29.331737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:29.332177 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:29.332091    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:29.332753 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:29.332738    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:07:40.129472 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:40.129446    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 23:07:40.135828 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:07:40.135805    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 23:09:08.862288 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:08.862256    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"]
Jul 09 23:09:08.862914 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:08.862474    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy" containerID="cri-o://5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0" gracePeriod=30
Jul 09 23:09:14.117071 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.117048    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:09:14.197040 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.196965    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-credential-socket\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197040 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197006    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-token\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197245 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197043    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-certs\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197245 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197074    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17cf0c39-815f-4e17-8ef8-847a033c3413-istiod-ca-cert\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197245 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197102    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-data\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197245 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197149    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-socket\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197245 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197173    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-envoy\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197510 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197254    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5b2r\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-kube-api-access-j5b2r\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197510 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197268    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:14.197510 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197282    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-podinfo\") pod \"17cf0c39-815f-4e17-8ef8-847a033c3413\" (UID: \"17cf0c39-815f-4e17-8ef8-847a033c3413\") "
Jul 09 23:09:14.197510 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197444    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:14.197719 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197555    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cf0c39-815f-4e17-8ef8-847a033c3413-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:09:14.197719 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197562    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.197719 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197601    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-credential-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.197931 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.197758    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:14.198134 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.198106    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-data" (OuterVolumeSpecName: "istio-data") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:14.199614 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.199595    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-token" (OuterVolumeSpecName: "istio-token") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:09:14.199769 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.199744    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-kube-api-access-j5b2r" (OuterVolumeSpecName: "kube-api-access-j5b2r") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "kube-api-access-j5b2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:09:14.199894 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.199770    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:14.199894 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.199770    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "17cf0c39-815f-4e17-8ef8-847a033c3413" (UID: "17cf0c39-815f-4e17-8ef8-847a033c3413"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 23:09:14.298384 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.298357    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-token\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.298384 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.298378    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17cf0c39-815f-4e17-8ef8-847a033c3413-istiod-ca-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.298384 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.298389    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-data\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.298652 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.298397    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-workload-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.298652 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.298406    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-envoy\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.298652 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.298416    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5b2r\" (UniqueName: \"kubernetes.io/projected/17cf0c39-815f-4e17-8ef8-847a033c3413-kube-api-access-j5b2r\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.298652 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.298424    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17cf0c39-815f-4e17-8ef8-847a033c3413-istio-podinfo\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:14.915899 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.915862    2576 generic.go:356] "Generic (PLEG): container finished" podID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerID="5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0" exitCode=0
Jul 09 23:09:14.916105 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.915919    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"
Jul 09 23:09:14.916105 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.915946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" event={"ID":"17cf0c39-815f-4e17-8ef8-847a033c3413","Type":"ContainerDied","Data":"5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0"}
Jul 09 23:09:14.916105 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.916010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk" event={"ID":"17cf0c39-815f-4e17-8ef8-847a033c3413","Type":"ContainerDied","Data":"4c31119eb31caf84f6c2495f238b5a8e624f2311d60af8ff16dd2327b5678fce"}
Jul 09 23:09:14.916105 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.916039    2576 scope.go:117] "RemoveContainer" containerID="5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0"
Jul 09 23:09:14.926115 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.926097    2576 scope.go:117] "RemoveContainer" containerID="475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb"
Jul 09 23:09:14.936024 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.936009    2576 scope.go:117] "RemoveContainer" containerID="5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0"
Jul 09 23:09:14.936306 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:09:14.936283    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0\": container with ID starting with 5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0 not found: ID does not exist" containerID="5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0"
Jul 09 23:09:14.936369 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.936309    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0"} err="failed to get container status \"5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0\": rpc error: code = NotFound desc = could not find container \"5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0\": container with ID starting with 5e410d9e44ac8ae1c55bd40261e6b07560f027ecc21c053b3b8b1748b020e6b0 not found: ID does not exist"
Jul 09 23:09:14.936369 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.936326    2576 scope.go:117] "RemoveContainer" containerID="475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb"
Jul 09 23:09:14.936578 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:09:14.936563    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb\": container with ID starting with 475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb not found: ID does not exist" containerID="475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb"
Jul 09 23:09:14.936626 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.936582    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb"} err="failed to get container status \"475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb\": rpc error: code = NotFound desc = could not find container \"475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb\": container with ID starting with 475f4894d20405b973acc1c0aba1b4a3b9d71eca7d20ea845ec7d2ba0c8ab4fb not found: ID does not exist"
Jul 09 23:09:14.940103 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.940083    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"]
Jul 09 23:09:14.943612 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:14.943592    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ceba72-openshift-default-5bffc75d59-qgtwk"]
Jul 09 23:09:15.045142 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:15.045111    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" path="/var/lib/kubelet/pods/17cf0c39-815f-4e17-8ef8-847a033c3413/volumes"
Jul 09 23:09:17.880866 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.880833    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"]
Jul 09 23:09:17.881378 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.881354    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy"
Jul 09 23:09:17.881378 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.881371    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy"
Jul 09 23:09:17.881534 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.881435    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy"
Jul 09 23:09:17.881534 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.881441    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy"
Jul 09 23:09:17.881643 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.881534    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy"
Jul 09 23:09:17.881643 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.881552    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17cf0c39-815f-4e17-8ef8-847a033c3413" containerName="istio-proxy"
Jul 09 23:09:17.884823 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.884804    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.887504 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.887481    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-669c32-openshift-default-dockercfg-njbnq\""
Jul 09 23:09:17.896321 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.896300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"]
Jul 09 23:09:17.933062 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-token\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933062 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-data\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933270 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-podinfo\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933270 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07732ddc-e894-4e0c-a793-c7ec199d2b34-istiod-ca-cert\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933270 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-envoy\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933270 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-socket\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933270 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-credential-socket\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933464 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcgr7\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-kube-api-access-pcgr7\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:17.933464 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:17.933326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-certs\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034279 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-token\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034279 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-data\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-podinfo\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07732ddc-e894-4e0c-a793-c7ec199d2b34-istiod-ca-cert\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-envoy\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-socket\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-credential-socket\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgr7\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-kube-api-access-pcgr7\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034874 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-certs\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034874 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-data\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.034874 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034754    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-socket\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.035041 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-certs\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.035041 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.034938    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-credential-socket\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.035239 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.035207    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07732ddc-e894-4e0c-a793-c7ec199d2b34-istiod-ca-cert\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.036666 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.036648    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-envoy\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.036959 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.036932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-podinfo\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.042421 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.042401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-token\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.042610 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.042590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgr7\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-kube-api-access-pcgr7\") pod \"e2e-api-b-669c32-openshift-default-567fb99787-pdfnz\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") " pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.196238 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.196167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:18.536881 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.536856    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"]
Jul 09 23:09:18.539054 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:09:18.539027    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07732ddc_e894_4e0c_a793_c7ec199d2b34.slice/crio-0affcc3aed9c31703b4ff52042874e2f4c6a085350f2d5cb436ce7c55807d0b8 WatchSource:0}: Error finding container 0affcc3aed9c31703b4ff52042874e2f4c6a085350f2d5cb436ce7c55807d0b8: Status 404 returned error can't find the container with id 0affcc3aed9c31703b4ff52042874e2f4c6a085350f2d5cb436ce7c55807d0b8
Jul 09 23:09:18.541548 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.541519    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:18.541616 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.541583    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:18.541616 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.541610    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:18.939738 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.939708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" event={"ID":"07732ddc-e894-4e0c-a793-c7ec199d2b34","Type":"ContainerStarted","Data":"b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38"}
Jul 09 23:09:18.940130 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.939758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" event={"ID":"07732ddc-e894-4e0c-a793-c7ec199d2b34","Type":"ContainerStarted","Data":"0affcc3aed9c31703b4ff52042874e2f4c6a085350f2d5cb436ce7c55807d0b8"}
Jul 09 23:09:18.958169 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:18.958122    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" podStartSLOduration=1.958104541 podStartE2EDuration="1.958104541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:09:18.957974057 +0000 UTC m=+2200.439797470" watchObservedRunningTime="2026-07-09 23:09:18.958104541 +0000 UTC m=+2200.439927940"
Jul 09 23:09:19.196764 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:19.196690    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:19.201580 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:19.201560    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:19.944241 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:19.944205    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:19.945374 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:19.945354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:35.585674 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:35.585627    2576 patch_prober.go:28] interesting pod/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:50646->10.133.0.54:15021: read: connection reset by peer" start-of-body=
Jul 09 23:09:35.586094 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:35.585688    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:50646->10.133.0.54:15021: read: connection reset by peer"
Jul 09 23:09:36.024043 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:36.023953    2576 generic.go:356] "Generic (PLEG): container finished" podID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerID="b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38" exitCode=0
Jul 09 23:09:36.024219 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:36.024033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" event={"ID":"07732ddc-e894-4e0c-a793-c7ec199d2b34","Type":"ContainerDied","Data":"b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38"}
Jul 09 23:09:36.024494 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:36.024475    2576 scope.go:117] "RemoveContainer" containerID="b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38"
Jul 09 23:09:36.025507 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:36.025483    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:36.025564 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:36.025547    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:36.025603 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:36.025575    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:37.034345 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:37.034302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" event={"ID":"07732ddc-e894-4e0c-a793-c7ec199d2b34","Type":"ContainerStarted","Data":"55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be"}
Jul 09 23:09:37.196403 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:37.196371    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:37.196597 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:37.196572    2576 patch_prober.go:28] interesting pod/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 09 23:09:37.196677 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:37.196631    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 09 23:09:38.197591 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:38.197553    2576 patch_prober.go:28] interesting pod/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 09 23:09:38.198016 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:38.197606    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 09 23:09:39.196966 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:39.196940    2576 patch_prober.go:28] interesting pod/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 09 23:09:39.197063 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:39.196992    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 09 23:09:40.196793 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:40.196736    2576 patch_prober.go:28] interesting pod/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 09 23:09:40.197252 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:40.196824    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 09 23:09:41.200148 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:41.200116    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:41.200733 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:41.200467    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:41.201206 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:41.201187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:47.053259 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:47.053222    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"]
Jul 09 23:09:47.053794 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:47.053444    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy" containerID="cri-o://55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be" gracePeriod=30
Jul 09 23:09:52.312769 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.312745    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:52.363899 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.363841    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-token\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.363899 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.363878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-data\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364088 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.363906    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcgr7\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-kube-api-access-pcgr7\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364088 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.363962    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-podinfo\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364088 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.363986    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-credential-socket\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364088 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364019    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07732ddc-e894-4e0c-a793-c7ec199d2b34-istiod-ca-cert\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364088 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364043    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-envoy\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364088 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364063    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-certs\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364396 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-socket\") pod \"07732ddc-e894-4e0c-a793-c7ec199d2b34\" (UID: \"07732ddc-e894-4e0c-a793-c7ec199d2b34\") "
Jul 09 23:09:52.364539 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364500    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07732ddc-e894-4e0c-a793-c7ec199d2b34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:09:52.364700 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364628    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:52.364884 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364809    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-data" (OuterVolumeSpecName: "istio-data") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:52.364884 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364823    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:52.365017 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.364945    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:52.366293 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.366268    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 23:09:52.367031 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.367007    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-token" (OuterVolumeSpecName: "istio-token") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:09:52.367138 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.367037    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:09:52.367138 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.367038    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-kube-api-access-pcgr7" (OuterVolumeSpecName: "kube-api-access-pcgr7") pod "07732ddc-e894-4e0c-a793-c7ec199d2b34" (UID: "07732ddc-e894-4e0c-a793-c7ec199d2b34"). InnerVolumeSpecName "kube-api-access-pcgr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:09:52.465357 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465328    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-token\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465357 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465351    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-data\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465357 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465361    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcgr7\" (UniqueName: \"kubernetes.io/projected/07732ddc-e894-4e0c-a793-c7ec199d2b34-kube-api-access-pcgr7\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465573 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465371    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-podinfo\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465573 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465380    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-credential-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465573 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465388    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07732ddc-e894-4e0c-a793-c7ec199d2b34-istiod-ca-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465573 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465396    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-istio-envoy\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465573 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465404    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:52.465573 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:52.465411    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07732ddc-e894-4e0c-a793-c7ec199d2b34-workload-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:09:53.122053 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.122014    2576 generic.go:356] "Generic (PLEG): container finished" podID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerID="55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be" exitCode=0
Jul 09 23:09:53.122239 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.122063    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"
Jul 09 23:09:53.122239 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.122069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" event={"ID":"07732ddc-e894-4e0c-a793-c7ec199d2b34","Type":"ContainerDied","Data":"55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be"}
Jul 09 23:09:53.122239 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.122174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz" event={"ID":"07732ddc-e894-4e0c-a793-c7ec199d2b34","Type":"ContainerDied","Data":"0affcc3aed9c31703b4ff52042874e2f4c6a085350f2d5cb436ce7c55807d0b8"}
Jul 09 23:09:53.122239 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.122196    2576 scope.go:117] "RemoveContainer" containerID="55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be"
Jul 09 23:09:53.137656 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.137626    2576 scope.go:117] "RemoveContainer" containerID="b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38"
Jul 09 23:09:53.142037 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.142013    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"]
Jul 09 23:09:53.145921 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.145898    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-669c32-openshift-default-567fb99787-pdfnz"]
Jul 09 23:09:53.146558 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.146546    2576 scope.go:117] "RemoveContainer" containerID="55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be"
Jul 09 23:09:53.146845 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:09:53.146828    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be\": container with ID starting with 55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be not found: ID does not exist" containerID="55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be"
Jul 09 23:09:53.146897 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.146852    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be"} err="failed to get container status \"55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be\": rpc error: code = NotFound desc = could not find container \"55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be\": container with ID starting with 55fe34cc8c1939bd2c21be6dd634a65908f4b525418f0e8e9917394ac97e48be not found: ID does not exist"
Jul 09 23:09:53.146897 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.146869    2576 scope.go:117] "RemoveContainer" containerID="b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38"
Jul 09 23:09:53.147130 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:09:53.147111    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38\": container with ID starting with b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38 not found: ID does not exist" containerID="b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38"
Jul 09 23:09:53.147184 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:53.147135    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38"} err="failed to get container status \"b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38\": rpc error: code = NotFound desc = could not find container \"b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38\": container with ID starting with b49aaf3f6eb00ad91f53476f1c3983f7cf7db5799193d5c6e068b4dde8c50a38 not found: ID does not exist"
Jul 09 23:09:55.042702 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.042672    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" path="/var/lib/kubelet/pods/07732ddc-e894-4e0c-a793-c7ec199d2b34/volumes"
Jul 09 23:09:55.962267 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.962237    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"]
Jul 09 23:09:55.962666 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.962652    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy"
Jul 09 23:09:55.962718 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.962668    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy"
Jul 09 23:09:55.962718 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.962682    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy"
Jul 09 23:09:55.962718 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.962688    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy"
Jul 09 23:09:55.962862 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.962762    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy"
Jul 09 23:09:55.962862 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.962796    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07732ddc-e894-4e0c-a793-c7ec199d2b34" containerName="istio-proxy"
Jul 09 23:09:55.966911 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.966892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.969496 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.969470    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-57ed9c-openshift-default-dockercfg-9wcw8\""
Jul 09 23:09:55.977410 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.977390    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"]
Jul 09 23:09:55.994706 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.994679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51045334-a922-44b1-a98b-73cebd7e5671-istio-podinfo\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.994846 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.994716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-envoy\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.994846 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.994753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89gm\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-kube-api-access-n89gm\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.994846 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.994815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-credential-socket\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.995015 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.994852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-socket\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.995015 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.994883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51045334-a922-44b1-a98b-73cebd7e5671-istiod-ca-cert\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.995015 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.994935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-certs\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.995144 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.995021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-istio-token\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:55.995144 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:55.995066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-data\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095494 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51045334-a922-44b1-a98b-73cebd7e5671-istio-podinfo\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095494 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-envoy\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89gm\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-kube-api-access-n89gm\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-credential-socket\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-socket\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51045334-a922-44b1-a98b-73cebd7e5671-istiod-ca-cert\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-certs\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-istio-token\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.095997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.095708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-data\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.096368 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.096027    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-credential-socket\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.096368 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.096049    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-socket\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.096368 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.096284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-certs\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.096368 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.096294    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-data\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.096520 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.096396    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51045334-a922-44b1-a98b-73cebd7e5671-istiod-ca-cert\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.098041 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.098018    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51045334-a922-44b1-a98b-73cebd7e5671-istio-podinfo\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.098041 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.098036    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-envoy\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.105403 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.105380    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-istio-token\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.105771 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.105753    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89gm\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-kube-api-access-n89gm\") pod \"e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") " pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.277903 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.277814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:56.416043 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.415154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"]
Jul 09 23:09:56.416986 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:09:56.416957    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51045334_a922_44b1_a98b_73cebd7e5671.slice/crio-3a1e669abcffee8f2f9752a33ec554531919ae41157ef340771e83657603c644 WatchSource:0}: Error finding container 3a1e669abcffee8f2f9752a33ec554531919ae41157ef340771e83657603c644: Status 404 returned error can't find the container with id 3a1e669abcffee8f2f9752a33ec554531919ae41157ef340771e83657603c644
Jul 09 23:09:56.419729 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.419698    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:56.419856 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.419762    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:56.419856 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:56.419819    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:09:57.146617 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:57.146574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" event={"ID":"51045334-a922-44b1-a98b-73cebd7e5671","Type":"ContainerStarted","Data":"f60c6e9918c1bd6011b03666405c09ebe6289c71e22137a9e1caefe12276badb"}
Jul 09 23:09:57.147070 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:57.146640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" event={"ID":"51045334-a922-44b1-a98b-73cebd7e5671","Type":"ContainerStarted","Data":"3a1e669abcffee8f2f9752a33ec554531919ae41157ef340771e83657603c644"}
Jul 09 23:09:57.167042 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:57.167000    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" podStartSLOduration=2.166985322 podStartE2EDuration="2.166985322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:09:57.164645292 +0000 UTC m=+2238.646468679" watchObservedRunningTime="2026-07-09 23:09:57.166985322 +0000 UTC m=+2238.648808708"
Jul 09 23:09:57.277973 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:57.277938    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:57.283291 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:57.283270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:58.152344 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:58.152313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:09:58.153393 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:09:58.153370    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:10:13.516266 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:13.516207    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:42982->10.133.0.55:15021: read: connection reset by peer" start-of-body=
Jul 09 23:10:13.516687 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:13.516276    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:42982->10.133.0.55:15021: read: connection reset by peer"
Jul 09 23:10:14.233028 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:14.232994    2576 generic.go:356] "Generic (PLEG): container finished" podID="51045334-a922-44b1-a98b-73cebd7e5671" containerID="f60c6e9918c1bd6011b03666405c09ebe6289c71e22137a9e1caefe12276badb" exitCode=0
Jul 09 23:10:14.233191 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:14.233069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" event={"ID":"51045334-a922-44b1-a98b-73cebd7e5671","Type":"ContainerDied","Data":"f60c6e9918c1bd6011b03666405c09ebe6289c71e22137a9e1caefe12276badb"}
Jul 09 23:10:14.233480 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:14.233464    2576 scope.go:117] "RemoveContainer" containerID="f60c6e9918c1bd6011b03666405c09ebe6289c71e22137a9e1caefe12276badb"
Jul 09 23:10:14.234512 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:14.234486    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:10:14.234578 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:14.234549    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:10:14.234614 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:14.234584    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 23:10:15.243859 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:15.243809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" event={"ID":"51045334-a922-44b1-a98b-73cebd7e5671","Type":"ContainerStarted","Data":"03db013900f5b5fc3d860c35608db2126b9674478d39268391073d5ed5cd98eb"}
Jul 09 23:10:15.278470 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:15.278442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:10:15.278665 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:15.278629    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 09 23:10:15.278749 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:15.278717    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 09 23:10:16.278366 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:16.278336    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 09 23:10:16.278739 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:16.278393    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 09 23:10:17.279010 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:17.278981    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 09 23:10:17.279456 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:17.279036    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 09 23:10:18.278914 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:18.278883    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 09 23:10:18.279086 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:18.278933    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 09 23:10:19.282407 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:19.282380    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:10:19.282858 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:19.282721    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:10:19.283330 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:10:19.283313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:12:40.160025 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:12:40.159997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 23:12:40.167038 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:12:40.167017    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sj8p9_7b8509ee-63de-4b12-876d-c270428eba72/ovn-acl-logging/0.log"
Jul 09 23:13:03.179838 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.179730    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"]
Jul 09 23:13:03.182734 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.182713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.185480 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.185453    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"kube-root-ca.crt\""
Jul 09 23:13:03.186999 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.186977    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"default-dockercfg-9xdfj\""
Jul 09 23:13:03.187113 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.187025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"openshift-service-ca.crt\""
Jul 09 23:13:03.187113 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.187043    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-566ef9\"/\"sub-test-model-566ef9-kserve-self-signed-certs\""
Jul 09 23:13:03.192744 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.192719    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"]
Jul 09 23:13:03.273692 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.273657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-model-cache\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.273935 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.273716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-dshm\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.273935 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.273742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-home\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.273935 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.273765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tls-certs\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.273935 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.273849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7c8w\" (UniqueName: \"kubernetes.io/projected/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-kube-api-access-l7c8w\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.273935 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.273910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tmp-dir\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.375237 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tmp-dir\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.375420 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-model-cache\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.375420 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-dshm\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.375541 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-home\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.375541 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tls-certs\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.375541 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7c8w\" (UniqueName: \"kubernetes.io/projected/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-kube-api-access-l7c8w\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.375866 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-home\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.376019 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.375998    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tmp-dir\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.376210 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.376190    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-model-cache\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.377590 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.377569    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-dshm\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.378072 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.378053    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tls-certs\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.383937 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.383912    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7c8w\" (UniqueName: \"kubernetes.io/projected/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-kube-api-access-l7c8w\") pod \"sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") " pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.494534 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.494446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:03.624492 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:03.624465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"]
Jul 09 23:13:03.626163 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:13:03.626135    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod770eb368_c74a_4b72_9fb8_e9d7cc2adc17.slice/crio-511289e265c5d468493a528fb8fb21798beb6f6c5f7aea82521dbd6168847845 WatchSource:0}: Error finding container 511289e265c5d468493a528fb8fb21798beb6f6c5f7aea82521dbd6168847845: Status 404 returned error can't find the container with id 511289e265c5d468493a528fb8fb21798beb6f6c5f7aea82521dbd6168847845
Jul 09 23:13:04.061148 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:04.061116    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2" event={"ID":"770eb368-c74a-4b72-9fb8-e9d7cc2adc17","Type":"ContainerStarted","Data":"24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11"}
Jul 09 23:13:04.061330 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:04.061158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2" event={"ID":"770eb368-c74a-4b72-9fb8-e9d7cc2adc17","Type":"ContainerStarted","Data":"511289e265c5d468493a528fb8fb21798beb6f6c5f7aea82521dbd6168847845"}
Jul 09 23:13:04.082946 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:04.082903    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2" podStartSLOduration=1.082889114 podStartE2EDuration="1.082889114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:13:04.081957645 +0000 UTC m=+2425.563781035" watchObservedRunningTime="2026-07-09 23:13:04.082889114 +0000 UTC m=+2425.564712498"
Jul 09 23:13:13.495168 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:13.495135    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:13.495645 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:13.495181    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:13.507601 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:13.507578    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:13:14.117907 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:13:14.117878    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:14:05.608408 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:05.608372    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"]
Jul 09 23:14:20.630308 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.630267    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2" podUID="770eb368-c74a-4b72-9fb8-e9d7cc2adc17" containerName="main" containerID="cri-o://24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11" gracePeriod=45
Jul 09 23:14:20.889143 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.889085    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:14:20.992353 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992325    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-model-cache\") pod \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") "
Jul 09 23:14:20.992535 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992369    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tls-certs\") pod \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") "
Jul 09 23:14:20.992535 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-home\") pod \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") "
Jul 09 23:14:20.992535 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7c8w\" (UniqueName: \"kubernetes.io/projected/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-kube-api-access-l7c8w\") pod \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") "
Jul 09 23:14:20.992535 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-dshm\") pod \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") "
Jul 09 23:14:20.992535 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992527    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tmp-dir\") pod \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\" (UID: \"770eb368-c74a-4b72-9fb8-e9d7cc2adc17\") "
Jul 09 23:14:20.992842 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992648    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-model-cache" (OuterVolumeSpecName: "model-cache") pod "770eb368-c74a-4b72-9fb8-e9d7cc2adc17" (UID: "770eb368-c74a-4b72-9fb8-e9d7cc2adc17"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:20.992902 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992837    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-home" (OuterVolumeSpecName: "home") pod "770eb368-c74a-4b72-9fb8-e9d7cc2adc17" (UID: "770eb368-c74a-4b72-9fb8-e9d7cc2adc17"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:20.992902 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992852    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "770eb368-c74a-4b72-9fb8-e9d7cc2adc17" (UID: "770eb368-c74a-4b72-9fb8-e9d7cc2adc17"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:20.993013 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.992985    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-model-cache\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:14:20.994740 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.994714    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "770eb368-c74a-4b72-9fb8-e9d7cc2adc17" (UID: "770eb368-c74a-4b72-9fb8-e9d7cc2adc17"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:14:20.994880 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.994717    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-dshm" (OuterVolumeSpecName: "dshm") pod "770eb368-c74a-4b72-9fb8-e9d7cc2adc17" (UID: "770eb368-c74a-4b72-9fb8-e9d7cc2adc17"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:14:20.994880 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:20.994798    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-kube-api-access-l7c8w" (OuterVolumeSpecName: "kube-api-access-l7c8w") pod "770eb368-c74a-4b72-9fb8-e9d7cc2adc17" (UID: "770eb368-c74a-4b72-9fb8-e9d7cc2adc17"). InnerVolumeSpecName "kube-api-access-l7c8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:14:21.093863 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.093831    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tls-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.093863 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.093862    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-home\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.094021 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.093876    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7c8w\" (UniqueName: \"kubernetes.io/projected/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-kube-api-access-l7c8w\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.094021 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.093890    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-dshm\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.094021 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.093905    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770eb368-c74a-4b72-9fb8-e9d7cc2adc17-tmp-dir\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:14:21.436259 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.436226    2576 generic.go:356] "Generic (PLEG): container finished" podID="770eb368-c74a-4b72-9fb8-e9d7cc2adc17" containerID="24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11" exitCode=0
Jul 09 23:14:21.436420 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.436265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2" event={"ID":"770eb368-c74a-4b72-9fb8-e9d7cc2adc17","Type":"ContainerDied","Data":"24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11"}
Jul 09 23:14:21.436420 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.436280    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"
Jul 09 23:14:21.436420 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.436296    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2" event={"ID":"770eb368-c74a-4b72-9fb8-e9d7cc2adc17","Type":"ContainerDied","Data":"511289e265c5d468493a528fb8fb21798beb6f6c5f7aea82521dbd6168847845"}
Jul 09 23:14:21.436420 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.436312    2576 scope.go:117] "RemoveContainer" containerID="24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11"
Jul 09 23:14:21.444837 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.444819    2576 scope.go:117] "RemoveContainer" containerID="24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11"
Jul 09 23:14:21.445107 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:14:21.445082    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11\": container with ID starting with 24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11 not found: ID does not exist" containerID="24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11"
Jul 09 23:14:21.445165 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.445105    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11"} err="failed to get container status \"24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11\": rpc error: code = NotFound desc = could not find container \"24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11\": container with ID starting with 24d6556d20890cf3070df872e1bab67872684752ef20f882ac23aae65e650c11 not found: ID does not exist"
Jul 09 23:14:21.453483 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.453462    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"]
Jul 09 23:14:21.455224 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:21.455203    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-566ef9/sub-test-model-566ef9-kserve-cd7f4fbcc-s8gc2"]
Jul 09 23:14:23.043308 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:14:23.043277    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="770eb368-c74a-4b72-9fb8-e9d7cc2adc17" path="/var/lib/kubelet/pods/770eb368-c74a-4b72-9fb8-e9d7cc2adc17/volumes"
Jul 09 23:15:00.143802 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.143755    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"]
Jul 09 23:15:00.144327 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.144246    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="770eb368-c74a-4b72-9fb8-e9d7cc2adc17" containerName="main"
Jul 09 23:15:00.144327 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.144265    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="770eb368-c74a-4b72-9fb8-e9d7cc2adc17" containerName="main"
Jul 09 23:15:00.144457 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.144406    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="770eb368-c74a-4b72-9fb8-e9d7cc2adc17" containerName="main"
Jul 09 23:15:00.147073 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.147049    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"]
Jul 09 23:15:00.147207 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.147172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"
Jul 09 23:15:00.149471 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.149451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"
Jul 09 23:15:00.149812 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.149791    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hn6dj\""
Jul 09 23:15:00.157576 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.157518    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"]
Jul 09 23:15:00.160126 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.160104    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"]
Jul 09 23:15:00.160472 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.160455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"
Jul 09 23:15:00.169054 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.169036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"
Jul 09 23:15:00.306409 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.306331    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"]
Jul 09 23:15:00.310031 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:15:00.310003    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fe11fd_3aad_45fc_9233_27c2ab8cc33e.slice/crio-bb11c845d5cd253f0273faecc2e53d00ed5888be09e9fb2c3e0618a4ab34bd09 WatchSource:0}: Error finding container bb11c845d5cd253f0273faecc2e53d00ed5888be09e9fb2c3e0618a4ab34bd09: Status 404 returned error can't find the container with id bb11c845d5cd253f0273faecc2e53d00ed5888be09e9fb2c3e0618a4ab34bd09
Jul 09 23:15:00.312762 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.312744    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 23:15:00.542288 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.542265    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"]
Jul 09 23:15:00.544169 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:15:00.544130    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafa3ab3_de16_43b1_890a_e35b1fa1db00.slice/crio-2eb43071ccd210f8f5768dfc5097059f46dc4abfd8c52521a49280edcf357689 WatchSource:0}: Error finding container 2eb43071ccd210f8f5768dfc5097059f46dc4abfd8c52521a49280edcf357689: Status 404 returned error can't find the container with id 2eb43071ccd210f8f5768dfc5097059f46dc4abfd8c52521a49280edcf357689
Jul 09 23:15:00.632002 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.631969    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7" event={"ID":"fafa3ab3-de16-43b1-890a-e35b1fa1db00","Type":"ContainerStarted","Data":"2eb43071ccd210f8f5768dfc5097059f46dc4abfd8c52521a49280edcf357689"}
Jul 09 23:15:00.633258 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:00.633232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s" event={"ID":"01fe11fd-3aad-45fc-9233-27c2ab8cc33e","Type":"ContainerStarted","Data":"bb11c845d5cd253f0273faecc2e53d00ed5888be09e9fb2c3e0618a4ab34bd09"}
Jul 09 23:15:03.653855 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:03.653809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7" event={"ID":"fafa3ab3-de16-43b1-890a-e35b1fa1db00","Type":"ContainerStarted","Data":"67cbaf42393899c4c12e02e65549176c2544436d4239d762876f735b97b683a9"}
Jul 09 23:15:03.655392 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:03.655368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s" event={"ID":"01fe11fd-3aad-45fc-9233-27c2ab8cc33e","Type":"ContainerStarted","Data":"c2d6ae6249dd0b7e403094503feaed34a627da0e9bd8b948a56a501a0d231ccc"}
Jul 09 23:15:03.668658 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:03.668616    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7" podStartSLOduration=1.620298909 podStartE2EDuration="3.668601457s" totalImagesPullingTime="2.048302548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:15:03.667506689 +0000 UTC m=+2545.149330091" watchObservedRunningTime="2026-07-09 23:15:03.668601457 +0000 UTC m=+2545.150424843"
Jul 09 23:15:03.682683 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:03.682640    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s" podStartSLOduration=1.397038115 podStartE2EDuration="3.682626372s" totalImagesPullingTime="2.285588257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:15:03.680189513 +0000 UTC m=+2545.162012899" watchObservedRunningTime="2026-07-09 23:15:03.682626372 +0000 UTC m=+2545.164449757"
Jul 09 23:15:40.146262 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.146230    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7269-140015660122416"]
Jul 09 23:15:40.149999 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.149979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:40.153448 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.153422    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-gqbhf\""
Jul 09 23:15:40.155895 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.155875    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015660122416"]
Jul 09 23:15:40.315019 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.314983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czpk\" (UniqueName: \"kubernetes.io/projected/c344366c-547c-4a81-91c2-4b63e0e94b36-kube-api-access-6czpk\") pod \"test-curl-7269-140015660122416\" (UID: \"c344366c-547c-4a81-91c2-4b63e0e94b36\") " pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:40.416457 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.416376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czpk\" (UniqueName: \"kubernetes.io/projected/c344366c-547c-4a81-91c2-4b63e0e94b36-kube-api-access-6czpk\") pod \"test-curl-7269-140015660122416\" (UID: \"c344366c-547c-4a81-91c2-4b63e0e94b36\") " pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:40.424766 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.424741    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czpk\" (UniqueName: \"kubernetes.io/projected/c344366c-547c-4a81-91c2-4b63e0e94b36-kube-api-access-6czpk\") pod \"test-curl-7269-140015660122416\" (UID: \"c344366c-547c-4a81-91c2-4b63e0e94b36\") " pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:40.460545 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.460522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:40.587669 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.587643    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015660122416"]
Jul 09 23:15:40.589573 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:15:40.589544    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc344366c_547c_4a81_91c2_4b63e0e94b36.slice/crio-c2344c9e00004b98066eae8ac06189d367b4fbac812c00edd486ae9974dedd35 WatchSource:0}: Error finding container c2344c9e00004b98066eae8ac06189d367b4fbac812c00edd486ae9974dedd35: Status 404 returned error can't find the container with id c2344c9e00004b98066eae8ac06189d367b4fbac812c00edd486ae9974dedd35
Jul 09 23:15:40.841275 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:40.841240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015660122416" event={"ID":"c344366c-547c-4a81-91c2-4b63e0e94b36","Type":"ContainerStarted","Data":"c2344c9e00004b98066eae8ac06189d367b4fbac812c00edd486ae9974dedd35"}
Jul 09 23:15:41.848110 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:41.848080    2576 generic.go:356] "Generic (PLEG): container finished" podID="c344366c-547c-4a81-91c2-4b63e0e94b36" containerID="21e7de3d07006aa50d29f167ebeaa49e1dddc63ec739ed046b826e7ec6c5b34a" exitCode=0
Jul 09 23:15:41.848500 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:41.848122    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015660122416" event={"ID":"c344366c-547c-4a81-91c2-4b63e0e94b36","Type":"ContainerDied","Data":"21e7de3d07006aa50d29f167ebeaa49e1dddc63ec739ed046b826e7ec6c5b34a"}
Jul 09 23:15:42.994890 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:42.994865    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:43.033484 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.033444    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7269-140015660122416_c344366c-547c-4a81-91c2-4b63e0e94b36/test-curl-7269-140015660122416/0.log"
Jul 09 23:15:43.038812 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.038790    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6czpk\" (UniqueName: \"kubernetes.io/projected/c344366c-547c-4a81-91c2-4b63e0e94b36-kube-api-access-6czpk\") pod \"c344366c-547c-4a81-91c2-4b63e0e94b36\" (UID: \"c344366c-547c-4a81-91c2-4b63e0e94b36\") "
Jul 09 23:15:43.040911 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.040884    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c344366c-547c-4a81-91c2-4b63e0e94b36-kube-api-access-6czpk" (OuterVolumeSpecName: "kube-api-access-6czpk") pod "c344366c-547c-4a81-91c2-4b63e0e94b36" (UID: "c344366c-547c-4a81-91c2-4b63e0e94b36"). InnerVolumeSpecName "kube-api-access-6czpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:43.061197 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.061175    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7269-140015660122416"]
Jul 09 23:15:43.065103 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.065082    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7269-140015660122416"]
Jul 09 23:15:43.139840 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.139738    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6czpk\" (UniqueName: \"kubernetes.io/projected/c344366c-547c-4a81-91c2-4b63e0e94b36-kube-api-access-6czpk\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:15:43.191029 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.191001    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7269-140015660123824"]
Jul 09 23:15:43.191389 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.191377    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c344366c-547c-4a81-91c2-4b63e0e94b36" containerName="test-curl-7269-140015660122416"
Jul 09 23:15:43.191441 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.191390    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c344366c-547c-4a81-91c2-4b63e0e94b36" containerName="test-curl-7269-140015660122416"
Jul 09 23:15:43.191477 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.191461    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c344366c-547c-4a81-91c2-4b63e0e94b36" containerName="test-curl-7269-140015660122416"
Jul 09 23:15:43.193488 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.193473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:43.200854 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.200832    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015660123824"]
Jul 09 23:15:43.240091 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.240064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4lch\" (UniqueName: \"kubernetes.io/projected/50577369-24b4-4ea7-ab9e-1b4a16135c29-kube-api-access-g4lch\") pod \"test-curl-7269-140015660123824\" (UID: \"50577369-24b4-4ea7-ab9e-1b4a16135c29\") " pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:43.341406 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.341375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4lch\" (UniqueName: \"kubernetes.io/projected/50577369-24b4-4ea7-ab9e-1b4a16135c29-kube-api-access-g4lch\") pod \"test-curl-7269-140015660123824\" (UID: \"50577369-24b4-4ea7-ab9e-1b4a16135c29\") " pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:43.349729 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.349697    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4lch\" (UniqueName: \"kubernetes.io/projected/50577369-24b4-4ea7-ab9e-1b4a16135c29-kube-api-access-g4lch\") pod \"test-curl-7269-140015660123824\" (UID: \"50577369-24b4-4ea7-ab9e-1b4a16135c29\") " pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:43.503463 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.503385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:43.634209 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.634183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015660123824"]
Jul 09 23:15:43.635264 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:15:43.635230    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50577369_24b4_4ea7_ab9e_1b4a16135c29.slice/crio-d4dec6662bb03d2c11ec30dafd7efd30726212beb756e3b8bdcd1a7bdb68c176 WatchSource:0}: Error finding container d4dec6662bb03d2c11ec30dafd7efd30726212beb756e3b8bdcd1a7bdb68c176: Status 404 returned error can't find the container with id d4dec6662bb03d2c11ec30dafd7efd30726212beb756e3b8bdcd1a7bdb68c176
Jul 09 23:15:43.861962 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.861923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015660123824" event={"ID":"50577369-24b4-4ea7-ab9e-1b4a16135c29","Type":"ContainerStarted","Data":"d4dec6662bb03d2c11ec30dafd7efd30726212beb756e3b8bdcd1a7bdb68c176"}
Jul 09 23:15:43.863127 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.863106    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:43.863254 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:43.863140    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2344c9e00004b98066eae8ac06189d367b4fbac812c00edd486ae9974dedd35"
Jul 09 23:15:43.868185 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:15:43.868162    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015660122416\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="c344366c-547c-4a81-91c2-4b63e0e94b36" pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:44.870149 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:44.870116    2576 generic.go:356] "Generic (PLEG): container finished" podID="50577369-24b4-4ea7-ab9e-1b4a16135c29" containerID="76dc2ddeb673c84a12392aade8e0743663b48b07c686d84db0cdbde29986cd25" exitCode=0
Jul 09 23:15:44.870564 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:44.870211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015660123824" event={"ID":"50577369-24b4-4ea7-ab9e-1b4a16135c29","Type":"ContainerDied","Data":"76dc2ddeb673c84a12392aade8e0743663b48b07c686d84db0cdbde29986cd25"}
Jul 09 23:15:44.872804 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:15:44.872768    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015660122416\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="c344366c-547c-4a81-91c2-4b63e0e94b36" pod="openshift-ingress/test-curl-7269-140015660122416"
Jul 09 23:15:45.043574 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:45.043544    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c344366c-547c-4a81-91c2-4b63e0e94b36" path="/var/lib/kubelet/pods/c344366c-547c-4a81-91c2-4b63e0e94b36/volumes"
Jul 09 23:15:46.027351 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.027327    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:46.048353 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.048299    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7269-140015660123824_50577369-24b4-4ea7-ab9e-1b4a16135c29/test-curl-7269-140015660123824/0.log"
Jul 09 23:15:46.068708 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.068681    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4lch\" (UniqueName: \"kubernetes.io/projected/50577369-24b4-4ea7-ab9e-1b4a16135c29-kube-api-access-g4lch\") pod \"50577369-24b4-4ea7-ab9e-1b4a16135c29\" (UID: \"50577369-24b4-4ea7-ab9e-1b4a16135c29\") "
Jul 09 23:15:46.070832 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.070801    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50577369-24b4-4ea7-ab9e-1b4a16135c29-kube-api-access-g4lch" (OuterVolumeSpecName: "kube-api-access-g4lch") pod "50577369-24b4-4ea7-ab9e-1b4a16135c29" (UID: "50577369-24b4-4ea7-ab9e-1b4a16135c29"). InnerVolumeSpecName "kube-api-access-g4lch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:46.074515 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.074493    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7269-140015660123824"]
Jul 09 23:15:46.079082 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.079062    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7269-140015660123824"]
Jul 09 23:15:46.170401 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.170319    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4lch\" (UniqueName: \"kubernetes.io/projected/50577369-24b4-4ea7-ab9e-1b4a16135c29-kube-api-access-g4lch\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:15:46.880945 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.880919    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:46.881132 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:46.880952    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4dec6662bb03d2c11ec30dafd7efd30726212beb756e3b8bdcd1a7bdb68c176"
Jul 09 23:15:46.890920 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:15:46.890889    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015660123824\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="50577369-24b4-4ea7-ab9e-1b4a16135c29" pod="openshift-ingress/test-curl-7269-140015660123824"
Jul 09 23:15:47.043434 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:47.043403    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50577369-24b4-4ea7-ab9e-1b4a16135c29" path="/var/lib/kubelet/pods/50577369-24b4-4ea7-ab9e-1b4a16135c29/volumes"
Jul 09 23:15:52.127606 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.127572    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:52.128177 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.128156    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50577369-24b4-4ea7-ab9e-1b4a16135c29" containerName="test-curl-7269-140015660123824"
Jul 09 23:15:52.128262 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.128180    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50577369-24b4-4ea7-ab9e-1b4a16135c29" containerName="test-curl-7269-140015660123824"
Jul 09 23:15:52.128317 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.128286    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50577369-24b4-4ea7-ab9e-1b4a16135c29" containerName="test-curl-7269-140015660123824"
Jul 09 23:15:52.131222 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.131201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:52.134217 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.134195    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-gqbhf\""
Jul 09 23:15:52.136479 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.136457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:52.223891 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.223850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5j9\" (UniqueName: \"kubernetes.io/projected/c75282b5-45ac-44e9-8c6c-4bb2982c2556-kube-api-access-9k5j9\") pod \"test-curl-7269-140015658421104\" (UID: \"c75282b5-45ac-44e9-8c6c-4bb2982c2556\") " pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:52.325179 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.325151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5j9\" (UniqueName: \"kubernetes.io/projected/c75282b5-45ac-44e9-8c6c-4bb2982c2556-kube-api-access-9k5j9\") pod \"test-curl-7269-140015658421104\" (UID: \"c75282b5-45ac-44e9-8c6c-4bb2982c2556\") " pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:52.333269 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.333241    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5j9\" (UniqueName: \"kubernetes.io/projected/c75282b5-45ac-44e9-8c6c-4bb2982c2556-kube-api-access-9k5j9\") pod \"test-curl-7269-140015658421104\" (UID: \"c75282b5-45ac-44e9-8c6c-4bb2982c2556\") " pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:52.440981 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.440893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:52.575018 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.574995    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:52.576831 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:15:52.576805    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc75282b5_45ac_44e9_8c6c_4bb2982c2556.slice/crio-0cf000a4d6af0b2271c690f9898790ce992cd030b30571eadbb7dfbc297b98df WatchSource:0}: Error finding container 0cf000a4d6af0b2271c690f9898790ce992cd030b30571eadbb7dfbc297b98df: Status 404 returned error can't find the container with id 0cf000a4d6af0b2271c690f9898790ce992cd030b30571eadbb7dfbc297b98df
Jul 09 23:15:52.912392 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:52.912363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658421104" event={"ID":"c75282b5-45ac-44e9-8c6c-4bb2982c2556","Type":"ContainerStarted","Data":"0cf000a4d6af0b2271c690f9898790ce992cd030b30571eadbb7dfbc297b98df"}
Jul 09 23:15:53.919463 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:53.919429    2576 generic.go:356] "Generic (PLEG): container finished" podID="c75282b5-45ac-44e9-8c6c-4bb2982c2556" containerID="0892989dfc28099a5c94e4567802e78cd045f1994f61d3ac134121c70afc5194" exitCode=0
Jul 09 23:15:53.919854 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:53.919511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7269-140015658421104" event={"ID":"c75282b5-45ac-44e9-8c6c-4bb2982c2556","Type":"ContainerDied","Data":"0892989dfc28099a5c94e4567802e78cd045f1994f61d3ac134121c70afc5194"}
Jul 09 23:15:55.059037 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.059012    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:55.079580 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.079560    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7269-140015658421104_c75282b5-45ac-44e9-8c6c-4bb2982c2556/test-curl-7269-140015658421104/0.log"
Jul 09 23:15:55.104393 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.104364    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:55.106880 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.106856    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7269-140015658421104"]
Jul 09 23:15:55.149893 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.149867    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k5j9\" (UniqueName: \"kubernetes.io/projected/c75282b5-45ac-44e9-8c6c-4bb2982c2556-kube-api-access-9k5j9\") pod \"c75282b5-45ac-44e9-8c6c-4bb2982c2556\" (UID: \"c75282b5-45ac-44e9-8c6c-4bb2982c2556\") "
Jul 09 23:15:55.151865 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.151844    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75282b5-45ac-44e9-8c6c-4bb2982c2556-kube-api-access-9k5j9" (OuterVolumeSpecName: "kube-api-access-9k5j9") pod "c75282b5-45ac-44e9-8c6c-4bb2982c2556" (UID: "c75282b5-45ac-44e9-8c6c-4bb2982c2556"). InnerVolumeSpecName "kube-api-access-9k5j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:15:55.250838 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.250727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k5j9\" (UniqueName: \"kubernetes.io/projected/c75282b5-45ac-44e9-8c6c-4bb2982c2556-kube-api-access-9k5j9\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:15:55.934148 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.934118    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cf000a4d6af0b2271c690f9898790ce992cd030b30571eadbb7dfbc297b98df"
Jul 09 23:15:55.934148 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:55.934135    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:55.944027 ip-10-0-132-100 kubenswrapper[2576]: E0709 23:15:55.944002    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7269-140015658421104\" is forbidden: User \"system:node:ip-10-0-132-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-100.ec2.internal' and this object" podUID="c75282b5-45ac-44e9-8c6c-4bb2982c2556" pod="openshift-ingress/test-curl-7269-140015658421104"
Jul 09 23:15:57.043743 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:15:57.043712    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75282b5-45ac-44e9-8c6c-4bb2982c2556" path="/var/lib/kubelet/pods/c75282b5-45ac-44e9-8c6c-4bb2982c2556/volumes"
Jul 09 23:16:00.009566 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:00.009538    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"]
Jul 09 23:16:00.010064 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:00.009714    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7" podUID="fafa3ab3-de16-43b1-890a-e35b1fa1db00" containerName="cleanup" containerID="cri-o://67cbaf42393899c4c12e02e65549176c2544436d4239d762876f735b97b683a9" gracePeriod=30
Jul 09 23:16:00.012455 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:00.012430    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"]
Jul 09 23:16:00.012633 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:00.012597    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s" podUID="01fe11fd-3aad-45fc-9233-27c2ab8cc33e" containerName="cleanup" containerID="cri-o://c2d6ae6249dd0b7e403094503feaed34a627da0e9bd8b948a56a501a0d231ccc" gracePeriod=30
Jul 09 23:16:11.858051 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:11.858018    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"]
Jul 09 23:16:11.858476 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:11.858282    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy" containerID="cri-o://03db013900f5b5fc3d860c35608db2126b9674478d39268391073d5ed5cd98eb" gracePeriod=30
Jul 09 23:16:12.570933 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:12.570903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b8988d898-vn5r6_6692ec74-4c40-4dd5-9267-97982af92f8a/authorino/0.log"
Jul 09 23:16:17.058044 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.058010    2576 generic.go:356] "Generic (PLEG): container finished" podID="51045334-a922-44b1-a98b-73cebd7e5671" containerID="03db013900f5b5fc3d860c35608db2126b9674478d39268391073d5ed5cd98eb" exitCode=0
Jul 09 23:16:17.058531 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.058078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" event={"ID":"51045334-a922-44b1-a98b-73cebd7e5671","Type":"ContainerDied","Data":"03db013900f5b5fc3d860c35608db2126b9674478d39268391073d5ed5cd98eb"}
Jul 09 23:16:17.058531 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.058138    2576 scope.go:117] "RemoveContainer" containerID="f60c6e9918c1bd6011b03666405c09ebe6289c71e22137a9e1caefe12276badb"
Jul 09 23:16:17.117402 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.117378    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:16:17.255922 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.255828    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n89gm\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-kube-api-access-n89gm\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.255922 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.255876    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-data\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.255922 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.255905    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-credential-socket\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.256208 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.255935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51045334-a922-44b1-a98b-73cebd7e5671-istiod-ca-cert\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.256208 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.255962    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-certs\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.256208 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256003    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-socket\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.256208 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-envoy\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.256208 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256076    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-istio-token\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.256208 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51045334-a922-44b1-a98b-73cebd7e5671-istio-podinfo\") pod \"51045334-a922-44b1-a98b-73cebd7e5671\" (UID: \"51045334-a922-44b1-a98b-73cebd7e5671\") "
Jul 09 23:16:17.256518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256236    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:16:17.256518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256261    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:16:17.256518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256314    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:16:17.256518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256375    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51045334-a922-44b1-a98b-73cebd7e5671-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:16:17.256518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256489    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-certs\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.256518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256507    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-workload-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.256518 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256520    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-credential-socket\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.256932 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256535    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51045334-a922-44b1-a98b-73cebd7e5671-istiod-ca-cert\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.256932 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.256700    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-data" (OuterVolumeSpecName: "istio-data") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:16:17.258144 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.258114    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-kube-api-access-n89gm" (OuterVolumeSpecName: "kube-api-access-n89gm") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "kube-api-access-n89gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:16:17.258271 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.258183    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51045334-a922-44b1-a98b-73cebd7e5671-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 23:16:17.258633 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.258613    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:16:17.258769 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.258639    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-istio-token" (OuterVolumeSpecName: "istio-token") pod "51045334-a922-44b1-a98b-73cebd7e5671" (UID: "51045334-a922-44b1-a98b-73cebd7e5671"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:16:17.357981 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.357941    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-envoy\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.357981 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.357974    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-istio-token\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.357981 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.357983    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51045334-a922-44b1-a98b-73cebd7e5671-istio-podinfo\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.358214 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.357992    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n89gm\" (UniqueName: \"kubernetes.io/projected/51045334-a922-44b1-a98b-73cebd7e5671-kube-api-access-n89gm\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.358214 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.358003    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51045334-a922-44b1-a98b-73cebd7e5671-istio-data\") on node \"ip-10-0-132-100.ec2.internal\" DevicePath \"\""
Jul 09 23:16:17.565679 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.565648    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-s9v4k_77dbfc96-106b-4cb7-8d93-d480d89c7c51/manager/0.log"
Jul 09 23:16:17.690617 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.690589    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r462n_23e02090-d9cd-47fa-aa4c-43e89e1ba363/manager/0.log"
Jul 09 23:16:17.929299 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:17.929218    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cqt8l_21458a95-2e1c-47f3-9397-b2010c427f59/server/0.log"
Jul 09 23:16:18.065240 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.065201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx" event={"ID":"51045334-a922-44b1-a98b-73cebd7e5671","Type":"ContainerDied","Data":"3a1e669abcffee8f2f9752a33ec554531919ae41157ef340771e83657603c644"}
Jul 09 23:16:18.065240 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.065231    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"
Jul 09 23:16:18.065746 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.065273    2576 scope.go:117] "RemoveContainer" containerID="03db013900f5b5fc3d860c35608db2126b9674478d39268391073d5ed5cd98eb"
Jul 09 23:16:18.067227 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.067197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ff6bg_9209a16c-0c41-4aa1-8d5b-31799ec88369/manager/0.log"
Jul 09 23:16:18.094489 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.094460    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"]
Jul 09 23:16:18.097719 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.097697    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-57ed9c-openshift-default-65b8fd455f-7rbdx"]
Jul 09 23:16:18.191028 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.190953    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-brz4b_fcdcb477-ad9d-420e-81f7-a5b7de34064f/copy-manifests/0.log"
Jul 09 23:16:18.203969 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.203942    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-brz4b_fcdcb477-ad9d-420e-81f7-a5b7de34064f/manager/0.log"
Jul 09 23:16:18.958911 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:18.958884    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29727315-fvd4s_01fe11fd-3aad-45fc-9233-27c2ab8cc33e/cleanup/0.log"
Jul 09 23:16:19.043796 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:19.043755    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51045334-a922-44b1-a98b-73cebd7e5671" path="/var/lib/kubelet/pods/51045334-a922-44b1-a98b-73cebd7e5671/volumes"
Jul 09 23:16:19.189942 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:19.189912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7_fafa3ab3-de16-43b1-890a-e35b1fa1db00/cleanup/0.log"
Jul 09 23:16:19.310125 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:19.310103    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-g76s2_06e52312-6e59-4ecf-bb5f-ba792525d355/postgres/0.log"
Jul 09 23:16:20.669361 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:20.669328    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b8988d898-vn5r6_6692ec74-4c40-4dd5-9267-97982af92f8a/authorino/0.log"
Jul 09 23:16:20.793231 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:20.793189    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mcvzd_51da3c3f-c2c1-44d8-b352-be9e55a57512/manager/0.log"
Jul 09 23:16:21.032061 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:21.031983    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kzr82_77294efb-435c-44ac-a528-c52d30b102bb/kuadrant-console-plugin/0.log"
Jul 09 23:16:21.156941 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:21.156912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9psd2_213fb219-39c2-4f73-913d-d5cb1d90b83b/registry-server/0.log"
Jul 09 23:16:21.538260 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:21.538234    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8jqfn_4fbffb9f-f144-4735-9643-76f42e0492c5/manager/0.log"
Jul 09 23:16:22.260647 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:22.260619    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-gdglp_e2d6dc02-d430-4889-b4f5-40f80cd9f222/kube-auth-proxy/0.log"
Jul 09 23:16:22.382073 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:22.382037    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qnxtw_3741202c-f808-4479-8181-2f4162f3262e/istio-proxy/1.log"
Jul 09 23:16:22.511020 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:22.510915    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rqd9d_6d748cd9-c43f-4de4-a8e5-c4e946f50017/payload-pre-processing/0.log"
Jul 09 23:16:22.634351 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:22.634307    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ghxxh_e662ddce-015f-4fee-8b69-ac6dd2066c3b/payload-processing/0.log"
Jul 09 23:16:22.757893 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:22.757866    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757b46bf55-4nxhf_f33d731e-5a76-4dea-ac58-0b8fd82779b9/router/0.log"
Jul 09 23:16:23.120376 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:23.120350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lskb6_dbfc0eea-8f5f-43e3-8271-31c6be15c934/main/0.log"
Jul 09 23:16:23.360386 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:23.360353    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-25tts_0179119e-304b-4b8c-9792-6f17c6a94bff/main/0.log"
Jul 09 23:16:23.715719 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:23.715692    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-xs7sw_073bf167-9b58-41e9-bee2-a3f8809da793/main/0.log"
Jul 09 23:16:30.126716 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:30.126676    2576 generic.go:356] "Generic (PLEG): container finished" podID="fafa3ab3-de16-43b1-890a-e35b1fa1db00" containerID="67cbaf42393899c4c12e02e65549176c2544436d4239d762876f735b97b683a9" exitCode=137
Jul 09 23:16:30.127153 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:30.126745    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7" event={"ID":"fafa3ab3-de16-43b1-890a-e35b1fa1db00","Type":"ContainerDied","Data":"67cbaf42393899c4c12e02e65549176c2544436d4239d762876f735b97b683a9"}
Jul 09 23:16:30.128741 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:30.128716    2576 generic.go:356] "Generic (PLEG): container finished" podID="01fe11fd-3aad-45fc-9233-27c2ab8cc33e" containerID="c2d6ae6249dd0b7e403094503feaed34a627da0e9bd8b948a56a501a0d231ccc" exitCode=137
Jul 09 23:16:30.128872 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:30.128798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s" event={"ID":"01fe11fd-3aad-45fc-9233-27c2ab8cc33e","Type":"ContainerDied","Data":"c2d6ae6249dd0b7e403094503feaed34a627da0e9bd8b948a56a501a0d231ccc"}
Jul 09 23:16:30.220162 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:30.220142    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"
Jul 09 23:16:30.223082 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:30.223063    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"
Jul 09 23:16:31.135009 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.134982    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"
Jul 09 23:16:31.135457 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.135011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7" event={"ID":"fafa3ab3-de16-43b1-890a-e35b1fa1db00","Type":"ContainerDied","Data":"2eb43071ccd210f8f5768dfc5097059f46dc4abfd8c52521a49280edcf357689"}
Jul 09 23:16:31.135457 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.135069    2576 scope.go:117] "RemoveContainer" containerID="67cbaf42393899c4c12e02e65549176c2544436d4239d762876f735b97b683a9"
Jul 09 23:16:31.136466 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.136449    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"
Jul 09 23:16:31.136557 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.136450    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s" event={"ID":"01fe11fd-3aad-45fc-9233-27c2ab8cc33e","Type":"ContainerDied","Data":"bb11c845d5cd253f0273faecc2e53d00ed5888be09e9fb2c3e0618a4ab34bd09"}
Jul 09 23:16:31.143997 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.143975    2576 scope.go:117] "RemoveContainer" containerID="c2d6ae6249dd0b7e403094503feaed34a627da0e9bd8b948a56a501a0d231ccc"
Jul 09 23:16:31.154170 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.154144    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"]
Jul 09 23:16:31.156171 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.156151    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57ed9c-29727315-dplt7"]
Jul 09 23:16:31.165846 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.165823    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"]
Jul 09 23:16:31.171006 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.170983    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727315-fvd4s"]
Jul 09 23:16:31.442353 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.442323    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkjbc_a7e7d3e0-f913-44e8-846c-b8448fc96cd0/global-pull-secret-syncer/0.log"
Jul 09 23:16:31.546763 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.546733    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l2pw2_84715db1-e88e-47d8-a287-53ee262c1146/konnectivity-agent/0.log"
Jul 09 23:16:31.565189 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:31.565160    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-100.ec2.internal_2402c47062fa63a1f829c94ee7d64289/haproxy/0.log"
Jul 09 23:16:33.043880 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:33.043846    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01fe11fd-3aad-45fc-9233-27c2ab8cc33e" path="/var/lib/kubelet/pods/01fe11fd-3aad-45fc-9233-27c2ab8cc33e/volumes"
Jul 09 23:16:33.044253 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:33.044097    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fafa3ab3-de16-43b1-890a-e35b1fa1db00" path="/var/lib/kubelet/pods/fafa3ab3-de16-43b1-890a-e35b1fa1db00/volumes"
Jul 09 23:16:36.617278 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:36.617246    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b8988d898-vn5r6_6692ec74-4c40-4dd5-9267-97982af92f8a/authorino/0.log"
Jul 09 23:16:36.643575 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:36.643548    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mcvzd_51da3c3f-c2c1-44d8-b352-be9e55a57512/manager/0.log"
Jul 09 23:16:36.691528 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:36.691503    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kzr82_77294efb-435c-44ac-a528-c52d30b102bb/kuadrant-console-plugin/0.log"
Jul 09 23:16:36.726897 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:36.726874    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9psd2_213fb219-39c2-4f73-913d-d5cb1d90b83b/registry-server/0.log"
Jul 09 23:16:37.054480 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:37.054397    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8jqfn_4fbffb9f-f144-4735-9643-76f42e0492c5/manager/0.log"
Jul 09 23:16:38.917427 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:38.917401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65c9688d7c-n2mzx_e7c023f4-05a9-4c63-a5c0-45edc08da563/metrics-server/0.log"
Jul 09 23:16:39.132543 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:39.132514    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-spwj2_8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa/node-exporter/0.log"
Jul 09 23:16:39.151346 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:39.151319    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-spwj2_8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa/kube-rbac-proxy/0.log"
Jul 09 23:16:39.176697 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:39.176630    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-spwj2_8bf8b8ae-a5d5-447c-95cb-70dba15f8eaa/init-textfile/0.log"
Jul 09 23:16:39.456298 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:39.456218    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gwcpk_f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26/prometheus-operator/0.log"
Jul 09 23:16:39.474957 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:39.474931    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gwcpk_f2017e89-9dfc-42e9-a4b5-8fb1dd0aba26/kube-rbac-proxy/0.log"
Jul 09 23:16:41.351418 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351380    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"]
Jul 09 23:16:41.351804 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351740    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe11fd-3aad-45fc-9233-27c2ab8cc33e" containerName="cleanup"
Jul 09 23:16:41.351804 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351752    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe11fd-3aad-45fc-9233-27c2ab8cc33e" containerName="cleanup"
Jul 09 23:16:41.351804 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351765    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fafa3ab3-de16-43b1-890a-e35b1fa1db00" containerName="cleanup"
Jul 09 23:16:41.351804 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351770    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fafa3ab3-de16-43b1-890a-e35b1fa1db00" containerName="cleanup"
Jul 09 23:16:41.351804 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351798    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75282b5-45ac-44e9-8c6c-4bb2982c2556" containerName="test-curl-7269-140015658421104"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351809    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75282b5-45ac-44e9-8c6c-4bb2982c2556" containerName="test-curl-7269-140015658421104"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351819    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351824    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351834    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351839    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351894    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fe11fd-3aad-45fc-9233-27c2ab8cc33e" containerName="cleanup"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351902    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351908    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75282b5-45ac-44e9-8c6c-4bb2982c2556" containerName="test-curl-7269-140015658421104"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351913    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fafa3ab3-de16-43b1-890a-e35b1fa1db00" containerName="cleanup"
Jul 09 23:16:41.351986 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.351918    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51045334-a922-44b1-a98b-73cebd7e5671" containerName="istio-proxy"
Jul 09 23:16:41.356594 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.356576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.359373 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.359346    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bnh24\"/\"openshift-service-ca.crt\""
Jul 09 23:16:41.359764 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.359742    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bnh24\"/\"default-dockercfg-f4t74\""
Jul 09 23:16:41.360711 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.360696    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bnh24\"/\"kube-root-ca.crt\""
Jul 09 23:16:41.364570 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.364543    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"]
Jul 09 23:16:41.462847 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.462813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8299x\" (UniqueName: \"kubernetes.io/projected/2900ecf2-aa3f-44bc-9855-f18d54c8c383-kube-api-access-8299x\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.462847 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.462852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-proc\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.463102 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.462907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-sys\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.463102 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.462945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-lib-modules\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.463102 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.463035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-podres\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.564519 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-sys\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.564519 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-lib-modules\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.564768 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-podres\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.564768 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564613    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-sys\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.564768 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8299x\" (UniqueName: \"kubernetes.io/projected/2900ecf2-aa3f-44bc-9855-f18d54c8c383-kube-api-access-8299x\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.564768 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-proc\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.564768 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-proc\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.565002 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-lib-modules\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.565002 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.564850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2900ecf2-aa3f-44bc-9855-f18d54c8c383-podres\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.572249 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.572230    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8299x\" (UniqueName: \"kubernetes.io/projected/2900ecf2-aa3f-44bc-9855-f18d54c8c383-kube-api-access-8299x\") pod \"perf-node-gather-daemonset-cgmvr\" (UID: \"2900ecf2-aa3f-44bc-9855-f18d54c8c383\") " pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.667627 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.667561    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:41.798526 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:41.798505    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"]
Jul 09 23:16:41.800632 ip-10-0-132-100 kubenswrapper[2576]: W0709 23:16:41.800600    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2900ecf2_aa3f_44bc_9855_f18d54c8c383.slice/crio-f828bbdef9054b2e864e81b21ef657f175e86957ff1a5eafd2af158c42c91d1b WatchSource:0}: Error finding container f828bbdef9054b2e864e81b21ef657f175e86957ff1a5eafd2af158c42c91d1b: Status 404 returned error can't find the container with id f828bbdef9054b2e864e81b21ef657f175e86957ff1a5eafd2af158c42c91d1b
Jul 09 23:16:42.132396 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:42.132370    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-554bc48674-vcx5q_db936990-f0b0-4b2a-880e-2b51f147e0bf/console/0.log"
Jul 09 23:16:42.200327 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:42.200236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr" event={"ID":"2900ecf2-aa3f-44bc-9855-f18d54c8c383","Type":"ContainerStarted","Data":"a1ee53edb3fd4a95c76a61283e23d37951d41d451825e2b00dc6661f1746e522"}
Jul 09 23:16:42.200327 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:42.200303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr" event={"ID":"2900ecf2-aa3f-44bc-9855-f18d54c8c383","Type":"ContainerStarted","Data":"f828bbdef9054b2e864e81b21ef657f175e86957ff1a5eafd2af158c42c91d1b"}
Jul 09 23:16:42.200772 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:42.200332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:42.217197 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:42.217155    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr" podStartSLOduration=1.21714092 podStartE2EDuration="1.21714092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:16:42.215492324 +0000 UTC m=+2643.697315711" watchObservedRunningTime="2026-07-09 23:16:42.21714092 +0000 UTC m=+2643.698964306"
Jul 09 23:16:43.842455 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:43.842420    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-scvhq_a5c4d66a-ed79-4cf4-8005-c955f57ffc55/dns/0.log"
Jul 09 23:16:43.861415 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:43.861387    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-scvhq_a5c4d66a-ed79-4cf4-8005-c955f57ffc55/kube-rbac-proxy/0.log"
Jul 09 23:16:43.915428 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:43.915402    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qnnt7_753b0678-cea9-43dd-8ad3-c877bba38890/dns-node-resolver/0.log"
Jul 09 23:16:44.446522 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:44.446489    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-766c7c59d6-2zgtw_5a97aca7-18a0-47be-8859-4d44647d6384/registry/0.log"
Jul 09 23:16:44.492547 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:44.492519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ljvbg_bc362340-c7bb-4c6d-ba2f-28d38341dabf/node-ca/0.log"
Jul 09 23:16:45.584626 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:45.584591    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-gdglp_e2d6dc02-d430-4889-b4f5-40f80cd9f222/kube-auth-proxy/0.log"
Jul 09 23:16:45.612564 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:45.612532    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qnxtw_3741202c-f808-4479-8181-2f4162f3262e/istio-proxy/0.log"
Jul 09 23:16:45.641422 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:45.641397    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qnxtw_3741202c-f808-4479-8181-2f4162f3262e/istio-proxy/1.log"
Jul 09 23:16:45.671720 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:45.671693    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rqd9d_6d748cd9-c43f-4de4-a8e5-c4e946f50017/payload-pre-processing/0.log"
Jul 09 23:16:45.702059 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:45.702034    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ghxxh_e662ddce-015f-4fee-8b69-ac6dd2066c3b/payload-processing/0.log"
Jul 09 23:16:45.723817 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:45.723793    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757b46bf55-4nxhf_f33d731e-5a76-4dea-ac58-0b8fd82779b9/router/0.log"
Jul 09 23:16:46.395585 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:46.395561    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4c248_07d4c6de-55eb-45eb-8f3e-143c4659a67d/serve-healthcheck-canary/0.log"
Jul 09 23:16:46.905255 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:46.905227    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt5c6_a1fc9281-f315-460d-a892-d3b469fb0d29/kube-rbac-proxy/0.log"
Jul 09 23:16:46.925940 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:46.925920    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt5c6_a1fc9281-f315-460d-a892-d3b469fb0d29/exporter/0.log"
Jul 09 23:16:46.946427 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:46.946404    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt5c6_a1fc9281-f315-460d-a892-d3b469fb0d29/extractor/0.log"
Jul 09 23:16:48.215205 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:48.215174    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bnh24/perf-node-gather-daemonset-cgmvr"
Jul 09 23:16:49.351961 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:49.351933    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-s9v4k_77dbfc96-106b-4cb7-8d93-d480d89c7c51/manager/0.log"
Jul 09 23:16:49.477746 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:49.477664    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r462n_23e02090-d9cd-47fa-aa4c-43e89e1ba363/manager/0.log"
Jul 09 23:16:49.599741 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:49.599707    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cqt8l_21458a95-2e1c-47f3-9397-b2010c427f59/server/0.log"
Jul 09 23:16:49.663338 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:49.663292    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ff6bg_9209a16c-0c41-4aa1-8d5b-31799ec88369/manager/0.log"
Jul 09 23:16:49.739328 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:49.739236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-brz4b_fcdcb477-ad9d-420e-81f7-a5b7de34064f/manager/0.log"
Jul 09 23:16:49.755966 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:49.755945    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dbdc554f-brz4b_fcdcb477-ad9d-420e-81f7-a5b7de34064f/copy-manifests/0.log"
Jul 09 23:16:51.823557 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:51.823526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-gdglp_e2d6dc02-d430-4889-b4f5-40f80cd9f222/kube-auth-proxy/0.log"
Jul 09 23:16:51.841528 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:51.841465    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qnxtw_3741202c-f808-4479-8181-2f4162f3262e/istio-proxy/0.log"
Jul 09 23:16:51.870874 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:51.870850    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qnxtw_3741202c-f808-4479-8181-2f4162f3262e/istio-proxy/1.log"
Jul 09 23:16:51.892897 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:51.892870    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rqd9d_6d748cd9-c43f-4de4-a8e5-c4e946f50017/payload-pre-processing/0.log"
Jul 09 23:16:51.924189 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:51.924164    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ghxxh_e662ddce-015f-4fee-8b69-ac6dd2066c3b/payload-processing/0.log"
Jul 09 23:16:51.935540 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:51.935526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757b46bf55-4nxhf_f33d731e-5a76-4dea-ac58-0b8fd82779b9/router/0.log"
Jul 09 23:16:53.133008 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:53.132977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6965988765-gdglp_e2d6dc02-d430-4889-b4f5-40f80cd9f222/kube-auth-proxy/0.log"
Jul 09 23:16:53.151238 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:53.151208    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qnxtw_3741202c-f808-4479-8181-2f4162f3262e/istio-proxy/0.log"
Jul 09 23:16:53.184772 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:53.184746    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qnxtw_3741202c-f808-4479-8181-2f4162f3262e/istio-proxy/1.log"
Jul 09 23:16:53.213414 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:53.213390    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rqd9d_6d748cd9-c43f-4de4-a8e5-c4e946f50017/payload-pre-processing/0.log"
Jul 09 23:16:53.239054 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:53.239030    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ghxxh_e662ddce-015f-4fee-8b69-ac6dd2066c3b/payload-processing/0.log"
Jul 09 23:16:53.258919 ip-10-0-132-100 kubenswrapper[2576]: I0709 23:16:53.258897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-757b46bf55-4nxhf_f33d731e-5a76-4dea-ac58-0b8fd82779b9/router/0.log"